-- Logs begin at Thu 2022-07-21 07:46:13 UTC, end at Thu 2022-07-21 08:44:25 UTC. -- Jul 21 08:11:21.868673 dv-cinder-850318-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 08:11:21.879962 dv-cinder-850318-4-smb devstack@keystone.service[80210]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 08:11:21 2022] *** Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: nodename: dv-cinder-850318-4-smb Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: machine: x86_64 Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: clock source: unix Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: pcre jit disabled Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: detected number of CPU cores: 4 Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: current working directory: / Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: detected binary path: /usr/bin/uwsgi-core Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: your processes number limit is 47680 Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: your memory page size is 4096 bytes Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: detected max file descriptor number: 2048 Jul 21 08:11:21.882234 dv-cinder-850318-4-smb devstack@keystone.service[80210]: lock engine: pthread robust mutexes Jul 21 08:11:21.883062 dv-cinder-850318-4-smb devstack@keystone.service[80210]: thunder lock: enabled Jul 21 08:11:21.883062 dv-cinder-850318-4-smb devstack@keystone.service[80210]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 08:11:21.883062 dv-cinder-850318-4-smb devstack@keystone.service[80210]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 08:11:21.927250 dv-cinder-850318-4-smb devstack@keystone.service[80210]: Python main interpreter initialized at 0x56087f26b9c0 Jul 21 08:11:21.927250 dv-cinder-850318-4-smb devstack@keystone.service[80210]: python threads support enabled Jul 21 08:11:21.927250 dv-cinder-850318-4-smb devstack@keystone.service[80210]: your server socket listen backlog is limited to 100 connections Jul 21 08:11:21.927250 dv-cinder-850318-4-smb devstack@keystone.service[80210]: your mercy for graceful operations on workers is 90 seconds Jul 21 08:11:21.927632 dv-cinder-850318-4-smb devstack@keystone.service[80210]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 08:11:21.927632 dv-cinder-850318-4-smb devstack@keystone.service[80210]: *** Operational MODE: preforking *** Jul 21 08:11:21.927925 dv-cinder-850318-4-smb devstack@keystone.service[80210]: *** uWSGI is running in multiple interpreter mode *** Jul 21 08:11:21.927925 dv-cinder-850318-4-smb devstack@keystone.service[80210]: spawned uWSGI master process (pid: 80210) Jul 21 08:11:21.928187 dv-cinder-850318-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 21 08:11:21.930391 dv-cinder-850318-4-smb devstack@keystone.service[80210]: spawned uWSGI worker 1 (pid: 80223, cores: 1) Jul 21 08:11:21.930391 dv-cinder-850318-4-smb devstack@keystone.service[80210]: spawned uWSGI worker 2 (pid: 80224, cores: 1) Jul 21 08:11:21.930391 dv-cinder-850318-4-smb devstack@keystone.service[80210]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 08:11:27.468635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:11:27.468635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: from cryptography.utils import int_from_bytes Jul 21 08:11:27.469855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:11:27.469855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: from cryptography.utils import int_from_bytes Jul 21 08:11:27.519819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 08:11:27.520080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 08:11:27.520689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] command line args: [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 08:11:27.521062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 08:11:27.521297 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ================================================================================ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 08:11:27.521615 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] admin_token = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.521922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] config_dir = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.522165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.522481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] config_source = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.522660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] debug = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.522932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.524719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.524719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.524719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.524719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.525104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.525236 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_config_append = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.525530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.525809 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_dir = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.526114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.526500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.526894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.527275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.527642 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.527919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.528190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.528586 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.528959 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.529308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.529666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.530030 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.530385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.530761 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.531120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.531518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.532134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.532384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] publish_errors = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.532731 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.533036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.533286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.533613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.533927 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.534242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] standard_threads = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.534540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.534859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.535103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.535356 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_journal = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.535601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_json = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.535851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_stderr = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.536098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_syslog = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.536415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.536804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.537119 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.537453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.537766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.538241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.538502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.538822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.539182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.539527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.539621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:11:27.539621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: from cryptography.utils import int_from_bytes Jul 21 08:11:27.540234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.540346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:11:27.540346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: from cryptography.utils import int_from_bytes Jul 21 08:11:27.540621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.540621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.541087 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.541403 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.541718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.543168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.543507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.545480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.545846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.546200 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.546524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.546870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.548559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.548926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.549254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.549609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.549937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.550254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.550586 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.550903 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.551231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.551541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.551845 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.552245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.552533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.553038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.553362 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.553798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.554122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.554420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.554708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.555012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.555295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.555985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.556356 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.556772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.557130 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.557499 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.557852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.558215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.558584 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.558961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.559313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.559679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.560041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.560728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.561092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.561458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.561808 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.562188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.562549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.562906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.563261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.563654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.564018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.564415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.564821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.565209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.565598 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.565957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.566327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.566700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.567061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.567424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.567782 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.568149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.568533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.568939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.569544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.569883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.570250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.570613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.570972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.571376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.571767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.572128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.572535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.572895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.573266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.573635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.574105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.574441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.574844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.575230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.575638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.576029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.576402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.576849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.577235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.577672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.578065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.578507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.578898 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.579359 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.579755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.external = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.580117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.580613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.581030 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.581412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.password = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.581763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.token = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.582134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.582551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.582987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.583346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.583774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.584170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.584553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.584994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.585368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.585808 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.586188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.586550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.586978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.587401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.587818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.588317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.588456 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 08:11:27.588634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 08:11:27.588752 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.588880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] command line args: [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 08:11:27.589164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 08:11:27.589315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.589429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ================================================================================ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 08:11:27.589543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] admin_token = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.589653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.589963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] config_dir = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.589963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.590203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.590318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] config_source = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.590318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] debug = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.590542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.590657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.590821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.590940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.591052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.591161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.591391 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.591619 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.591619 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.591927 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.592077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_config_append = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.592077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.592312 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.592410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_dir = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.592410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.592733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.592861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.592861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.593100 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.593264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.593264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.593463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.593562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.593562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.593792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.593964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.594128 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.594293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.594465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.594465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.594713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.594846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.594846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.595175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.595354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.595501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.595630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.595630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.595921 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.596145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.596286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.596398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] publish_errors = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.596570 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.596721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.596864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.597067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.597236 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.597350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.597477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.597608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.597739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] standard_threads = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.597856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.598028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.598144 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.598361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.598539 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.598712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] use_journal = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.598712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] use_json = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.598975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] use_stderr = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.598975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] use_syslog = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.599307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.599496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:11:27.599496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.599792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.599925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.600109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.600221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.600221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.600676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.600856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.600856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.601083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.601189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.601315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.601454 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.601454 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.601737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.601884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.602014 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.602195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.602365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.602476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.602609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.602609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.602855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.602967 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.603096 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.603221 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.603330 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.603578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.603722 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.603869 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.603993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.604181 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.604323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.604453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.604625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.604805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.604940 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.605126 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.605262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.605391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.605541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.605628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.605763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.605901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.606032 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.606153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.606274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.606387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.606641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.606737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.606862 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.607009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.607152 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.607317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.607451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.607571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.607769 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.607984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.608135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.608232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.608360 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.608522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.608692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.608828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.609019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.609159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.609303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.609439 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.609556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.609677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.609819 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.609944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.610081 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.610204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.610321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.610474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.610595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.610708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.610928 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.611062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.611190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.611317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.611445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.611620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.611771 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.611906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.612032 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.612139 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.612300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.612427 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.612603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.612781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.612867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.613007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.613146 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.613261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.613496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.613635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.613763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.613909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.614028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.614198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.614345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.614469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.614652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.614789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.614917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.615179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.615373 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.615502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.615624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.615749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.615884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.616008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.616221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.616430 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.616599 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.616714 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.616816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.616939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.617078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.617195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.617337 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.617464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.617572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.617751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.617911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.618047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.618176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.618286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.618445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.618580 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.618679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.618898 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.619005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.619161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.619290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.619419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.619661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.619756 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.619849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.619980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.620108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.620313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.620455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.620621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.620756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.620880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.620996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.621151 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.621247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.621500 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.621615 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.621774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.621925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.622035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.622215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.622339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.622472 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.622611 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.622740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.622947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.623098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.623230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.623360 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.623486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.623660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.623796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.623942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.external = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.624066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.624193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.624398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.624567 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.624715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.624843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.624972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.password = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.625099 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.token = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.625219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.625338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.625513 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.625650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.625780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.625916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.626048 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.626218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.626368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.626500 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.626631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.626760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.626894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.627016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.627150 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.627350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.627495 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.627629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.627758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.627897 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.628054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.628183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.628297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.628643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.628784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.628784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.629026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.629151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.629281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.629413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.629540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.629704 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.629823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.630041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.630126 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.630321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.630412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.630578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.630750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.630868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.631038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.631161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.631273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.631477 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.631572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.631750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.632051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.632179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.632307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.632435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.632592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.632719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.632824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.633024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.633157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.633261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.633475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.633602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.633730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.633856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.633977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.634195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.634348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.634480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.634608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] role.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.634737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.634862 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.634970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] role.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.635095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.635327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.635457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.635709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.635849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.635978 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.636141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.636271 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.636379 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.636604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.636733 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.636877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.637009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.637135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.637365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.637499 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.637626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.637837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.637968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.638092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.638232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.638351 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.638562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.638707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.638834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.639017 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.639167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.639264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.639475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.639613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.639745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.639913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.640034 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.640165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.640394 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.640707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.640980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.641117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.641246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.641448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.641545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.641708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.641942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.642192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.642336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.642466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.642577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.642717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.642890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.643023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.643147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.643361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.643500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.643647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.643768 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.643893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.644153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.644335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.644467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.644712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.644848 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.644982 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.645114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.645214 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.645686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.645817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.646038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.646173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.646301 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.646431 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.646546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.646727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.646857 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.646987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.647108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.647230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.647466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.647619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.647751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.647956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.648090 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.648220 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.648330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.648657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.648657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.648795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.648892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.649112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.649219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.649341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.649466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.649591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.649817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.649934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.650078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.650169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.650265 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.650517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.650607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.650744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.650871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.650991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.651239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.651341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.651466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.651635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.651782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.651916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.652012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.652160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.652356 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.652444 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.652657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.652741 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.652917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.653134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.653273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.653400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.653537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.653664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.653829 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.653963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.654092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.654255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.654397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.662886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.664016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.665614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.665762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.665899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.666050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.666189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.666321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.666435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.666549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.666676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.666819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.666963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.667113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.667242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.667358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.667469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.667596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.667728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.667873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.668046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.668193 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.668331 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.668466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.668627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.668780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.668921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] role.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.669052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.669179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] role.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.669309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.669438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.669577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.669707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.669833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.669958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.670083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.670321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.670456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.670587 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.670717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.670843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.670974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 08:11:27.671915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.671915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.673059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.673059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.673059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.673059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.673059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.673059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.673059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.673059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.673059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.674072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.674072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.674072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.674072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.674072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.674072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.674072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.674072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.674072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.675029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.675029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.675029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.675029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.675029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.675029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.675029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.675029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.675029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.676024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.676024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.676024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.676024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.676024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.676024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.676024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.676024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.676024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.677087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.677087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.677087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.677087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.677087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.677087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.677087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.677087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.677087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.678089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.678089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.678089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.678089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.678089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.678089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.678089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:11:27.678089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 08:11:27.698418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.698697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.698825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.702456 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.702680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.702892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.707886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.712064 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.738629 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.739015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.741312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.741635 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.891528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.891805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.943368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.943709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.955180 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:27.955467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.012348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.012748 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.012898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.013074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.013233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.013366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.013558 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.013558 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.013843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.013843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.014080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.014262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.041275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.041621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.041854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.041854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.042250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.042480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.042691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.042869 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.042869 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.043115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.043262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.043394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.043394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.043394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.054989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.055440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.068878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.069422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.069643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.069856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.070059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.070291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.070496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.070730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.070930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.070930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.071323 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.071523 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.071723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.071723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:11:28.088717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.089123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.089334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 08:11:28.089552 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 08:11:28.089752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.089752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 08:11:28.090113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.090328 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.090532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 08:11:28.090724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.090916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.091107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.091318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.091521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.091724 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.091724 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.102009 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.102352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.102574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.102860 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.103064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.103272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.103466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.103677 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.111361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.112275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.114895 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.115219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.115454 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.115760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.115929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.116066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.116176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.116338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.116485 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.116715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.116855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.116985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.117095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.117249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.117350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.117517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.117625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.117787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.117932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.118032 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.118293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.118588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.145730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.146213 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.147376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.147721 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.147955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.148233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.153325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.153619 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.153762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.153899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.154031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.154161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.161408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.161616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.161713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.161867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.166645 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.166849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.166955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.167091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.167220 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.167368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.167479 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.167651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.167822 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.167956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.168083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.168212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.168360 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.168526 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.168658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.168789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.187658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.187931 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.188106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.188236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.192756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.193004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.196773 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.197054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.197054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.197207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.202335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.202693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.206239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.206524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.210267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.210572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.210775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.210996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.211193 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.211391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.211614 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.211808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.212022 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.212178 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.212340 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.212560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.231165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.231488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.231589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.231771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.231924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.232056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.232240 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.232577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.240285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.240694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.242156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.242431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.242597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.242946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.245876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.246425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.246425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.246679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.246841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.246983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.247123 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.247427 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.247749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.248141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.261080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.261357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.261680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.261916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.262199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.262466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.262773 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.263784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.264163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.264560 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.264959 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.265314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.265667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.266030 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.283212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.286627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.286875 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.290149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.290589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.291812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.293543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.293846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.294153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.294686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.296749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.299294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.299697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.300117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.301872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.303815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.307334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.307637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.307921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.308199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.309661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.311626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.315207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.315629 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.315997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.316379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.318077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.318379 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.318658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.327019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.327293 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.327570 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.327842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.328109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.328435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.328802 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.329070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.329432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.329616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.329616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.329880 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.330117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.330255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.330389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.330389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.330742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.338573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:11:28.338856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.339132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.339400 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.339658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.339923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.340214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.340453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.340751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.341011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.341275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.341523 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.341784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.342044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:11:28.369077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56087f26b9c0 pid: 80223 (default app) Jul 21 08:11:28.372741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dbb22-edac-4bc1-8171-f1d2ae1aa9a8 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:28.373036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dbb22-edac-4bc1-8171-f1d2ae1aa9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:28.373316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dbb22-edac-4bc1-8171-f1d2ae1aa9a8 None None] PATH_INFO: `/v3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:28.377732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Thu Jul 21 08:11:28 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:28.380129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56087f26b9c0 pid: 80224 (default app) Jul 21 08:11:36.415581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02322cef-48fa-4851-b7c0-9bc407f07757 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:36.416185 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02322cef-48fa-4851-b7c0-9bc407f07757 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:36.416185 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02322cef-48fa-4851-b7c0-9bc407f07757 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:36.417737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:36.428919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfca746-ed09-460d-b866-4159c0ca96ff None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:36.429538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfca746-ed09-460d-b866-4159c0ca96ff None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:36.429818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfca746-ed09-460d-b866-4159c0ca96ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:36.511065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: INFO dbcounter [None req-5cfca746-ed09-460d-b866-4159c0ca96ff None None] Registered counter for database keystone Jul 21 08:11:36.533973 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG oslo_db.sqlalchemy.engines [None req-5cfca746-ed09-460d-b866-4159c0ca96ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:11:36.541242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writer thread running {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:11:36.730876 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG passlib.handlers.bcrypt [None req-5cfca746-ed09-460d-b866-4159c0ca96ff None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80224) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 08:11:36.731308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG passlib.handlers.bcrypt [None req-5cfca746-ed09-460d-b866-4159c0ca96ff None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80224) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 08:11:36.788484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5cfca746-ed09-460d-b866-4159c0ca96ff None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:36.790141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5cfca746-ed09-460d-b866-4159c0ca96ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:36.934547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1/3] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 08:11:37.137036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02322cef-48fa-4851-b7c0-9bc407f07757 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:37.208953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: INFO dbcounter [None req-02322cef-48fa-4851-b7c0-9bc407f07757 None None] Registered counter for database keystone Jul 21 08:11:37.230209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG oslo_db.sqlalchemy.engines [None req-02322cef-48fa-4851-b7c0-9bc407f07757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:11:37.237162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writer thread running {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:11:37.363302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02322cef-48fa-4851-b7c0-9bc407f07757 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:37.367880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea7cc0-5299-467f-bdb3-2d0535d69285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:37.368608 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea7cc0-5299-467f-bdb3-2d0535d69285 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:37.368893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea7cc0-5299-467f-bdb3-2d0535d69285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:37.369167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea7cc0-5299-467f-bdb3-2d0535d69285 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:37.379007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea7cc0-5299-467f-bdb3-2d0535d69285 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:37.434169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: WARNING keystone.common.rbac_enforcer.enforcer [None req-51ea7cc0-5299-467f-bdb3-2d0535d69285 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 08:11:37.434851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea7cc0-5299-467f-bdb3-2d0535d69285 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:37.446684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 3/4] 10.222.0.40 () {58 vars in 1324 bytes} [Thu Jul 21 08:11:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:11:37.455911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfca746-ed09-460d-b866-4159c0ca96ff None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:37.477450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfca746-ed09-460d-b866-4159c0ca96ff None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:37.482681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0c8c6-477b-4068-a016-18e8e3d5a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:37.483937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0c8c6-477b-4068-a016-18e8e3d5a47a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:37.484223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0c8c6-477b-4068-a016-18e8e3d5a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:37.484519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0c8c6-477b-4068-a016-18e8e3d5a47a admin admin] PATH_INFO: `/v3/projects/3a9abea4928641f4840c146c33d7e1f5` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:37.486334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0c8c6-477b-4068-a016-18e8e3d5a47a admin admin] RBAC: Authorizing `identity:get_project(project_id=3a9abea4928641f4840c146c33d7e1f5)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:37.542798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: WARNING keystone.common.rbac_enforcer.enforcer [None req-17a0c8c6-477b-4068-a016-18e8e3d5a47a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 08:11:37.543120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0c8c6-477b-4068-a016-18e8e3d5a47a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:37.548068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 2/5] 10.222.0.40 () {56 vars in 1207 bytes} [Thu Jul 21 08:11:37 2022] GET /identity/v3/projects/3a9abea4928641f4840c146c33d7e1f5 => generated 344 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:39.701514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc0925-a6d7-4322-beba-d13bb64f563e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:39.702253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc0925-a6d7-4322-beba-d13bb64f563e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:39.702253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc0925-a6d7-4322-beba-d13bb64f563e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:39.706236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 4/6] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:39.713358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649d2cd-9865-419b-a9ef-f4aa099cd878 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:39.713945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649d2cd-9865-419b-a9ef-f4aa099cd878 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:39.713945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649d2cd-9865-419b-a9ef-f4aa099cd878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:39.735770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4649d2cd-9865-419b-a9ef-f4aa099cd878 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:39.737542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4649d2cd-9865-419b-a9ef-f4aa099cd878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:39.746861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 3/7] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 21 08:11:39.771412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc0925-a6d7-4322-beba-d13bb64f563e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:39.785905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc0925-a6d7-4322-beba-d13bb64f563e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:39.791939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338fb1c-6fed-42cd-b932-97a82cc8f467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:39.792682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338fb1c-6fed-42cd-b932-97a82cc8f467 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:39.792952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338fb1c-6fed-42cd-b932-97a82cc8f467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:39.793228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338fb1c-6fed-42cd-b932-97a82cc8f467 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:39.803417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338fb1c-6fed-42cd-b932-97a82cc8f467 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:39.805489 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338fb1c-6fed-42cd-b932-97a82cc8f467 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:39.816576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 5/8] 10.222.0.40 () {58 vars in 1324 bytes} [Thu Jul 21 08:11:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:11:39.823371 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649d2cd-9865-419b-a9ef-f4aa099cd878 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:39.834063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649d2cd-9865-419b-a9ef-f4aa099cd878 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:39.841901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450e003-74d3-4cda-98f4-c83e7e046865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:39.842837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450e003-74d3-4cda-98f4-c83e7e046865 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:39.843187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450e003-74d3-4cda-98f4-c83e7e046865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:39.843497 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450e003-74d3-4cda-98f4-c83e7e046865 admin admin] PATH_INFO: `/v3/users/51be48ea284046818e95b0cd55b089e7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:39.845336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450e003-74d3-4cda-98f4-c83e7e046865 admin admin] RBAC: Authorizing `identity:get_user(user_id=51be48ea284046818e95b0cd55b089e7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:39.847267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450e003-74d3-4cda-98f4-c83e7e046865 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:39.849093 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 4/9] 10.222.0.40 () {56 vars in 1198 bytes} [Thu Jul 21 08:11:39 2022] GET /identity/v3/users/51be48ea284046818e95b0cd55b089e7 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:42.024526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786014e-d5e1-4211-bcf6-d8745fc691b6 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:42.025421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786014e-d5e1-4211-bcf6-d8745fc691b6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:42.025583 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786014e-d5e1-4211-bcf6-d8745fc691b6 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:42.028268 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:42.036632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8ae67-768d-4fdb-81f5-25da34bb2ccb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:42.037164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8ae67-768d-4fdb-81f5-25da34bb2ccb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:42.037164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8ae67-768d-4fdb-81f5-25da34bb2ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:42.041372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829d172-4075-4e8c-a54a-0da0a64076ce None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:42.041880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829d172-4075-4e8c-a54a-0da0a64076ce None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:42.042385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829d172-4075-4e8c-a54a-0da0a64076ce None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:42.045015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 7/11] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:42.054602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bef5b-0a26-4a98-bd45-bc1875ee9e48 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:42.055110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bef5b-0a26-4a98-bd45-bc1875ee9e48 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:42.055325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-88f8ae67-768d-4fdb-81f5-25da34bb2ccb None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:42.055604 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bef5b-0a26-4a98-bd45-bc1875ee9e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:42.056591 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-88f8ae67-768d-4fdb-81f5-25da34bb2ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:42.129164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG passlib.handlers.bcrypt [None req-359bef5b-0a26-4a98-bd45-bc1875ee9e48 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80223) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 08:11:42.129580 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG passlib.handlers.bcrypt [None req-359bef5b-0a26-4a98-bd45-bc1875ee9e48 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80223) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 08:11:42.149362 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 5/12] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:11:42.175636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-359bef5b-0a26-4a98-bd45-bc1875ee9e48 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:42.177332 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-359bef5b-0a26-4a98-bd45-bc1875ee9e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:42.191143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8ae67-768d-4fdb-81f5-25da34bb2ccb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:42.221821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:42.335040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 8/13] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:11:42.338920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8ae67-768d-4fdb-81f5-25da34bb2ccb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:42.357417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bef5b-0a26-4a98-bd45-bc1875ee9e48 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:42.381246 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a506d-e6a6-4f69-916c-d90ee431d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:42.382270 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a506d-e6a6-4f69-916c-d90ee431d104 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:42.382634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a506d-e6a6-4f69-916c-d90ee431d104 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:42.382998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a506d-e6a6-4f69-916c-d90ee431d104 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:42.397662 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a506d-e6a6-4f69-916c-d90ee431d104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d45a506d-e6a6-4f69-916c-d90ee431d104 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:11:42.409250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:11:42.410268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:11:42.411108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 6/14] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:11:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:11:42.417184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a506d-e6a6-4f69-916c-d90ee431d104 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:42.509190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bef5b-0a26-4a98-bd45-bc1875ee9e48 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:42.512221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:42.515678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:42.541822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a506d-e6a6-4f69-916c-d90ee431d104 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:42.563406 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332cf6-2368-45f4-9dd7-f73efbdea03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:42.565151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332cf6-2368-45f4-9dd7-f73efbdea03b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:42.565357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332cf6-2368-45f4-9dd7-f73efbdea03b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:42.565624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332cf6-2368-45f4-9dd7-f73efbdea03b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:42.584189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addae1f4-8fe7-4ae0-b183-3cc739f169d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:42.585132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addae1f4-8fe7-4ae0-b183-3cc739f169d6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:42.585524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addae1f4-8fe7-4ae0-b183-3cc739f169d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:42.585885 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addae1f4-8fe7-4ae0-b183-3cc739f169d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:42.586820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addae1f4-8fe7-4ae0-b183-3cc739f169d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:11:42.587208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addae1f4-8fe7-4ae0-b183-3cc739f169d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:42.588783 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addae1f4-8fe7-4ae0-b183-3cc739f169d6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:42.605371 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 7/15] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:11:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:11:42.612779 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addae1f4-8fe7-4ae0-b183-3cc739f169d6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:42.655380 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd332cf6-2368-45f4-9dd7-f73efbdea03b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:42.657088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd332cf6-2368-45f4-9dd7-f73efbdea03b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:42.742652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addae1f4-8fe7-4ae0-b183-3cc739f169d6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:42.767473 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 9/16] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:11:42.774251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332cf6-2368-45f4-9dd7-f73efbdea03b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:42.777609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:42.795652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cc9a1-3ea0-4bfa-adba-492a29dba122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:42.796832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cc9a1-3ea0-4bfa-adba-492a29dba122 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:42.797112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cc9a1-3ea0-4bfa-adba-492a29dba122 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:42.797460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cc9a1-3ea0-4bfa-adba-492a29dba122 None admin] PATH_INFO: `/v3/users/51be48ea284046818e95b0cd55b089e7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:42.799281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cc9a1-3ea0-4bfa-adba-492a29dba122 None admin] RBAC: Authorizing `identity:get_user(user_id=51be48ea284046818e95b0cd55b089e7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:42.801365 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cc9a1-3ea0-4bfa-adba-492a29dba122 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:42.804613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 8/17] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:11:42 2022] GET /identity/v3/users/51be48ea284046818e95b0cd55b089e7 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:42.810248 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cc9a1-3ea0-4bfa-adba-492a29dba122 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:42.833810 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:42.925240 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332cf6-2368-45f4-9dd7-f73efbdea03b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:42.957159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cc9a1-3ea0-4bfa-adba-492a29dba122 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:42.977947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93766d69-980c-497a-88bd-0a3d92159caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:42.978946 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93766d69-980c-497a-88bd-0a3d92159caa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:42.979314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93766d69-980c-497a-88bd-0a3d92159caa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:42.979785 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93766d69-980c-497a-88bd-0a3d92159caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:43.003955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263acea-ca3d-48b4-9336-ac1cc8d0889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:43.004467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93766d69-980c-497a-88bd-0a3d92159caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:43.004814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263acea-ca3d-48b4-9336-ac1cc8d0889c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:43.005090 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263acea-ca3d-48b4-9336-ac1cc8d0889c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:43.005362 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263acea-ca3d-48b4-9336-ac1cc8d0889c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:43.006467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93766d69-980c-497a-88bd-0a3d92159caa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:43.006768 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263acea-ca3d-48b4-9336-ac1cc8d0889c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:43.008266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263acea-ca3d-48b4-9336-ac1cc8d0889c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:43.010298 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:11:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:11:43.019953 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263acea-ca3d-48b4-9336-ac1cc8d0889c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-93766d69-980c-497a-88bd-0a3d92159caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:11:43.046217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:11:43.047821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:11:43.048884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:11:43.048884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:11:43.048884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:11:43.048884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:11:43.048884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:11:43.057447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93766d69-980c-497a-88bd-0a3d92159caa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:43.130450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:43.153467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263acea-ca3d-48b4-9336-ac1cc8d0889c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:43.164685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:43.193900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f830a8-89ab-4d3b-aa3a-7e046193cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:43.194633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f830a8-89ab-4d3b-aa3a-7e046193cc4d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:43.194914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f830a8-89ab-4d3b-aa3a-7e046193cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:43.195180 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f830a8-89ab-4d3b-aa3a-7e046193cc4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:43.196066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f830a8-89ab-4d3b-aa3a-7e046193cc4d None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.domain.id=default, user.id=51be48ea284046818e95b0cd55b089e7) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:11:43.196370 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f830a8-89ab-4d3b-aa3a-7e046193cc4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:43.197922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f830a8-89ab-4d3b-aa3a-7e046193cc4d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:43.205936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1322 bytes} [Thu Jul 21 08:11:43 2022] GET /identity/v3/role_assignments?user.id=51be48ea284046818e95b0cd55b089e7&scope.domain.id=default&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 233 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:43.227798 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93766d69-980c-497a-88bd-0a3d92159caa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:43.288797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfdd72-4ac2-4f31-bff1-caf771cf1e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:43.289928 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfdd72-4ac2-4f31-bff1-caf771cf1e24 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:43.290334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfdd72-4ac2-4f31-bff1-caf771cf1e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:43.290943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfdd72-4ac2-4f31-bff1-caf771cf1e24 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:43.292708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfdd72-4ac2-4f31-bff1-caf771cf1e24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:11:43.293227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfdd72-4ac2-4f31-bff1-caf771cf1e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:43.295251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfdd72-4ac2-4f31-bff1-caf771cf1e24 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:43.329520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 11/21] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:45.617657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be595ba1-35fa-463b-b289-9a1a830b8a8a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:45.617657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be595ba1-35fa-463b-b289-9a1a830b8a8a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:45.617657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be595ba1-35fa-463b-b289-9a1a830b8a8a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:45.618788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:45.630781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff49c47-83d5-4930-b61c-118d7264258d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:45.631903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff49c47-83d5-4930-b61c-118d7264258d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:45.632383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff49c47-83d5-4930-b61c-118d7264258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:45.661851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7ff49c47-83d5-4930-b61c-118d7264258d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:45.663705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7ff49c47-83d5-4930-b61c-118d7264258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:45.765041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:11:45.810351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be595ba1-35fa-463b-b289-9a1a830b8a8a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:45.963616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be595ba1-35fa-463b-b289-9a1a830b8a8a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:46.020000 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a00b79-ca04-40e4-87b2-c5194d6f68aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:46.021581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a00b79-ca04-40e4-87b2-c5194d6f68aa None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:46.022089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a00b79-ca04-40e4-87b2-c5194d6f68aa None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:46.022666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a00b79-ca04-40e4-87b2-c5194d6f68aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:46.041669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a00b79-ca04-40e4-87b2-c5194d6f68aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-78a00b79-ca04-40e4-87b2-c5194d6f68aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:11:46.049933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:11:46.050830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:11:46.051564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:11:46.051564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:11:46.051564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:11:46.051564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:11:46.051564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:11:46.051564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:11:46.051564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:11:46.051564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:11:46.051564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:11:46.051564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:11:46.051564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:11:46.051564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:11:46.054186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 12/24] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:11:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:11:46.061830 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff49c47-83d5-4930-b61c-118d7264258d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:46.176135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:46.248662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff49c47-83d5-4930-b61c-118d7264258d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:46.308537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91035f2c-3c1a-4f8b-9e11-29ad41052950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:46.309244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91035f2c-3c1a-4f8b-9e11-29ad41052950 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:46.309527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91035f2c-3c1a-4f8b-9e11-29ad41052950 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:46.309803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91035f2c-3c1a-4f8b-9e11-29ad41052950 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:46.310597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91035f2c-3c1a-4f8b-9e11-29ad41052950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:11:46.310907 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91035f2c-3c1a-4f8b-9e11-29ad41052950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:46.312378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91035f2c-3c1a-4f8b-9e11-29ad41052950 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:46.340917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 13/25] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:11:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:46.347570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a00b79-ca04-40e4-87b2-c5194d6f68aa None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:46.362562 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:46.490784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18ef2-81a8-454a-8a33-24e0f92e12af None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:46.491768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18ef2-81a8-454a-8a33-24e0f92e12af None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:46.492594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18ef2-81a8-454a-8a33-24e0f92e12af None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:46.495174 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 14/26] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:11:46.505121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10cd81-7687-4508-b799-a270c7457271 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:46.505792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10cd81-7687-4508-b799-a270c7457271 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:46.506279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10cd81-7687-4508-b799-a270c7457271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:46.549112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ac10cd81-7687-4508-b799-a270c7457271 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:46.552086 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ac10cd81-7687-4508-b799-a270c7457271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:46.586386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a00b79-ca04-40e4-87b2-c5194d6f68aa None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:46.673237 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad8eaf-6355-47ca-a597-9eb5a8626352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:46.675086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad8eaf-6355-47ca-a597-9eb5a8626352 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:46.675514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad8eaf-6355-47ca-a597-9eb5a8626352 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:46.676017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad8eaf-6355-47ca-a597-9eb5a8626352 None admin] PATH_INFO: `/v3/users/51be48ea284046818e95b0cd55b089e7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:46.680417 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad8eaf-6355-47ca-a597-9eb5a8626352 None admin] RBAC: Authorizing `identity:get_user(user_id=51be48ea284046818e95b0cd55b089e7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:46.684150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad8eaf-6355-47ca-a597-9eb5a8626352 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:46.687508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 13/27] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:11:46 2022] GET /identity/v3/users/51be48ea284046818e95b0cd55b089e7 => generated 247 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:46.717141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad8eaf-6355-47ca-a597-9eb5a8626352 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:46.825007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 15/28] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:11:46.826623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d00bf-3f83-4e27-bba2-62349b5dfe29 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:46.827028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d00bf-3f83-4e27-bba2-62349b5dfe29 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:46.827319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d00bf-3f83-4e27-bba2-62349b5dfe29 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:46.833746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 16/29] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:46.872443 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:46.874247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097f791-cac7-44d7-8c8e-e2207374b75c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:46.874542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097f791-cac7-44d7-8c8e-e2207374b75c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:46.875154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097f791-cac7-44d7-8c8e-e2207374b75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:46.906356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1097f791-cac7-44d7-8c8e-e2207374b75c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:46.908908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1097f791-cac7-44d7-8c8e-e2207374b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:46.928106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad8eaf-6355-47ca-a597-9eb5a8626352 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:46.972911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:47.007001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467513a-ba8a-4469-8a4f-e3984ee6c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:47.007844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467513a-ba8a-4469-8a4f-e3984ee6c545 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:47.008124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467513a-ba8a-4469-8a4f-e3984ee6c545 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:47.008395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467513a-ba8a-4469-8a4f-e3984ee6c545 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:47.010825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467513a-ba8a-4469-8a4f-e3984ee6c545 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:47.012386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467513a-ba8a-4469-8a4f-e3984ee6c545 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:47.014250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 14/30] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:11:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:47.015962 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467513a-ba8a-4469-8a4f-e3984ee6c545 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:47.056257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 17/31] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:11:47.058391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097f791-cac7-44d7-8c8e-e2207374b75c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:47.170221 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467513a-ba8a-4469-8a4f-e3984ee6c545 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:47.215842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64440327-fdf5-4490-8095-d22dc621f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:47.216877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64440327-fdf5-4490-8095-d22dc621f9e0 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:47.217326 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64440327-fdf5-4490-8095-d22dc621f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:47.217901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64440327-fdf5-4490-8095-d22dc621f9e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:47.218844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64440327-fdf5-4490-8095-d22dc621f9e0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:47.220568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64440327-fdf5-4490-8095-d22dc621f9e0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:47.239170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:47.284283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097f791-cac7-44d7-8c8e-e2207374b75c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:47.352239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215487b2-95bc-4dbf-acf4-6aebbb5b3a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:47.353845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215487b2-95bc-4dbf-acf4-6aebbb5b3a18 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:47.354323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215487b2-95bc-4dbf-acf4-6aebbb5b3a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:47.354816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215487b2-95bc-4dbf-acf4-6aebbb5b3a18 None admin] PATH_INFO: `/v3/domains/default/users/51be48ea284046818e95b0cd55b089e7/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:47.359443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215487b2-95bc-4dbf-acf4-6aebbb5b3a18 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=51be48ea284046818e95b0cd55b089e7, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:47.362376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215487b2-95bc-4dbf-acf4-6aebbb5b3a18 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:47.369443 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 15/32] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 21 08:11:47 2022] POST /identity/v3/roles => generated 219 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:11:47.370834 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1284c-82d4-4177-8c04-e58a4bb8af2b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:47.371285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1284c-82d4-4177-8c04-e58a4bb8af2b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:47.371695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1284c-82d4-4177-8c04-e58a4bb8af2b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:47.374067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:47.375646 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1284c-82d4-4177-8c04-e58a4bb8af2b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:47.520082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1284c-82d4-4177-8c04-e58a4bb8af2b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:47.525430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 18/34] 10.222.0.40 () {58 vars in 1361 bytes} [Thu Jul 21 08:11:47 2022] PUT /identity/v3/domains/default/users/51be48ea284046818e95b0cd55b089e7/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:11:47.526835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbc873-a608-4d76-9911-cadb07af27b6 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:47.527134 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbc873-a608-4d76-9911-cadb07af27b6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:47.527519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbc873-a608-4d76-9911-cadb07af27b6 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:47.533356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 19/35] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:47.535368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66950f3-4f91-44a1-a02c-c5cfa2b1d6e1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:47.535368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66950f3-4f91-44a1-a02c-c5cfa2b1d6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:47.535614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66950f3-4f91-44a1-a02c-c5cfa2b1d6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:47.557368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d66950f3-4f91-44a1-a02c-c5cfa2b1d6e1 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:47.559142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d66950f3-4f91-44a1-a02c-c5cfa2b1d6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:47.588291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e42c6-98d8-47b5-819a-d11c964af060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:47.589197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e42c6-98d8-47b5-819a-d11c964af060 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:47.589594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e42c6-98d8-47b5-819a-d11c964af060 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:47.589905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e42c6-98d8-47b5-819a-d11c964af060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:47.613173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:47.624295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e42c6-98d8-47b5-819a-d11c964af060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:47.630802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e42c6-98d8-47b5-819a-d11c964af060 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2f1e42c6-98d8-47b5-819a-d11c964af060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:11:47.674537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:11:47.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:11:47.678249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:11:47.678249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:11:47.678249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:11:47.678249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:11:47.686145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 20/37] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:11:47.686701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 17/37] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:11:47.692256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f3432-7ab7-4295-8be7-c60b7b3ce8d6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:47.692256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f3432-7ab7-4295-8be7-c60b7b3ce8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:47.692256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f3432-7ab7-4295-8be7-c60b7b3ce8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:47.693682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e42c6-98d8-47b5-819a-d11c964af060 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:47.718781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6d7f3432-7ab7-4295-8be7-c60b7b3ce8d6 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:47.720114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6d7f3432-7ab7-4295-8be7-c60b7b3ce8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:47.794227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:47.823183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 21/38] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:11:47.824367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f3432-7ab7-4295-8be7-c60b7b3ce8d6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:47.874285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e42c6-98d8-47b5-819a-d11c964af060 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:47.934361 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753704da-e2a3-4b4e-b7df-cdd7fe650f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:47.936123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753704da-e2a3-4b4e-b7df-cdd7fe650f97 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:47.936975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753704da-e2a3-4b4e-b7df-cdd7fe650f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:47.937737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753704da-e2a3-4b4e-b7df-cdd7fe650f97 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:47.939796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753704da-e2a3-4b4e-b7df-cdd7fe650f97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:11:47.940714 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753704da-e2a3-4b4e-b7df-cdd7fe650f97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:47.944359 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753704da-e2a3-4b4e-b7df-cdd7fe650f97 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:47.965512 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:47.978038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 18/39] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:47.980094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753704da-e2a3-4b4e-b7df-cdd7fe650f97 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:47.984263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f3432-7ab7-4295-8be7-c60b7b3ce8d6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:48.034342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad7d23-499d-4b8f-8e40-6e18ac153eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:48.035121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad7d23-499d-4b8f-8e40-6e18ac153eea None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:48.035364 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad7d23-499d-4b8f-8e40-6e18ac153eea None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:48.035716 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad7d23-499d-4b8f-8e40-6e18ac153eea None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:48.036415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad7d23-499d-4b8f-8e40-6e18ac153eea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:48.038496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad7d23-499d-4b8f-8e40-6e18ac153eea None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:48.066147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 22/40] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 21 08:11:47 2022] POST /identity/v3/roles => generated 225 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:11:48.067342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad7d23-499d-4b8f-8e40-6e18ac153eea None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:48.234316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753704da-e2a3-4b4e-b7df-cdd7fe650f97 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:48.258393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:48.289116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad7d23-499d-4b8f-8e40-6e18ac153eea None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:48.293006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c1100-1035-4fa0-ba78-cd5c62aeaf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:48.294239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c1100-1035-4fa0-ba78-cd5c62aeaf09 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:48.295931 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c1100-1035-4fa0-ba78-cd5c62aeaf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:48.296551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c1100-1035-4fa0-ba78-cd5c62aeaf09 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:48.297715 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c1100-1035-4fa0-ba78-cd5c62aeaf09 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:48.299505 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c1100-1035-4fa0-ba78-cd5c62aeaf09 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:48.332580 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 19/41] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 21 08:11:47 2022] POST /identity/v3/roles => generated 223 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:11:48.334371 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97944b7a-9de4-4191-a323-dca34a7f1f7f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:48.334907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97944b7a-9de4-4191-a323-dca34a7f1f7f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:48.335463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97944b7a-9de4-4191-a323-dca34a7f1f7f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:48.338412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 20/42] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:48.349064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23512c2e-91c4-4c51-a0fa-e9967e83f51f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:48.349599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23512c2e-91c4-4c51-a0fa-e9967e83f51f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:48.350025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23512c2e-91c4-4c51-a0fa-e9967e83f51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:48.382831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8e316-64f3-4e4f-b51f-cbbfc3533b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:48.385352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8e316-64f3-4e4f-b51f-cbbfc3533b23 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:48.386298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8e316-64f3-4e4f-b51f-cbbfc3533b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:48.387085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8e316-64f3-4e4f-b51f-cbbfc3533b23 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:48.388869 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8e316-64f3-4e4f-b51f-cbbfc3533b23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:48.392362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8e316-64f3-4e4f-b51f-cbbfc3533b23 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:48.444271 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:48.459446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 23/43] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:11:48 2022] POST /identity/v3/projects => generated 301 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:11:48.505636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-23512c2e-91c4-4c51-a0fa-e9967e83f51f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:48.507891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-23512c2e-91c4-4c51-a0fa-e9967e83f51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:48.611866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 21/44] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:11:48.661536 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8e316-64f3-4e4f-b51f-cbbfc3533b23 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:48.819671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8e316-64f3-4e4f-b51f-cbbfc3533b23 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:48.859407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c1f4a-534e-4cbf-aa45-2937e80ee7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:48.860303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c1f4a-534e-4cbf-aa45-2937e80ee7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:48.860631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c1f4a-534e-4cbf-aa45-2937e80ee7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:48.860992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c1f4a-534e-4cbf-aa45-2937e80ee7d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:48.862568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c1f4a-534e-4cbf-aa45-2937e80ee7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:48.864230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c1f4a-534e-4cbf-aa45-2937e80ee7d9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:48.866096 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 24/45] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:11:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:48.872158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23512c2e-91c4-4c51-a0fa-e9967e83f51f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:48.994143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23512c2e-91c4-4c51-a0fa-e9967e83f51f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:48.996988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:49.042934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bbc02-436f-414d-ab6e-42da9ba319c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:49.043825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bbc02-436f-414d-ab6e-42da9ba319c0 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:49.044256 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bbc02-436f-414d-ab6e-42da9ba319c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:49.044718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bbc02-436f-414d-ab6e-42da9ba319c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:49.045625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bbc02-436f-414d-ab6e-42da9ba319c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:49.047816 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bbc02-436f-414d-ab6e-42da9ba319c0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:49.082249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 22/46] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:11:48 2022] POST /identity/v3/projects => generated 312 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:11:49.960226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e745944-4f1a-473b-a158-b12e04f83049 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:49.960823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e745944-4f1a-473b-a158-b12e04f83049 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:49.961259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e745944-4f1a-473b-a158-b12e04f83049 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:49.963918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 25/47] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:49.970438 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65469e-12c2-402f-a425-ae4fb9f45185 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:49.971042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65469e-12c2-402f-a425-ae4fb9f45185 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:49.971228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65469e-12c2-402f-a425-ae4fb9f45185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:49.991924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7a65469e-12c2-402f-a425-ae4fb9f45185 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:49.993250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7a65469e-12c2-402f-a425-ae4fb9f45185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:50.087674 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 23/48] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:11:50.111513 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e745944-4f1a-473b-a158-b12e04f83049 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:50.205195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:50.247100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e745944-4f1a-473b-a158-b12e04f83049 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:50.289784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec668b4-d3f9-420d-9733-fed5abb9bab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:50.290710 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec668b4-d3f9-420d-9733-fed5abb9bab4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:50.291073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec668b4-d3f9-420d-9733-fed5abb9bab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:50.291412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec668b4-d3f9-420d-9733-fed5abb9bab4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:50.311574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec668b4-d3f9-420d-9733-fed5abb9bab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5ec668b4-d3f9-420d-9733-fed5abb9bab4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:11:50.329195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:11:50.330212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:11:50.330944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:11:50.330944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:11:50.330944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:11:50.330944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:11:50.330944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:11:50.330944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:11:50.330944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:11:50.330944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:11:50.330944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:11:50.330944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:11:50.330944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:11:50.330944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:11:50.332095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 26/49] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:11:50.338787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65469e-12c2-402f-a425-ae4fb9f45185 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:50.435786 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:50.457595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65469e-12c2-402f-a425-ae4fb9f45185 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:50.506076 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cc3c6-8900-48b1-8168-94f3bf192902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:50.506709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cc3c6-8900-48b1-8168-94f3bf192902 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:50.506989 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cc3c6-8900-48b1-8168-94f3bf192902 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:50.507265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cc3c6-8900-48b1-8168-94f3bf192902 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:50.508028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cc3c6-8900-48b1-8168-94f3bf192902 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:11:50.508332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cc3c6-8900-48b1-8168-94f3bf192902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:50.509788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cc3c6-8900-48b1-8168-94f3bf192902 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:50.527585 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 24/50] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:11:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:50.529803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec668b4-d3f9-420d-9733-fed5abb9bab4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:50.656331 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec668b4-d3f9-420d-9733-fed5abb9bab4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:50.688339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:50.698563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279288b7-6a2a-4e2f-be6c-8867b428c321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:50.699484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279288b7-6a2a-4e2f-be6c-8867b428c321 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:50.699764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279288b7-6a2a-4e2f-be6c-8867b428c321 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:50.700036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279288b7-6a2a-4e2f-be6c-8867b428c321 None admin] PATH_INFO: `/v3/users/51be48ea284046818e95b0cd55b089e7` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:50.701541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279288b7-6a2a-4e2f-be6c-8867b428c321 None admin] RBAC: Authorizing `identity:get_user(user_id=51be48ea284046818e95b0cd55b089e7)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:50.703080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279288b7-6a2a-4e2f-be6c-8867b428c321 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:50.704918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 27/51] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:11:50 2022] GET /identity/v3/users/51be48ea284046818e95b0cd55b089e7 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:50.713821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cc3c6-8900-48b1-8168-94f3bf192902 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:50.831812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cc3c6-8900-48b1-8168-94f3bf192902 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:50.873833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee0703-d823-418b-ae45-fe1c0f43a3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:50.874672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee0703-d823-418b-ae45-fe1c0f43a3ba None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:50.874952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee0703-d823-418b-ae45-fe1c0f43a3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:50.875225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee0703-d823-418b-ae45-fe1c0f43a3ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:50.876577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee0703-d823-418b-ae45-fe1c0f43a3ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:50.878102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee0703-d823-418b-ae45-fe1c0f43a3ba None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:50.880018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 25/52] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:11:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:50.886244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279288b7-6a2a-4e2f-be6c-8867b428c321 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:51.006356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279288b7-6a2a-4e2f-be6c-8867b428c321 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:51.049173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6c743-0db9-44c2-8bf1-cb9b78ddc50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:51.049857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6c743-0db9-44c2-8bf1-cb9b78ddc50c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:51.050139 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6c743-0db9-44c2-8bf1-cb9b78ddc50c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:51.050411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6c743-0db9-44c2-8bf1-cb9b78ddc50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:51.051326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6c743-0db9-44c2-8bf1-cb9b78ddc50c None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.domain.id=default, user.id=51be48ea284046818e95b0cd55b089e7) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:11:51.051636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6c743-0db9-44c2-8bf1-cb9b78ddc50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:51.053213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6c743-0db9-44c2-8bf1-cb9b78ddc50c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:51.063050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 28/53] 10.222.0.40 () {56 vars in 1322 bytes} [Thu Jul 21 08:11:50 2022] GET /identity/v3/role_assignments?user.id=51be48ea284046818e95b0cd55b089e7&scope.domain.id=default&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 530 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:11:51.330836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e2072-6ae8-4558-aa0a-922a59a62c80 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:51.331628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e2072-6ae8-4558-aa0a-922a59a62c80 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:51.331773 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e2072-6ae8-4558-aa0a-922a59a62c80 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:51.333772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 26/54] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:51.340236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bda98d-3167-44b1-9e86-abbf550d964d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:51.340634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bda98d-3167-44b1-9e86-abbf550d964d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:51.340866 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bda98d-3167-44b1-9e86-abbf550d964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:51.475942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-21bda98d-3167-44b1-9e86-abbf550d964d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:51.477291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-21bda98d-3167-44b1-9e86-abbf550d964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:51.548729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:51.563253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 29/55] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:11:51.593457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e2072-6ae8-4558-aa0a-922a59a62c80 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:51.618238 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:51.722438 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e2072-6ae8-4558-aa0a-922a59a62c80 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:51.764878 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8768b5e-a2b5-4b59-b5f7-498f41badba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:51.765757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8768b5e-a2b5-4b59-b5f7-498f41badba0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:51.766083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8768b5e-a2b5-4b59-b5f7-498f41badba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:51.766392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8768b5e-a2b5-4b59-b5f7-498f41badba0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:51.767945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8768b5e-a2b5-4b59-b5f7-498f41badba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:51.769763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8768b5e-a2b5-4b59-b5f7-498f41badba0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:51.772116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 27/56] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:51.778273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bda98d-3167-44b1-9e86-abbf550d964d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:51.906097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bda98d-3167-44b1-9e86-abbf550d964d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:51.950137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8186a-d200-4db3-bd14-6a8c4f7b3f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:51.951050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8186a-d200-4db3-bd14-6a8c4f7b3f82 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:51.951335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8186a-d200-4db3-bd14-6a8c4f7b3f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:51.951611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8186a-d200-4db3-bd14-6a8c4f7b3f82 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:51.952356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8186a-d200-4db3-bd14-6a8c4f7b3f82 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:51.954370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8186a-d200-4db3-bd14-6a8c4f7b3f82 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:51.983100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 30/57] 10.222.0.40 () {60 vars in 1140 bytes} [Thu Jul 21 08:11:51 2022] POST /identity/v3/projects => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:11:54.191660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf05cf-2ea2-4ddd-8c54-9c27dd5f62cf None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:54.192225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf05cf-2ea2-4ddd-8c54-9c27dd5f62cf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:54.192225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf05cf-2ea2-4ddd-8c54-9c27dd5f62cf None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:54.193932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 28/58] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:54.200300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36865a98-ca05-4aa8-8f70-efa53abb87b2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:54.200905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36865a98-ca05-4aa8-8f70-efa53abb87b2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:54.200905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36865a98-ca05-4aa8-8f70-efa53abb87b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:54.220537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-36865a98-ca05-4aa8-8f70-efa53abb87b2 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:54.221880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-36865a98-ca05-4aa8-8f70-efa53abb87b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:54.267520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:54.315395 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 31/59] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:11:54.345383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf05cf-2ea2-4ddd-8c54-9c27dd5f62cf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:54.457961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:54.483583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf05cf-2ea2-4ddd-8c54-9c27dd5f62cf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:54.527800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed9e85-090d-4026-b739-6d291ccc7901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:54.529122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed9e85-090d-4026-b739-6d291ccc7901 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:54.529676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed9e85-090d-4026-b739-6d291ccc7901 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:54.530113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed9e85-090d-4026-b739-6d291ccc7901 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:54.532234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed9e85-090d-4026-b739-6d291ccc7901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:54.534520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed9e85-090d-4026-b739-6d291ccc7901 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:54.537189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 29/60] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:11:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:11:54.545075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36865a98-ca05-4aa8-8f70-efa53abb87b2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:54.669300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36865a98-ca05-4aa8-8f70-efa53abb87b2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:54.723199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc66f5e-f333-4a13-a4e4-65bfdf49e8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:54.724364 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc66f5e-f333-4a13-a4e4-65bfdf49e8c7 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:54.724953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc66f5e-f333-4a13-a4e4-65bfdf49e8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:54.725484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc66f5e-f333-4a13-a4e4-65bfdf49e8c7 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:54.726873 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc66f5e-f333-4a13-a4e4-65bfdf49e8c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:11:54.729740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc66f5e-f333-4a13-a4e4-65bfdf49e8c7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:11:54.768906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 32/61] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:11:54 2022] POST /identity/v3/users => generated 275 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:11:59.224713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff586e-f065-4a6b-a59c-33542378497e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:59.225532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff586e-f065-4a6b-a59c-33542378497e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:59.225532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff586e-f065-4a6b-a59c-33542378497e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:59.227076 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 30/62] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:11:59.232958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe5cf2-7c9b-48a0-a3f1-d10bff79eda1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:59.233809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe5cf2-7c9b-48a0-a3f1-d10bff79eda1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:59.233809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe5cf2-7c9b-48a0-a3f1-d10bff79eda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:59.261831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ddfe5cf2-7c9b-48a0-a3f1-d10bff79eda1 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:59.263238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ddfe5cf2-7c9b-48a0-a3f1-d10bff79eda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:59.303466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:59.362792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611003f-06bc-4d10-b4fd-e6a054e72fdf None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:59.363268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611003f-06bc-4d10-b4fd-e6a054e72fdf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:59.363760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611003f-06bc-4d10-b4fd-e6a054e72fdf None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:59.366538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:59.376104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ddf2b-7e63-49e7-8e28-e20bd2d5cc84 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:59.376581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ddf2b-7e63-49e7-8e28-e20bd2d5cc84 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:59.377179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ddf2b-7e63-49e7-8e28-e20bd2d5cc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:59.399094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 33/64] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:11:59.401407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a532-5277-4671-95e4-7a78386e0174 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:59.401865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a532-5277-4671-95e4-7a78386e0174 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:59.402322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a532-5277-4671-95e4-7a78386e0174 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:59.404704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 34/65] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:59.408805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9b0ddf2b-7e63-49e7-8e28-e20bd2d5cc84 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:59.411638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b0ddf2b-7e63-49e7-8e28-e20bd2d5cc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:59.413625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a911e-47e5-4c0e-98b1-ab40e922e0c1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:59.414083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a911e-47e5-4c0e-98b1-ab40e922e0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:59.414535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a911e-47e5-4c0e-98b1-ab40e922e0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:59.461189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b53a911e-47e5-4c0e-98b1-ab40e922e0c1 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:59.462719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b53a911e-47e5-4c0e-98b1-ab40e922e0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:59.556780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 32/66] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:11:59.558744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ddf2b-7e63-49e7-8e28-e20bd2d5cc84 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:59.633255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 35/67] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:11:59.635775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66ec66-c72f-4318-8efd-05c046d4500d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:59.636547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66ec66-c72f-4318-8efd-05c046d4500d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:59.636969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66ec66-c72f-4318-8efd-05c046d4500d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:59.639977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 36/68] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:11:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:11:59.648038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66ec66-c72f-4318-8efd-05c046d4500d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:59.715524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:59.745246 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ddf2b-7e63-49e7-8e28-e20bd2d5cc84 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:59.795128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527a74a-6fff-434b-9199-20659822d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:59.796564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527a74a-6fff-434b-9199-20659822d860 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:59.797066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527a74a-6fff-434b-9199-20659822d860 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:59.797553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527a74a-6fff-434b-9199-20659822d860 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:59.811834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:11:59.818013 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527a74a-6fff-434b-9199-20659822d860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:11:59.831043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66ec66-c72f-4318-8efd-05c046d4500d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f527a74a-6fff-434b-9199-20659822d860 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:11:59.832448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:11:59.833718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:11:59.834536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:11:59.834536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:11:59.834536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:11:59.834536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:11:59.834536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:11:59.834536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:11:59.834536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:11:59.834536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:11:59.834536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:11:59.834536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:11:59.834536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:11:59.834536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:11:59.835304 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 33/69] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:11:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:11:59.837349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce20505-3443-435d-bd41-44ac4db1c4ac None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:59.837835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce20505-3443-435d-bd41-44ac4db1c4ac None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:59.838296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce20505-3443-435d-bd41-44ac4db1c4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:59.868453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4ce20505-3443-435d-bd41-44ac4db1c4ac None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:11:59.870819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4ce20505-3443-435d-bd41-44ac4db1c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:11:59.892117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6452c-14bc-418c-8294-4590a7454470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:11:59.893204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6452c-14bc-418c-8294-4590a7454470 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:11:59.893666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6452c-14bc-418c-8294-4590a7454470 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:11:59.894098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6452c-14bc-418c-8294-4590a7454470 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:11:59.913544 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6452c-14bc-418c-8294-4590a7454470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0dd6452c-14bc-418c-8294-4590a7454470 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:11:59.927961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:11:59.929792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:11:59.931343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 37/70] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:11:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:11:59.934633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6452c-14bc-418c-8294-4590a7454470 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:11:59.991114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 34/71] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:11:59.992021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce20505-3443-435d-bd41-44ac4db1c4ac None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:00.096479 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:00.101356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6452c-14bc-418c-8294-4590a7454470 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:00.142255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68880feb-bfcd-4f51-8891-be80cb27fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:00.143085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68880feb-bfcd-4f51-8891-be80cb27fdfc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:00.143366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68880feb-bfcd-4f51-8891-be80cb27fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:00.143640 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68880feb-bfcd-4f51-8891-be80cb27fdfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:00.152472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce20505-3443-435d-bd41-44ac4db1c4ac None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:00.156996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68880feb-bfcd-4f51-8891-be80cb27fdfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-68880feb-bfcd-4f51-8891-be80cb27fdfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:00.164989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:00.167029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 38/72] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:00.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2104a-b823-4124-a27e-5d11fd29a38b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:00.171335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2104a-b823-4124-a27e-5d11fd29a38b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:00.171335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2104a-b823-4124-a27e-5d11fd29a38b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:00.171335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 39/73] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:00.173506 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2104a-b823-4124-a27e-5d11fd29a38b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:00.193739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:00.197679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bacf06-1caa-497d-bc7b-d617085d5ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:00.198443 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bacf06-1caa-497d-bc7b-d617085d5ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:00.198786 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bacf06-1caa-497d-bc7b-d617085d5ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:00.199067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bacf06-1caa-497d-bc7b-d617085d5ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:00.199856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bacf06-1caa-497d-bc7b-d617085d5ad9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:00.200173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bacf06-1caa-497d-bc7b-d617085d5ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:00.201687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bacf06-1caa-497d-bc7b-d617085d5ad9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:00.214522 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 35/74] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:11:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:00.216546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bacf06-1caa-497d-bc7b-d617085d5ad9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:00.328311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2104a-b823-4124-a27e-5d11fd29a38b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:00.369611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b312b9-12b6-4569-8dbf-446620c7379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:00.370226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b312b9-12b6-4569-8dbf-446620c7379b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:00.370504 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b312b9-12b6-4569-8dbf-446620c7379b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:00.370776 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b312b9-12b6-4569-8dbf-446620c7379b None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:00.371555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b312b9-12b6-4569-8dbf-446620c7379b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:00.371863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b312b9-12b6-4569-8dbf-446620c7379b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:00.373384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b312b9-12b6-4569-8dbf-446620c7379b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:00.373834 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bacf06-1caa-497d-bc7b-d617085d5ad9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:00.384096 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 40/75] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:12:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:00.385759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6ce74-c9de-4001-8817-77ae00d66d10 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:00.386199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6ce74-c9de-4001-8817-77ae00d66d10 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:00.386609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6ce74-c9de-4001-8817-77ae00d66d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:00.407597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1db6ce74-c9de-4001-8817-77ae00d66d10 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:00.408937 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1db6ce74-c9de-4001-8817-77ae00d66d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:00.419542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:00.426375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3f200-a016-4c05-bb4a-c363d5ae3f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:00.427208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3f200-a016-4c05-bb4a-c363d5ae3f89 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:00.427486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3f200-a016-4c05-bb4a-c363d5ae3f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:00.427756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3f200-a016-4c05-bb4a-c363d5ae3f89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:00.439913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3f200-a016-4c05-bb4a-c363d5ae3f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-61a3f200-a016-4c05-bb4a-c363d5ae3f89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:00.447974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:00.449911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:00.451538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 36/76] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:00.453664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3f200-a016-4c05-bb4a-c363d5ae3f89 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:00.525951 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:00.548545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 41/77] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:00.548545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6ce74-c9de-4001-8817-77ae00d66d10 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:00.577854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3f200-a016-4c05-bb4a-c363d5ae3f89 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:00.621797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf23fd-4dc2-4890-9740-cab0c0e2762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:00.622381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf23fd-4dc2-4890-9740-cab0c0e2762e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:00.622662 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf23fd-4dc2-4890-9740-cab0c0e2762e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:00.622935 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf23fd-4dc2-4890-9740-cab0c0e2762e None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:00.623716 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf23fd-4dc2-4890-9740-cab0c0e2762e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:00.624026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf23fd-4dc2-4890-9740-cab0c0e2762e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:00.625544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf23fd-4dc2-4890-9740-cab0c0e2762e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:00.636008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 37/78] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:00.643371 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf23fd-4dc2-4890-9740-cab0c0e2762e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:00.677020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6ce74-c9de-4001-8817-77ae00d66d10 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:00.719420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:00.721087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a00cd1-4925-4560-9df3-500a7ef01730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:00.722754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a00cd1-4925-4560-9df3-500a7ef01730 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:00.723227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a00cd1-4925-4560-9df3-500a7ef01730 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:00.723726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a00cd1-4925-4560-9df3-500a7ef01730 None admin] PATH_INFO: `/v3/users/c91018e1aa094e4cbbd6eadad3738ae0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:00.754738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a00cd1-4925-4560-9df3-500a7ef01730 None admin] RBAC: Authorizing `identity:get_user(user_id=c91018e1aa094e4cbbd6eadad3738ae0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:00.757950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a00cd1-4925-4560-9df3-500a7ef01730 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:00.761748 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 42/79] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:00 2022] GET /identity/v3/users/c91018e1aa094e4cbbd6eadad3738ae0 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:00.763042 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a00cd1-4925-4560-9df3-500a7ef01730 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:00.773696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf23fd-4dc2-4890-9740-cab0c0e2762e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:00.813509 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff10590-3a91-413c-b8d3-417869eb0799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:00.814435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff10590-3a91-413c-b8d3-417869eb0799 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:00.814721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff10590-3a91-413c-b8d3-417869eb0799 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:00.814997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff10590-3a91-413c-b8d3-417869eb0799 None admin] PATH_INFO: `/v3/users/c91018e1aa094e4cbbd6eadad3738ae0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:00.816778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff10590-3a91-413c-b8d3-417869eb0799 None admin] RBAC: Authorizing `identity:get_user(user_id=c91018e1aa094e4cbbd6eadad3738ae0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:00.818546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff10590-3a91-413c-b8d3-417869eb0799 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:00.820392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 38/80] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:00 2022] GET /identity/v3/users/c91018e1aa094e4cbbd6eadad3738ae0 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:00.821241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff10590-3a91-413c-b8d3-417869eb0799 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:00.861870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:00.915623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a00cd1-4925-4560-9df3-500a7ef01730 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:00.960718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb7b6e-fade-4e91-b1d3-3b1828418f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:00.961458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb7b6e-fade-4e91-b1d3-3b1828418f24 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:00.961743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb7b6e-fade-4e91-b1d3-3b1828418f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:00.962025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb7b6e-fade-4e91-b1d3-3b1828418f24 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:00.962805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb7b6e-fade-4e91-b1d3-3b1828418f24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:00.963116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb7b6e-fade-4e91-b1d3-3b1828418f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:00.964607 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb7b6e-fade-4e91-b1d3-3b1828418f24 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:00.975187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 43/81] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:00.976335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb7b6e-fade-4e91-b1d3-3b1828418f24 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:00.976802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff10590-3a91-413c-b8d3-417869eb0799 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:01.009586 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:01.024791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e338c-139e-43e5-95b9-85c0862c3324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:01.025635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e338c-139e-43e5-95b9-85c0862c3324 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:01.025912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e338c-139e-43e5-95b9-85c0862c3324 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:01.026215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e338c-139e-43e5-95b9-85c0862c3324 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:01.028182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e338c-139e-43e5-95b9-85c0862c3324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:01.030309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e338c-139e-43e5-95b9-85c0862c3324 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:01.032405 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 39/82] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:12:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:01.033551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e338c-139e-43e5-95b9-85c0862c3324 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:01.143316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb7b6e-fade-4e91-b1d3-3b1828418f24 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:01.176935 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e338c-139e-43e5-95b9-85c0862c3324 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:01.178195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:01.198512 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee12294-ab69-4aea-b4cd-154420e222aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:01.199560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee12294-ab69-4aea-b4cd-154420e222aa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:01.199996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee12294-ab69-4aea-b4cd-154420e222aa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:01.200380 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee12294-ab69-4aea-b4cd-154420e222aa None admin] PATH_INFO: `/v3/users/51be48ea284046818e95b0cd55b089e7` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:01.202029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee12294-ab69-4aea-b4cd-154420e222aa None admin] RBAC: Authorizing `identity:get_user(user_id=51be48ea284046818e95b0cd55b089e7)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:01.203731 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee12294-ab69-4aea-b4cd-154420e222aa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:01.206031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 44/83] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:00 2022] GET /identity/v3/users/51be48ea284046818e95b0cd55b089e7 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:01.207103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee12294-ab69-4aea-b4cd-154420e222aa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:01.228112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3327-097b-482a-a989-fe791a264953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:01.229198 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3327-097b-482a-a989-fe791a264953 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:01.229641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3327-097b-482a-a989-fe791a264953 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:01.230082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3327-097b-482a-a989-fe791a264953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:01.321006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:01.341811 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e3327-097b-482a-a989-fe791a264953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:01.343409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e3327-097b-482a-a989-fe791a264953 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:01.371213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee12294-ab69-4aea-b4cd-154420e222aa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:01.414190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38539660-4689-41f3-a9bb-a64bea38ddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:01.415539 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539660-4689-41f3-a9bb-a64bea38ddb2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:01.416012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539660-4689-41f3-a9bb-a64bea38ddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:01.416428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539660-4689-41f3-a9bb-a64bea38ddb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:01.482216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 40/84] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:01.483732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3327-097b-482a-a989-fe791a264953 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:01.492906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:01.512645 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38539660-4689-41f3-a9bb-a64bea38ddb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:01.515605 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38539660-4689-41f3-a9bb-a64bea38ddb2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:01.614525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:01.627779 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3327-097b-482a-a989-fe791a264953 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:01.656933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 45/85] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:01.658951 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38539660-4689-41f3-a9bb-a64bea38ddb2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:01.674570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d4b66-ae8b-4843-81d7-e2e1782a2380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:01.676011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d4b66-ae8b-4843-81d7-e2e1782a2380 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:01.676453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d4b66-ae8b-4843-81d7-e2e1782a2380 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:01.676935 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d4b66-ae8b-4843-81d7-e2e1782a2380 None admin] PATH_INFO: `/v3/users/c91018e1aa094e4cbbd6eadad3738ae0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:01.679294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d4b66-ae8b-4843-81d7-e2e1782a2380 None admin] RBAC: Authorizing `identity:get_user(user_id=c91018e1aa094e4cbbd6eadad3738ae0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:01.681895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d4b66-ae8b-4843-81d7-e2e1782a2380 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:01.684889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 41/86] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:01 2022] GET /identity/v3/users/c91018e1aa094e4cbbd6eadad3738ae0 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:01.686404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d4b66-ae8b-4843-81d7-e2e1782a2380 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:01.805059 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d4b66-ae8b-4843-81d7-e2e1782a2380 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:01.805263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:01.824450 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38539660-4689-41f3-a9bb-a64bea38ddb2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:01.848024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297a959-7bf6-4d45-aeef-af8226a08268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:01.848751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297a959-7bf6-4d45-aeef-af8226a08268 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:01.849037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297a959-7bf6-4d45-aeef-af8226a08268 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:01.849317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297a959-7bf6-4d45-aeef-af8226a08268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:01.876094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91bd3-fd8e-4c35-a9e0-dfaa92bd3b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:01.877232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91bd3-fd8e-4c35-a9e0-dfaa92bd3b00 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:01.877681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91bd3-fd8e-4c35-a9e0-dfaa92bd3b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:01.878058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91bd3-fd8e-4c35-a9e0-dfaa92bd3b00 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:01.879075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae91bd3-fd8e-4c35-a9e0-dfaa92bd3b00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:01.880880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae91bd3-fd8e-4c35-a9e0-dfaa92bd3b00 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:01.882728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:01.906108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 46/87] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:12:01 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:12:01.907019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91bd3-fd8e-4c35-a9e0-dfaa92bd3b00 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:01.968796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297a959-7bf6-4d45-aeef-af8226a08268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:01.971560 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297a959-7bf6-4d45-aeef-af8226a08268 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:02.123765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91bd3-fd8e-4c35-a9e0-dfaa92bd3b00 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:02.134476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 42/88] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:02.135651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297a959-7bf6-4d45-aeef-af8226a08268 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:02.189540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab315e7-9b71-42c7-baa5-4baa31bb6d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:02.190774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab315e7-9b71-42c7-baa5-4baa31bb6d2a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:02.191230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab315e7-9b71-42c7-baa5-4baa31bb6d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:02.191680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab315e7-9b71-42c7-baa5-4baa31bb6d2a None admin] PATH_INFO: `/v3/projects/920e3b8181264a9b9731c88a1d4bef70` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:02.194229 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab315e7-9b71-42c7-baa5-4baa31bb6d2a None admin] RBAC: Authorizing `identity:get_project(project_id=920e3b8181264a9b9731c88a1d4bef70)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:02.196587 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab315e7-9b71-42c7-baa5-4baa31bb6d2a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:02.198615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 47/89] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:01 2022] GET /identity/v3/projects/920e3b8181264a9b9731c88a1d4bef70 => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:02.203756 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab315e7-9b71-42c7-baa5-4baa31bb6d2a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:02.227807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:02.232661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:02.310104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297a959-7bf6-4d45-aeef-af8226a08268 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:02.388203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76c93e-a6df-48c1-b0a2-5e0089116200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:02.390882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76c93e-a6df-48c1-b0a2-5e0089116200 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:02.391344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76c93e-a6df-48c1-b0a2-5e0089116200 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:02.392184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76c93e-a6df-48c1-b0a2-5e0089116200 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:02.395277 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76c93e-a6df-48c1-b0a2-5e0089116200 None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:02.399887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76c93e-a6df-48c1-b0a2-5e0089116200 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:02.405355 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 43/90] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:02 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:02.406405 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76c93e-a6df-48c1-b0a2-5e0089116200 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:02.414343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab315e7-9b71-42c7-baa5-4baa31bb6d2a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:02.473993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dc1b4-b538-4de7-90f3-5796c42d9c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:02.475007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dc1b4-b538-4de7-90f3-5796c42d9c85 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:02.475445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dc1b4-b538-4de7-90f3-5796c42d9c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:02.475884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dc1b4-b538-4de7-90f3-5796c42d9c85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:02.561487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758dc1b4-b538-4de7-90f3-5796c42d9c85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:02.563365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758dc1b4-b538-4de7-90f3-5796c42d9c85 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:02.588746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:02.623916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76c93e-a6df-48c1-b0a2-5e0089116200 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:02.680743 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:02.693752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 48/91] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:02.694998 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dc1b4-b538-4de7-90f3-5796c42d9c85 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:02.713502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23108f1-d752-405e-9782-ead38f2c14ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:02.715067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23108f1-d752-405e-9782-ead38f2c14ee None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:02.715546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23108f1-d752-405e-9782-ead38f2c14ee None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:02.717790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23108f1-d752-405e-9782-ead38f2c14ee None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:02.719955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23108f1-d752-405e-9782-ead38f2c14ee None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:02.722804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23108f1-d752-405e-9782-ead38f2c14ee None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:02.726248 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 44/92] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:02 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:02.727695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23108f1-d752-405e-9782-ead38f2c14ee None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:02.883318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dc1b4-b538-4de7-90f3-5796c42d9c85 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:02.889465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23108f1-d752-405e-9782-ead38f2c14ee None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:02.911391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:02.940791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbdaf5-3285-45c7-b0c8-6a7f5d6204ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:02.941879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbdaf5-3285-45c7-b0c8-6a7f5d6204ad None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:02.942225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbdaf5-3285-45c7-b0c8-6a7f5d6204ad None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:02.942568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbdaf5-3285-45c7-b0c8-6a7f5d6204ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:02.943519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbdaf5-3285-45c7-b0c8-6a7f5d6204ad None admin] RBAC: Adding query filter params (role.id=2363304f42424934b09a0ff0bc62315d, scope.project.id=920e3b8181264a9b9731c88a1d4bef70, user.id=c91018e1aa094e4cbbd6eadad3738ae0) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:02.944338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbdaf5-3285-45c7-b0c8-6a7f5d6204ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:02.945969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbdaf5-3285-45c7-b0c8-6a7f5d6204ad None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:02.953089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 49/93] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:02 2022] GET /identity/v3/role_assignments?user.id=c91018e1aa094e4cbbd6eadad3738ae0&scope.project.id=920e3b8181264a9b9731c88a1d4bef70&role.id=2363304f42424934b09a0ff0bc62315d => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:02.958152 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbdaf5-3285-45c7-b0c8-6a7f5d6204ad None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:02.973761 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d7093-c6b9-4efd-9499-8c226b19a9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:02.975550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d7093-c6b9-4efd-9499-8c226b19a9dc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:02.976344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d7093-c6b9-4efd-9499-8c226b19a9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:02.977174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d7093-c6b9-4efd-9499-8c226b19a9dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:02.979126 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d7093-c6b9-4efd-9499-8c226b19a9dc None admin] RBAC: Adding query filter params (role.id=cbcda598469c41f19a1d3109e5d4c236, scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4, user.id=c91018e1aa094e4cbbd6eadad3738ae0) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:02.979939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d7093-c6b9-4efd-9499-8c226b19a9dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:02.983105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d7093-c6b9-4efd-9499-8c226b19a9dc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:02.996608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 45/94] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:02 2022] GET /identity/v3/role_assignments?user.id=c91018e1aa094e4cbbd6eadad3738ae0&scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4&role.id=cbcda598469c41f19a1d3109e5d4c236 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:02.998637 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d7093-c6b9-4efd-9499-8c226b19a9dc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:03.165193 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:03.268459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbdaf5-3285-45c7-b0c8-6a7f5d6204ad None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:03.294575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d7093-c6b9-4efd-9499-8c226b19a9dc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:03.333348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbc8b4-1d17-4d69-a680-4376bdb163b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:03.334310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbc8b4-1d17-4d69-a680-4376bdb163b0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:03.334602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbc8b4-1d17-4d69-a680-4376bdb163b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:03.334880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbc8b4-1d17-4d69-a680-4376bdb163b0 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:03.345590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbc8b4-1d17-4d69-a680-4376bdb163b0 None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:03.347184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbc8b4-1d17-4d69-a680-4376bdb163b0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:03.352787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 50/95] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:02 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:03.361636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbc8b4-1d17-4d69-a680-4376bdb163b0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:03.379819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb3e2f-7c90-4de4-9e6b-7c705d52c290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:03.381330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3e2f-7c90-4de4-9e6b-7c705d52c290 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:03.381847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3e2f-7c90-4de4-9e6b-7c705d52c290 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:03.382360 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3e2f-7c90-4de4-9e6b-7c705d52c290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:03.384194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb3e2f-7c90-4de4-9e6b-7c705d52c290 None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4, user.id=51be48ea284046818e95b0cd55b089e7) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:03.387187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb3e2f-7c90-4de4-9e6b-7c705d52c290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:03.390327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb3e2f-7c90-4de4-9e6b-7c705d52c290 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:03.408475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 46/96] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:02 2022] GET /identity/v3/role_assignments?user.id=51be48ea284046818e95b0cd55b089e7&scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 259 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:03.464301 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:03.596033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbc8b4-1d17-4d69-a680-4376bdb163b0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:03.665846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba1c24-7833-45fe-ae34-564842f24254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:03.667007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba1c24-7833-45fe-ae34-564842f24254 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:03.667528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba1c24-7833-45fe-ae34-564842f24254 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:03.668019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba1c24-7833-45fe-ae34-564842f24254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:03.669728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba1c24-7833-45fe-ae34-564842f24254 None admin] RBAC: Adding query filter params (role.id=2363304f42424934b09a0ff0bc62315d, scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4, user.id=c91018e1aa094e4cbbd6eadad3738ae0) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:03.670282 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba1c24-7833-45fe-ae34-564842f24254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:03.673199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba1c24-7833-45fe-ae34-564842f24254 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:03.685401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 51/97] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:03 2022] GET /identity/v3/role_assignments?user.id=c91018e1aa094e4cbbd6eadad3738ae0&scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4&role.id=2363304f42424934b09a0ff0bc62315d => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:04.777696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b07e1c-01b3-4395-b838-60f71df65959 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:04.778489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b07e1c-01b3-4395-b838-60f71df65959 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:04.778489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b07e1c-01b3-4395-b838-60f71df65959 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:04.779711 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 47/98] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:04.786004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca25f11-1af5-488d-9e45-b45f86d77884 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:04.786810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca25f11-1af5-488d-9e45-b45f86d77884 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:04.786810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca25f11-1af5-488d-9e45-b45f86d77884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:04.821611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7ca25f11-1af5-488d-9e45-b45f86d77884 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:04.823727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7ca25f11-1af5-488d-9e45-b45f86d77884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:04.971246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 52/99] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:05.005692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b07e1c-01b3-4395-b838-60f71df65959 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:05.240053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b07e1c-01b3-4395-b838-60f71df65959 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:05.289239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:05.311437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade46d3-b635-465c-94e7-e954987f78b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:05.312951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade46d3-b635-465c-94e7-e954987f78b9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:05.316598 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade46d3-b635-465c-94e7-e954987f78b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:05.316598 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade46d3-b635-465c-94e7-e954987f78b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:05.335168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade46d3-b635-465c-94e7-e954987f78b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-cade46d3-b635-465c-94e7-e954987f78b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:05.350583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:05.352227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:05.353781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 48/100] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:05.364854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca25f11-1af5-488d-9e45-b45f86d77884 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:05.451603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:05.557315 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca25f11-1af5-488d-9e45-b45f86d77884 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:05.606423 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e439b-a634-48a1-baec-ebf13f9a903a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:05.607142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e439b-a634-48a1-baec-ebf13f9a903a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:05.607426 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e439b-a634-48a1-baec-ebf13f9a903a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:05.607701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e439b-a634-48a1-baec-ebf13f9a903a None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:05.608516 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e439b-a634-48a1-baec-ebf13f9a903a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:05.608833 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e439b-a634-48a1-baec-ebf13f9a903a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:05.610284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e439b-a634-48a1-baec-ebf13f9a903a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:05.625725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 53/101] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:05.634893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade46d3-b635-465c-94e7-e954987f78b9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:05.844746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76359d7-ca2a-4d9f-a0ac-a49f20d3a87a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:05.845510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76359d7-ca2a-4d9f-a0ac-a49f20d3a87a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:05.845510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76359d7-ca2a-4d9f-a0ac-a49f20d3a87a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:05.847012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 54/102] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:05.853864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53324a3e-571e-47a5-b04f-bbbabb38ee7b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:05.855035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53324a3e-571e-47a5-b04f-bbbabb38ee7b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:05.855542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53324a3e-571e-47a5-b04f-bbbabb38ee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:05.876550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade46d3-b635-465c-94e7-e954987f78b9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:05.888782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-53324a3e-571e-47a5-b04f-bbbabb38ee7b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:05.895313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-53324a3e-571e-47a5-b04f-bbbabb38ee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:05.972997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a239d4-14bc-4c7f-a995-b2811adca71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:05.974186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a239d4-14bc-4c7f-a995-b2811adca71e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:05.974629 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a239d4-14bc-4c7f-a995-b2811adca71e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:05.975114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a239d4-14bc-4c7f-a995-b2811adca71e None admin] PATH_INFO: `/v3/users/41cac483807745bf8baed735b53437e7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:06.009398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a239d4-14bc-4c7f-a995-b2811adca71e None admin] RBAC: Authorizing `identity:get_user(user_id=41cac483807745bf8baed735b53437e7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:06.011053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a239d4-14bc-4c7f-a995-b2811adca71e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:06.013010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 49/103] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:05 2022] GET /identity/v3/users/41cac483807745bf8baed735b53437e7 => generated 289 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:06.026254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a239d4-14bc-4c7f-a995-b2811adca71e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:06.069947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 55/104] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:06.103120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53324a3e-571e-47a5-b04f-bbbabb38ee7b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:06.106306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:06.160879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:06.246277 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a239d4-14bc-4c7f-a995-b2811adca71e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:06.328853 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73929970-7834-449a-adea-3c8fe9134c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:06.329562 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73929970-7834-449a-adea-3c8fe9134c81 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:06.329846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73929970-7834-449a-adea-3c8fe9134c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:06.330125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73929970-7834-449a-adea-3c8fe9134c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:06.338430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53324a3e-571e-47a5-b04f-bbbabb38ee7b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:06.443319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087c13-29f7-451b-9a6a-8d40b32eda4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:06.444908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087c13-29f7-451b-9a6a-8d40b32eda4c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:06.445460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087c13-29f7-451b-9a6a-8d40b32eda4c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:06.446002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087c13-29f7-451b-9a6a-8d40b32eda4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:06.447586 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed087c13-29f7-451b-9a6a-8d40b32eda4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:06.449772 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed087c13-29f7-451b-9a6a-8d40b32eda4c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:06.461072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 56/105] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:12:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:06.470397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087c13-29f7-451b-9a6a-8d40b32eda4c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:06.536262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73929970-7834-449a-adea-3c8fe9134c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:06.540695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73929970-7834-449a-adea-3c8fe9134c81 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:06.653228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:06.777091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:06.784625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087c13-29f7-451b-9a6a-8d40b32eda4c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:06.840017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 50/106] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 814 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:12:06.841491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b86e2-480b-4e5b-9e80-6605a6e4f4a5 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:06.841788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b86e2-480b-4e5b-9e80-6605a6e4f4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:06.842065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b86e2-480b-4e5b-9e80-6605a6e4f4a5 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:06.843718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 51/107] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:06.849813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b86e2-480b-4e5b-9e80-6605a6e4f4a5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:06.868462 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bace0-4e86-4ad6-b5a8-bc1541133aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:06.869283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bace0-4e86-4ad6-b5a8-bc1541133aa5 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:06.869595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bace0-4e86-4ad6-b5a8-bc1541133aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:06.869754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bace0-4e86-4ad6-b5a8-bc1541133aa5 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:06.872202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bace0-4e86-4ad6-b5a8-bc1541133aa5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:06.873945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bace0-4e86-4ad6-b5a8-bc1541133aa5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:06.925480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 57/108] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:12:06 2022] POST /identity/v3/projects => generated 302 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:12:06.926870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60fc04-bf00-4dd4-a9d1-1b610258fa3b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:06.927160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60fc04-bf00-4dd4-a9d1-1b610258fa3b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:06.927451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60fc04-bf00-4dd4-a9d1-1b610258fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:06.968646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8a60fc04-bf00-4dd4-a9d1-1b610258fa3b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:06.973765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8a60fc04-bf00-4dd4-a9d1-1b610258fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:07.148166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b86e2-480b-4e5b-9e80-6605a6e4f4a5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:07.205572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 58/109] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:07.236034 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ef77f-22c8-4916-9b2d-943cbeb01157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:07.237894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ef77f-22c8-4916-9b2d-943cbeb01157 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:07.238574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ef77f-22c8-4916-9b2d-943cbeb01157 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:07.239241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ef77f-22c8-4916-9b2d-943cbeb01157 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:07.241956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ef77f-22c8-4916-9b2d-943cbeb01157 None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:07.245074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ef77f-22c8-4916-9b2d-943cbeb01157 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:07.246419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60fc04-bf00-4dd4-a9d1-1b610258fa3b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:07.248564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 52/110] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:06 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:07.262045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ef77f-22c8-4916-9b2d-943cbeb01157 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:07.290536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:07.438886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:07.495818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60fc04-bf00-4dd4-a9d1-1b610258fa3b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:07.519083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ef77f-22c8-4916-9b2d-943cbeb01157 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:07.578224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326e7ea-396c-4e4d-bebc-33ad9a98b5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:07.579646 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e7ea-396c-4e4d-bebc-33ad9a98b5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:07.581207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad5c90-06cf-4856-a6f6-868d75a427ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:07.582362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad5c90-06cf-4856-a6f6-868d75a427ec None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:07.582916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e7ea-396c-4e4d-bebc-33ad9a98b5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:07.583407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e7ea-396c-4e4d-bebc-33ad9a98b5a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:07.584744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e7ea-396c-4e4d-bebc-33ad9a98b5a4 None admin] RBAC: Adding query filter params (role.id=b59cdb5ce7164e609a36d41dfe3d0ef2, scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4, user.id=41cac483807745bf8baed735b53437e7) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:07.585350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad5c90-06cf-4856-a6f6-868d75a427ec None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:07.585827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad5c90-06cf-4856-a6f6-868d75a427ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:07.587169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e7ea-396c-4e4d-bebc-33ad9a98b5a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:07.590507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e7ea-396c-4e4d-bebc-33ad9a98b5a4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:07.602844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 53/111] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:07 2022] GET /identity/v3/role_assignments?user.id=41cac483807745bf8baed735b53437e7&scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4&role.id=b59cdb5ce7164e609a36d41dfe3d0ef2 => generated 259 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:07.608606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad5c90-06cf-4856-a6f6-868d75a427ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:07.612794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b5553-8202-4760-bbbd-7a250853d725 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:07.613444 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b5553-8202-4760-bbbd-7a250853d725 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:07.613922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b5553-8202-4760-bbbd-7a250853d725 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:07.615814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 54/112] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3dad5c90-06cf-4856-a6f6-868d75a427ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:07.620596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:07.621704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:07.622649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 59/113] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:12:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:12:07.625114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaacbb7-5d2d-44c6-b9b4-f804117ae9fb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:07.625415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaacbb7-5d2d-44c6-b9b4-f804117ae9fb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:07.625893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaacbb7-5d2d-44c6-b9b4-f804117ae9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:07.629798 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad5c90-06cf-4856-a6f6-868d75a427ec None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:07.653872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5eaacbb7-5d2d-44c6-b9b4-f804117ae9fb None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:07.655196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5eaacbb7-5d2d-44c6-b9b4-f804117ae9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:07.772339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 55/114] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:07.780528 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130f6d1-3576-41ad-8a4e-5ba3ccd2dd10 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:07.780528 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130f6d1-3576-41ad-8a4e-5ba3ccd2dd10 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:07.780528 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130f6d1-3576-41ad-8a4e-5ba3ccd2dd10 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:07.780528 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 56/115] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:07.782599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c108c-095e-43ef-bb59-d9b38702fb78 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:07.782876 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c108c-095e-43ef-bb59-d9b38702fb78 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:07.783165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c108c-095e-43ef-bb59-d9b38702fb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:07.801136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:07.813313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-653c108c-095e-43ef-bb59-d9b38702fb78 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:07.816644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-653c108c-095e-43ef-bb59-d9b38702fb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:07.833285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad5c90-06cf-4856-a6f6-868d75a427ec None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:07.879147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8491c-c993-4a78-ad6b-c74083a3c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:07.879850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8491c-c993-4a78-ad6b-c74083a3c16b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:07.880406 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8491c-c993-4a78-ad6b-c74083a3c16b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:07.880921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8491c-c993-4a78-ad6b-c74083a3c16b None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:07.882194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8491c-c993-4a78-ad6b-c74083a3c16b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:07.882727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8491c-c993-4a78-ad6b-c74083a3c16b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:07.884402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8491c-c993-4a78-ad6b-c74083a3c16b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:07.895080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 60/116] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:12:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:07.896875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8491c-c993-4a78-ad6b-c74083a3c16b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:07.908813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:07.962612 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 57/117] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:07.966286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c108c-095e-43ef-bb59-d9b38702fb78 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:08.139719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c108c-095e-43ef-bb59-d9b38702fb78 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:08.157698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8491c-c993-4a78-ad6b-c74083a3c16b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:08.183126 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:08.191881 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9649a6-e0b8-4069-969f-18a4e78d936f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:08.193863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9649a6-e0b8-4069-969f-18a4e78d936f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:08.194418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9649a6-e0b8-4069-969f-18a4e78d936f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:08.195016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9649a6-e0b8-4069-969f-18a4e78d936f None admin] PATH_INFO: `/v3/users/c91018e1aa094e4cbbd6eadad3738ae0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:08.196765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9649a6-e0b8-4069-969f-18a4e78d936f None admin] RBAC: Authorizing `identity:get_user(user_id=c91018e1aa094e4cbbd6eadad3738ae0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:08.198611 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9649a6-e0b8-4069-969f-18a4e78d936f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:08.202248 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 58/118] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:07 2022] GET /identity/v3/users/c91018e1aa094e4cbbd6eadad3738ae0 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:08.203336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9649a6-e0b8-4069-969f-18a4e78d936f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:08.230801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b8f28-6d1e-49c5-99e3-6896b001ddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:08.231636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8f28-6d1e-49c5-99e3-6896b001ddb6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:08.231947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8f28-6d1e-49c5-99e3-6896b001ddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:08.232231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8f28-6d1e-49c5-99e3-6896b001ddb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:08.259371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b8f28-6d1e-49c5-99e3-6896b001ddb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-373b8f28-6d1e-49c5-99e3-6896b001ddb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:08.275817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:08.276816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:08.277568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:08.277568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:08.277568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:08.277568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:08.277568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:08.277568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:08.277568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:08.277568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:08.277568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:08.277568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:08.277568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:08.277568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:08.278142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 61/119] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:08.280426 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8feb70-a5c1-4b20-939e-d403bd005e7c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:08.289577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8feb70-a5c1-4b20-939e-d403bd005e7c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:08.290406 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8feb70-a5c1-4b20-939e-d403bd005e7c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:08.293336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 62/120] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:08 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:08.294882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8feb70-a5c1-4b20-939e-d403bd005e7c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:08.350944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9649a6-e0b8-4069-969f-18a4e78d936f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:08.392936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bbdb9-2220-420b-baa8-561b1d66c181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:08.394163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bbdb9-2220-420b-baa8-561b1d66c181 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:08.394654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bbdb9-2220-420b-baa8-561b1d66c181 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:08.395146 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bbdb9-2220-420b-baa8-561b1d66c181 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:08.408350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bbdb9-2220-420b-baa8-561b1d66c181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c29bbdb9-2220-420b-baa8-561b1d66c181 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:08.416818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:08.417744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:08.418496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:08.418496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:08.418496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:08.418496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:08.418496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:08.418496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:08.418496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:08.418496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:08.418496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:08.418496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:08.418496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:08.418496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:08.421223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 59/121] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:12:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:08.427284 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bbdb9-2220-420b-baa8-561b1d66c181 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:08.442547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:08.504833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:08.531740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8feb70-a5c1-4b20-939e-d403bd005e7c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:08.582924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bbdb9-2220-420b-baa8-561b1d66c181 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:08.605482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6dfe2-a45d-412e-a3a4-cd7abcd26a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:08.607078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6dfe2-a45d-412e-a3a4-cd7abcd26a26 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:08.607597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6dfe2-a45d-412e-a3a4-cd7abcd26a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:08.608102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6dfe2-a45d-412e-a3a4-cd7abcd26a26 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:08.610516 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6dfe2-a45d-412e-a3a4-cd7abcd26a26 None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:08.613923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6dfe2-a45d-412e-a3a4-cd7abcd26a26 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:08.617622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 63/122] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:08 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:08.620186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf96570-0c35-4f61-9f14-1c65d990be72 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:08.620748 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf96570-0c35-4f61-9f14-1c65d990be72 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:08.621269 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf96570-0c35-4f61-9f14-1c65d990be72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:08.660736 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ccf96570-0c35-4f61-9f14-1c65d990be72 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:08.663102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ccf96570-0c35-4f61-9f14-1c65d990be72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:08.664064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bd52b-380f-40e0-9abb-0d93c5e63578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:08.665362 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bd52b-380f-40e0-9abb-0d93c5e63578 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:08.665893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bd52b-380f-40e0-9abb-0d93c5e63578 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:08.666428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bd52b-380f-40e0-9abb-0d93c5e63578 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:08.668357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bd52b-380f-40e0-9abb-0d93c5e63578 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:08.670471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bd52b-380f-40e0-9abb-0d93c5e63578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:08.672413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bd52b-380f-40e0-9abb-0d93c5e63578 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:08.692754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 60/123] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:08.694375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bd52b-380f-40e0-9abb-0d93c5e63578 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:08.824625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 64/124] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:08.826365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf96570-0c35-4f61-9f14-1c65d990be72 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:08.915469 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bd52b-380f-40e0-9abb-0d93c5e63578 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:08.963318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:08.982575 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:08.989338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c49f7-2dab-4101-9e7f-8275f228d38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:08.990812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c49f7-2dab-4101-9e7f-8275f228d38e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:08.991265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c49f7-2dab-4101-9e7f-8275f228d38e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:08.991755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c49f7-2dab-4101-9e7f-8275f228d38e None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:08.993221 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c49f7-2dab-4101-9e7f-8275f228d38e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:08.993721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c49f7-2dab-4101-9e7f-8275f228d38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:08.996390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c49f7-2dab-4101-9e7f-8275f228d38e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:09.012986 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 61/125] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:09.014458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c49f7-2dab-4101-9e7f-8275f228d38e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:09.066999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf96570-0c35-4f61-9f14-1c65d990be72 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:09.130509 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cca03-58ad-4820-9b75-ffcabccff624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:09.132166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cca03-58ad-4820-9b75-ffcabccff624 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:09.132714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cca03-58ad-4820-9b75-ffcabccff624 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:09.133207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cca03-58ad-4820-9b75-ffcabccff624 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4/users/c91018e1aa094e4cbbd6eadad3738ae0/roles/cbcda598469c41f19a1d3109e5d4c236` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:09.137347 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cca03-58ad-4820-9b75-ffcabccff624 None admin] RBAC: Authorizing `identity:create_grant(project_id=e72c20e824a34e33a3d2cec6cea56ca4, user_id=c91018e1aa094e4cbbd6eadad3738ae0, role_id=cbcda598469c41f19a1d3109e5d4c236)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:09.140196 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cca03-58ad-4820-9b75-ffcabccff624 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:09.170358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 65/126] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:12:08 2022] PUT /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4/users/c91018e1aa094e4cbbd6eadad3738ae0/roles/cbcda598469c41f19a1d3109e5d4c236 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:09.171733 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cca03-58ad-4820-9b75-ffcabccff624 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:09.271642 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c49f7-2dab-4101-9e7f-8275f228d38e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:09.396682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cca03-58ad-4820-9b75-ffcabccff624 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:09.404375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139d4f-3712-4cd4-a456-c3d939009f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:09.405891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139d4f-3712-4cd4-a456-c3d939009f5a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:09.406401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139d4f-3712-4cd4-a456-c3d939009f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:09.406926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139d4f-3712-4cd4-a456-c3d939009f5a None admin] PATH_INFO: `/v3/users/c91018e1aa094e4cbbd6eadad3738ae0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:09.408683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18139d4f-3712-4cd4-a456-c3d939009f5a None admin] RBAC: Authorizing `identity:get_user(user_id=c91018e1aa094e4cbbd6eadad3738ae0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:09.410521 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18139d4f-3712-4cd4-a456-c3d939009f5a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:09.413013 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 62/127] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:09 2022] GET /identity/v3/users/c91018e1aa094e4cbbd6eadad3738ae0 => generated 275 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:09.414169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139d4f-3712-4cd4-a456-c3d939009f5a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:09.486118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:09.490927 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:09.506302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7c6e6-5ab5-4e7a-bd34-ac9f43fc686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:09.507543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7c6e6-5ab5-4e7a-bd34-ac9f43fc686a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:09.508033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7c6e6-5ab5-4e7a-bd34-ac9f43fc686a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:09.508546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7c6e6-5ab5-4e7a-bd34-ac9f43fc686a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:09.524031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7c6e6-5ab5-4e7a-bd34-ac9f43fc686a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c7f7c6e6-5ab5-4e7a-bd34-ac9f43fc686a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:09.533744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:09.535255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:09.536295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:09.536295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:09.536295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:09.536295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:09.536295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:09.536295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:09.536295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:09.536295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:09.536295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:09.536295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:09.536295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:09.536295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:09.539971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 66/128] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:09.541262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7c6e6-5ab5-4e7a-bd34-ac9f43fc686a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:09.604349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139d4f-3712-4cd4-a456-c3d939009f5a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:09.711215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db592627-a5f6-4608-8ddf-11779426b23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:09.712827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db592627-a5f6-4608-8ddf-11779426b23d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:09.713331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db592627-a5f6-4608-8ddf-11779426b23d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:09.713819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db592627-a5f6-4608-8ddf-11779426b23d None admin] PATH_INFO: `/v3/users/51be48ea284046818e95b0cd55b089e7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:09.717851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db592627-a5f6-4608-8ddf-11779426b23d None admin] RBAC: Authorizing `identity:get_user(user_id=51be48ea284046818e95b0cd55b089e7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:09.721476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db592627-a5f6-4608-8ddf-11779426b23d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:09.724449 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 63/129] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:09 2022] GET /identity/v3/users/51be48ea284046818e95b0cd55b089e7 => generated 247 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:09.725451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db592627-a5f6-4608-8ddf-11779426b23d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:09.733892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7c6e6-5ab5-4e7a-bd34-ac9f43fc686a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:09.846958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44127bd-85d6-4434-ac97-1135a090c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:09.847794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44127bd-85d6-4434-ac97-1135a090c59b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:09.848078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44127bd-85d6-4434-ac97-1135a090c59b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:09.848357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44127bd-85d6-4434-ac97-1135a090c59b None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:09.850032 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44127bd-85d6-4434-ac97-1135a090c59b None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:09.851705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44127bd-85d6-4434-ac97-1135a090c59b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:09.853628 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 67/130] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:09 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:09.854582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44127bd-85d6-4434-ac97-1135a090c59b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:09.950971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:09.980720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db592627-a5f6-4608-8ddf-11779426b23d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:10.022903 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:10.051247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31106876-6c2e-4156-b391-7712900d904d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:10.052377 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106876-6c2e-4156-b391-7712900d904d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:10.052960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106876-6c2e-4156-b391-7712900d904d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:10.053445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106876-6c2e-4156-b391-7712900d904d None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:10.054828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31106876-6c2e-4156-b391-7712900d904d None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:10.055346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31106876-6c2e-4156-b391-7712900d904d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:10.055740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44127bd-85d6-4434-ac97-1135a090c59b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:10.057885 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31106876-6c2e-4156-b391-7712900d904d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:10.080534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 64/131] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:10.080534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c9401-6d09-40be-b1da-c2f0213f2cda None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:10.080534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c9401-6d09-40be-b1da-c2f0213f2cda None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:10.080534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c9401-6d09-40be-b1da-c2f0213f2cda None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:10.082229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 65/132] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:10.091070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c9401-6d09-40be-b1da-c2f0213f2cda None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:10.129603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578c8d5-cbf1-489a-8970-dd11b1a9c1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:10.131388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578c8d5-cbf1-489a-8970-dd11b1a9c1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:10.132123 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578c8d5-cbf1-489a-8970-dd11b1a9c1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:10.132838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578c8d5-cbf1-489a-8970-dd11b1a9c1a0 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:10.135395 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578c8d5-cbf1-489a-8970-dd11b1a9c1a0 None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:10.138194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578c8d5-cbf1-489a-8970-dd11b1a9c1a0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:10.141983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 68/133] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:09 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:10.143778 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578c8d5-cbf1-489a-8970-dd11b1a9c1a0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:10.232656 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c9401-6d09-40be-b1da-c2f0213f2cda None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:10.289161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db738c63-dd1d-4acf-9a4c-7bbdb354223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:10.290089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db738c63-dd1d-4acf-9a4c-7bbdb354223d None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:10.290425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db738c63-dd1d-4acf-9a4c-7bbdb354223d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:10.290670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db738c63-dd1d-4acf-9a4c-7bbdb354223d None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4/users/c91018e1aa094e4cbbd6eadad3738ae0/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:10.294499 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db738c63-dd1d-4acf-9a4c-7bbdb354223d None admin] RBAC: Authorizing `identity:create_grant(project_id=e72c20e824a34e33a3d2cec6cea56ca4, user_id=c91018e1aa094e4cbbd6eadad3738ae0, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:10.296077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db738c63-dd1d-4acf-9a4c-7bbdb354223d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:10.318663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 66/134] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:12:10 2022] PUT /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4/users/c91018e1aa094e4cbbd6eadad3738ae0/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:10.320600 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a4185-e751-44ab-a98c-c4c1862dc21d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:10.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a4185-e751-44ab-a98c-c4c1862dc21d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:10.321729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a4185-e751-44ab-a98c-c4c1862dc21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:10.345267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bb8a4185-e751-44ab-a98c-c4c1862dc21d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:10.347006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bb8a4185-e751-44ab-a98c-c4c1862dc21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:10.364017 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578c8d5-cbf1-489a-8970-dd11b1a9c1a0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:10.388598 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:10.394264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:10.417524 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415741e-a69d-40fd-94d1-8be48a23d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:10.418961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415741e-a69d-40fd-94d1-8be48a23d152 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:10.419528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415741e-a69d-40fd-94d1-8be48a23d152 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:10.420091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415741e-a69d-40fd-94d1-8be48a23d152 None admin] PATH_INFO: `/v3/users/c91018e1aa094e4cbbd6eadad3738ae0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:10.421994 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415741e-a69d-40fd-94d1-8be48a23d152 None admin] RBAC: Authorizing `identity:get_user(user_id=c91018e1aa094e4cbbd6eadad3738ae0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:10.423968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415741e-a69d-40fd-94d1-8be48a23d152 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:10.426668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 69/135] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:10 2022] GET /identity/v3/users/c91018e1aa094e4cbbd6eadad3738ae0 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:10.428023 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415741e-a69d-40fd-94d1-8be48a23d152 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:10.445513 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 67/136] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:10.447029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b1017-162d-4009-b983-07cb3a0cd2f9 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:10.447387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b1017-162d-4009-b983-07cb3a0cd2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:10.447739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b1017-162d-4009-b983-07cb3a0cd2f9 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:10.449877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 68/137] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:10.454473 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b1017-162d-4009-b983-07cb3a0cd2f9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:10.598698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415741e-a69d-40fd-94d1-8be48a23d152 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:10.616027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b1017-162d-4009-b983-07cb3a0cd2f9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:10.645948 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53620cf0-8689-4ca9-a120-109e338731ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:10.647019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53620cf0-8689-4ca9-a120-109e338731ca None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:10.647303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53620cf0-8689-4ca9-a120-109e338731ca None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:10.647663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53620cf0-8689-4ca9-a120-109e338731ca None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4/users/51be48ea284046818e95b0cd55b089e7/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:10.650743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53620cf0-8689-4ca9-a120-109e338731ca None admin] RBAC: Authorizing `identity:create_grant(project_id=e72c20e824a34e33a3d2cec6cea56ca4, user_id=51be48ea284046818e95b0cd55b089e7, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:10.652381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53620cf0-8689-4ca9-a120-109e338731ca None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:10.672898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 70/138] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:12:10 2022] PUT /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4/users/51be48ea284046818e95b0cd55b089e7/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:10.674430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c50db-09d5-43a9-b04d-e3f92aa5b531 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:10.675429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c50db-09d5-43a9-b04d-e3f92aa5b531 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:10.675770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c50db-09d5-43a9-b04d-e3f92aa5b531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:10.683608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d9867-e60d-445a-92c8-b3f7b2916a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:10.685242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d9867-e60d-445a-92c8-b3f7b2916a6d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:10.685725 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d9867-e60d-445a-92c8-b3f7b2916a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:10.686215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d9867-e60d-445a-92c8-b3f7b2916a6d None admin] PATH_INFO: `/v3/projects/920e3b8181264a9b9731c88a1d4bef70` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:10.688683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d9867-e60d-445a-92c8-b3f7b2916a6d None admin] RBAC: Authorizing `identity:get_project(project_id=920e3b8181264a9b9731c88a1d4bef70)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:10.691586 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d9867-e60d-445a-92c8-b3f7b2916a6d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:10.695313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 69/139] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:10 2022] GET /identity/v3/projects/920e3b8181264a9b9731c88a1d4bef70 => generated 312 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:10.696719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d9867-e60d-445a-92c8-b3f7b2916a6d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:10.703432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ed7c50db-09d5-43a9-b04d-e3f92aa5b531 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:10.705540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ed7c50db-09d5-43a9-b04d-e3f92aa5b531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:10.761755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:10.840601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d9867-e60d-445a-92c8-b3f7b2916a6d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:10.864429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:10.889163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d8e84-4fe6-43f7-a051-4ea52f370dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:10.890304 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d8e84-4fe6-43f7-a051-4ea52f370dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:10.890607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d8e84-4fe6-43f7-a051-4ea52f370dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:10.891008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d8e84-4fe6-43f7-a051-4ea52f370dd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:10.892466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d8e84-4fe6-43f7-a051-4ea52f370dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:10.894536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d8e84-4fe6-43f7-a051-4ea52f370dd8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:10.897609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 70/140] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:12:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:10.898460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d8e84-4fe6-43f7-a051-4ea52f370dd8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:10.930356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 71/141] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:10.931680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c50db-09d5-43a9-b04d-e3f92aa5b531 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:11.042213 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d8e84-4fe6-43f7-a051-4ea52f370dd8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:11.054333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:11.077632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c50db-09d5-43a9-b04d-e3f92aa5b531 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:11.111151 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23197342-705a-4cad-ade7-7eca423d91fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:11.112160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23197342-705a-4cad-ade7-7eca423d91fc None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:11.112431 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23197342-705a-4cad-ade7-7eca423d91fc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:11.112768 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23197342-705a-4cad-ade7-7eca423d91fc None admin] PATH_INFO: `/v3/projects/920e3b8181264a9b9731c88a1d4bef70/users/c91018e1aa094e4cbbd6eadad3738ae0/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:11.117636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23197342-705a-4cad-ade7-7eca423d91fc None admin] RBAC: Authorizing `identity:create_grant(project_id=920e3b8181264a9b9731c88a1d4bef70, user_id=c91018e1aa094e4cbbd6eadad3738ae0, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:11.119194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23197342-705a-4cad-ade7-7eca423d91fc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:11.129595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db261673-eedc-41d9-bdc2-4e17d93cbcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:11.130371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db261673-eedc-41d9-bdc2-4e17d93cbcf5 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:11.130720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db261673-eedc-41d9-bdc2-4e17d93cbcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:11.131552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db261673-eedc-41d9-bdc2-4e17d93cbcf5 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:11.132810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db261673-eedc-41d9-bdc2-4e17d93cbcf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:11.137753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db261673-eedc-41d9-bdc2-4e17d93cbcf5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:11.144411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 71/142] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:12:10 2022] PUT /identity/v3/projects/920e3b8181264a9b9731c88a1d4bef70/users/c91018e1aa094e4cbbd6eadad3738ae0/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:11.146483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23197342-705a-4cad-ade7-7eca423d91fc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:11.196737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 72/143] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:12:10 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:12:11.348991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23197342-705a-4cad-ade7-7eca423d91fc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:11.411387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bb324-040f-4426-8a5b-5d03c5810f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:11.412274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bb324-040f-4426-8a5b-5d03c5810f2b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:11.412583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bb324-040f-4426-8a5b-5d03c5810f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:11.412866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bb324-040f-4426-8a5b-5d03c5810f2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:11.437068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bb324-040f-4426-8a5b-5d03c5810f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-126bb324-040f-4426-8a5b-5d03c5810f2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:11.449787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:11.450758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:11.451527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 72/144] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:11.459010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db261673-eedc-41d9-bdc2-4e17d93cbcf5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:11.504091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:11.611967 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db261673-eedc-41d9-bdc2-4e17d93cbcf5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:11.665099 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557a59a-a051-411c-b127-ca880cf87f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:11.665834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557a59a-a051-411c-b127-ca880cf87f80 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:11.666121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557a59a-a051-411c-b127-ca880cf87f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:11.666400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557a59a-a051-411c-b127-ca880cf87f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:11.667204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557a59a-a051-411c-b127-ca880cf87f80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:11.667522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557a59a-a051-411c-b127-ca880cf87f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:11.669033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557a59a-a051-411c-b127-ca880cf87f80 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:11.686471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 73/145] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:11.692794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bb324-040f-4426-8a5b-5d03c5810f2b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:11.738467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:11.838860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bb324-040f-4426-8a5b-5d03c5810f2b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:11.888058 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59929c1-2ec1-47eb-ac7b-0ef8c5d9983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:11.889029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59929c1-2ec1-47eb-ac7b-0ef8c5d9983f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:11.889316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59929c1-2ec1-47eb-ac7b-0ef8c5d9983f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:11.889594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59929c1-2ec1-47eb-ac7b-0ef8c5d9983f None admin] PATH_INFO: `/v3/users/41cac483807745bf8baed735b53437e7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:11.891026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59929c1-2ec1-47eb-ac7b-0ef8c5d9983f None admin] RBAC: Authorizing `identity:get_user(user_id=41cac483807745bf8baed735b53437e7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:11.892633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59929c1-2ec1-47eb-ac7b-0ef8c5d9983f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:11.894490 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 73/146] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:11 2022] GET /identity/v3/users/41cac483807745bf8baed735b53437e7 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:11.901150 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557a59a-a051-411c-b127-ca880cf87f80 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:12.044742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:12.066488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557a59a-a051-411c-b127-ca880cf87f80 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:12.141692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfab26e-5acf-40ce-9d71-c3d7ea87d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:12.143486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfab26e-5acf-40ce-9d71-c3d7ea87d56f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:12.144018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfab26e-5acf-40ce-9d71-c3d7ea87d56f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:12.144532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfab26e-5acf-40ce-9d71-c3d7ea87d56f None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:12.148548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfab26e-5acf-40ce-9d71-c3d7ea87d56f None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:12.151545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfab26e-5acf-40ce-9d71-c3d7ea87d56f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:12.154136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 74/147] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:11 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:12.160723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59929c1-2ec1-47eb-ac7b-0ef8c5d9983f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:12.308313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:12.327086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59929c1-2ec1-47eb-ac7b-0ef8c5d9983f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:12.376978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089152a8-1068-4d76-b280-9c61c3d5c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:12.378805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089152a8-1068-4d76-b280-9c61c3d5c0e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:12.379297 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089152a8-1068-4d76-b280-9c61c3d5c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:12.379770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089152a8-1068-4d76-b280-9c61c3d5c0e7 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4/users/41cac483807745bf8baed735b53437e7/roles/b59cdb5ce7164e609a36d41dfe3d0ef2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:12.384062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089152a8-1068-4d76-b280-9c61c3d5c0e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e72c20e824a34e33a3d2cec6cea56ca4, user_id=41cac483807745bf8baed735b53437e7, role_id=b59cdb5ce7164e609a36d41dfe3d0ef2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:12.386017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089152a8-1068-4d76-b280-9c61c3d5c0e7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:12.410937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 74/148] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:12:12 2022] PUT /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4/users/41cac483807745bf8baed735b53437e7/roles/b59cdb5ce7164e609a36d41dfe3d0ef2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:12:12.981941 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716b87-02ef-412a-acc0-85e06d822d76 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:12.982986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716b87-02ef-412a-acc0-85e06d822d76 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:12.983751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716b87-02ef-412a-acc0-85e06d822d76 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:12.986789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 75/149] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:13.010057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf863-6245-4836-ae08-6fd57255d896 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:13.011028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf863-6245-4836-ae08-6fd57255d896 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:13.011809 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf863-6245-4836-ae08-6fd57255d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:13.050466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e6ddf863-6245-4836-ae08-6fd57255d896 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:13.053075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e6ddf863-6245-4836-ae08-6fd57255d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:13.199064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 75/150] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:12:13.242287 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c716b87-02ef-412a-acc0-85e06d822d76 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:13.497865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c716b87-02ef-412a-acc0-85e06d822d76 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:13.569379 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0d9c6-bb16-441a-ab7b-7c44a21f8fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:13.570243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0d9c6-bb16-441a-ab7b-7c44a21f8fcf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:13.570526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0d9c6-bb16-441a-ab7b-7c44a21f8fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:13.570803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0d9c6-bb16-441a-ab7b-7c44a21f8fcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:13.588283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0d9c6-bb16-441a-ab7b-7c44a21f8fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-17f0d9c6-bb16-441a-ab7b-7c44a21f8fcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:13.596835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:13.598441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:13.599961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 76/151] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:12:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:13.612652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddf863-6245-4836-ae08-6fd57255d896 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:13.827681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:13.852682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddf863-6245-4836-ae08-6fd57255d896 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:13.921065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef065f-85ff-4210-ae4c-4c2fc4735916 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:13.921383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef065f-85ff-4210-ae4c-4c2fc4735916 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:13.921633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef065f-85ff-4210-ae4c-4c2fc4735916 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:13.923242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 77/152] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:13.924158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31e1a7-f602-4aaf-9405-205c5f9632d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:13.925464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31e1a7-f602-4aaf-9405-205c5f9632d0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:13.925943 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31e1a7-f602-4aaf-9405-205c5f9632d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:13.926425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31e1a7-f602-4aaf-9405-205c5f9632d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:13.927997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31e1a7-f602-4aaf-9405-205c5f9632d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:13.928689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31e1a7-f602-4aaf-9405-205c5f9632d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:13.929462 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad3579-c012-45a0-93d1-d1b34b186a7a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:13.929752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad3579-c012-45a0-93d1-d1b34b186a7a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:13.930026 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad3579-c012-45a0-93d1-d1b34b186a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:13.931393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31e1a7-f602-4aaf-9405-205c5f9632d0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:13.948724 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 76/153] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:12:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:13.958325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31e1a7-f602-4aaf-9405-205c5f9632d0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:13.977782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-11ad3579-c012-45a0-93d1-d1b34b186a7a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:13.979052 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-11ad3579-c012-45a0-93d1-d1b34b186a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:14.022527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:14.170480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31e1a7-f602-4aaf-9405-205c5f9632d0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:14.264027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 78/154] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:14.273911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6504c51-76ec-4dd8-9dbf-af8dd0decf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:14.275875 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6504c51-76ec-4dd8-9dbf-af8dd0decf6c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:14.276614 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6504c51-76ec-4dd8-9dbf-af8dd0decf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:14.277241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6504c51-76ec-4dd8-9dbf-af8dd0decf6c None admin] PATH_INFO: `/v3/users/c91018e1aa094e4cbbd6eadad3738ae0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:14.279812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6504c51-76ec-4dd8-9dbf-af8dd0decf6c None admin] RBAC: Authorizing `identity:get_user(user_id=c91018e1aa094e4cbbd6eadad3738ae0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:14.282879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6504c51-76ec-4dd8-9dbf-af8dd0decf6c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:14.286388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 77/155] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:13 2022] GET /identity/v3/users/c91018e1aa094e4cbbd6eadad3738ae0 => generated 275 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:14.295708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad3579-c012-45a0-93d1-d1b34b186a7a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:14.356458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6504c51-76ec-4dd8-9dbf-af8dd0decf6c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:14.432649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:14.538084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad3579-c012-45a0-93d1-d1b34b186a7a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:14.609100 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6504c51-76ec-4dd8-9dbf-af8dd0decf6c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:14.649926 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8afe12-3190-4a75-8d5d-7c8d4f684d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:14.651009 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8afe12-3190-4a75-8d5d-7c8d4f684d91 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:14.651538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8afe12-3190-4a75-8d5d-7c8d4f684d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:14.652071 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8afe12-3190-4a75-8d5d-7c8d4f684d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:14.677777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b738c1-1732-4ba0-8cda-d533e759815a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:14.680879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b738c1-1732-4ba0-8cda-d533e759815a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:14.681679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b738c1-1732-4ba0-8cda-d533e759815a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:14.683101 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b738c1-1732-4ba0-8cda-d533e759815a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:14.710438 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b738c1-1732-4ba0-8cda-d533e759815a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:14.725075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e5b738c1-1732-4ba0-8cda-d533e759815a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:14.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:14.729924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:14.731471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:14.731471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:14.731471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:14.731471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:14.731471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:14.731471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:14.731471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:14.731471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:14.731471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:14.731471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:14.731471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:14.731471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:14.739592 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 78/156] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:12:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:14.748305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b738c1-1732-4ba0-8cda-d533e759815a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:14.897880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8afe12-3190-4a75-8d5d-7c8d4f684d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:14.899428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8afe12-3190-4a75-8d5d-7c8d4f684d91 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:14.961627 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:15.032439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b738c1-1732-4ba0-8cda-d533e759815a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:15.105990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 79/157] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 811 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:15.107912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ca0f3-7046-4650-a9aa-7a824ab9e779 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:15.108414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ca0f3-7046-4650-a9aa-7a824ab9e779 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:15.108930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ca0f3-7046-4650-a9aa-7a824ab9e779 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:15.110895 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 80/158] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:15.120790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d173d6d-6c5a-423d-b408-a834fca5d784 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:15.121418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d173d6d-6c5a-423d-b408-a834fca5d784 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:15.121894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d173d6d-6c5a-423d-b408-a834fca5d784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:15.130060 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce492d6-4cff-4d79-ac8e-f8cb7f741437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:15.131287 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce492d6-4cff-4d79-ac8e-f8cb7f741437 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:15.131777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce492d6-4cff-4d79-ac8e-f8cb7f741437 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:15.132264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce492d6-4cff-4d79-ac8e-f8cb7f741437 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:15.133835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce492d6-4cff-4d79-ac8e-f8cb7f741437 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:15.134378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce492d6-4cff-4d79-ac8e-f8cb7f741437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:15.137126 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce492d6-4cff-4d79-ac8e-f8cb7f741437 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:15.154335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 79/159] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:15.155654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5d173d6d-6c5a-423d-b408-a834fca5d784 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:15.155764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce492d6-4cff-4d79-ac8e-f8cb7f741437 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:15.157427 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5d173d6d-6c5a-423d-b408-a834fca5d784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:15.310035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:15.330186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce492d6-4cff-4d79-ac8e-f8cb7f741437 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:15.392536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589315f-7d91-48b1-b0b9-dac1e0b18a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:15.393483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589315f-7d91-48b1-b0b9-dac1e0b18a82 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:15.393753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589315f-7d91-48b1-b0b9-dac1e0b18a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:15.394022 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589315f-7d91-48b1-b0b9-dac1e0b18a82 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:15.397759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589315f-7d91-48b1-b0b9-dac1e0b18a82 None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:15.399309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589315f-7d91-48b1-b0b9-dac1e0b18a82 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:15.401264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 80/160] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:15 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:15.402115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589315f-7d91-48b1-b0b9-dac1e0b18a82 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:15.418853 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:15.423211 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 81/161] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:15.424747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d173d6d-6c5a-423d-b408-a834fca5d784 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:15.591850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589315f-7d91-48b1-b0b9-dac1e0b18a82 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:15.654511 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f647e-5d52-4b41-9843-6922046c73b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:15.655443 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f647e-5d52-4b41-9843-6922046c73b5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:15.655714 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f647e-5d52-4b41-9843-6922046c73b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:15.656001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f647e-5d52-4b41-9843-6922046c73b5 None admin] PATH_INFO: `/v3/users/51be48ea284046818e95b0cd55b089e7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:15.661659 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f647e-5d52-4b41-9843-6922046c73b5 None admin] RBAC: Authorizing `identity:get_user(user_id=51be48ea284046818e95b0cd55b089e7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:15.663371 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f647e-5d52-4b41-9843-6922046c73b5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:15.665239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 81/162] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:15 2022] GET /identity/v3/users/51be48ea284046818e95b0cd55b089e7 => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:15.666255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f647e-5d52-4b41-9843-6922046c73b5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:15.695406 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d173d6d-6c5a-423d-b408-a834fca5d784 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:15.797315 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87938a5-91fe-4fb1-bcc7-7c69047be35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:15.798643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87938a5-91fe-4fb1-bcc7-7c69047be35c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:15.799210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87938a5-91fe-4fb1-bcc7-7c69047be35c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:15.799505 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87938a5-91fe-4fb1-bcc7-7c69047be35c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:15.800677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87938a5-91fe-4fb1-bcc7-7c69047be35c None admin] RBAC: Adding query filter params (role.id=cbcda598469c41f19a1d3109e5d4c236, scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4, user.id=c91018e1aa094e4cbbd6eadad3738ae0) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:15.801000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87938a5-91fe-4fb1-bcc7-7c69047be35c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:15.802595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87938a5-91fe-4fb1-bcc7-7c69047be35c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:15.815165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 82/163] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:15 2022] GET /identity/v3/role_assignments?user.id=c91018e1aa094e4cbbd6eadad3738ae0&scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4&role.id=cbcda598469c41f19a1d3109e5d4c236 => generated 608 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:15.816004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87938a5-91fe-4fb1-bcc7-7c69047be35c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:15.837682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:15.900116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f647e-5d52-4b41-9843-6922046c73b5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:15.912789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:15.997293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e018b-f3d4-45fb-81b9-9ed095273389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:15.998446 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e018b-f3d4-45fb-81b9-9ed095273389 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:16.001063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e018b-f3d4-45fb-81b9-9ed095273389 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:16.001515 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e018b-f3d4-45fb-81b9-9ed095273389 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:16.028947 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e018b-f3d4-45fb-81b9-9ed095273389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-411e018b-f3d4-45fb-81b9-9ed095273389 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:16.045107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:16.046162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:16.047026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 82/164] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:16.056515 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e018b-f3d4-45fb-81b9-9ed095273389 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:16.076634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87938a5-91fe-4fb1-bcc7-7c69047be35c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:16.148372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e4b41-2884-4412-99e2-b35fbf6f5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:16.149344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4b41-2884-4412-99e2-b35fbf6f5bec None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:16.149772 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4b41-2884-4412-99e2-b35fbf6f5bec None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:16.150249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4b41-2884-4412-99e2-b35fbf6f5bec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:16.240349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e018b-f3d4-45fb-81b9-9ed095273389 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:16.285441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91863b80-87a3-496e-8bf4-e89a9d796b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:16.286494 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91863b80-87a3-496e-8bf4-e89a9d796b5b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:16.287168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91863b80-87a3-496e-8bf4-e89a9d796b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:16.288512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91863b80-87a3-496e-8bf4-e89a9d796b5b None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:16.290273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91863b80-87a3-496e-8bf4-e89a9d796b5b None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:16.290951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91863b80-87a3-496e-8bf4-e89a9d796b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:16.293860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91863b80-87a3-496e-8bf4-e89a9d796b5b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:16.296201 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:16.306741 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 83/165] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:16.315349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e4b41-2884-4412-99e2-b35fbf6f5bec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:16.317003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e4b41-2884-4412-99e2-b35fbf6f5bec None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:16.318649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91863b80-87a3-496e-8bf4-e89a9d796b5b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:16.447495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91863b80-87a3-496e-8bf4-e89a9d796b5b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:16.455736 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:16.498918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beacad3-f258-4992-a55c-d20aa099f69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:16.500211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beacad3-f258-4992-a55c-d20aa099f69f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:16.500881 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beacad3-f258-4992-a55c-d20aa099f69f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:16.501571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beacad3-f258-4992-a55c-d20aa099f69f None admin] PATH_INFO: `/v3/users/c91018e1aa094e4cbbd6eadad3738ae0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:16.505617 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beacad3-f258-4992-a55c-d20aa099f69f None admin] RBAC: Authorizing `identity:get_user(user_id=c91018e1aa094e4cbbd6eadad3738ae0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:16.507554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beacad3-f258-4992-a55c-d20aa099f69f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:16.510434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 84/166] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:16 2022] GET /identity/v3/users/c91018e1aa094e4cbbd6eadad3738ae0 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:16.518089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beacad3-f258-4992-a55c-d20aa099f69f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:16.577218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 83/167] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:16.579215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec663ae3-aec1-4835-9866-d50196640631 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:16.579837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec663ae3-aec1-4835-9866-d50196640631 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:16.580405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec663ae3-aec1-4835-9866-d50196640631 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:16.582101 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 84/168] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:16.585510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec663ae3-aec1-4835-9866-d50196640631 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:16.644262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:16.726118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beacad3-f258-4992-a55c-d20aa099f69f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:16.811853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec663ae3-aec1-4835-9866-d50196640631 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:16.817439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdebe5e-c2b4-494c-87bc-21518f453bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:16.818916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdebe5e-c2b4-494c-87bc-21518f453bed None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:16.819431 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdebe5e-c2b4-494c-87bc-21518f453bed None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:16.820919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdebe5e-c2b4-494c-87bc-21518f453bed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:16.881320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d482e78-d07d-405c-a124-8eac47003ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:16.882222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d482e78-d07d-405c-a124-8eac47003ebd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:16.882499 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d482e78-d07d-405c-a124-8eac47003ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:16.882771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d482e78-d07d-405c-a124-8eac47003ebd None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:16.887613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d482e78-d07d-405c-a124-8eac47003ebd None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:16.889236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d482e78-d07d-405c-a124-8eac47003ebd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:16.898351 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 85/169] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:16 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:16.899766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe61c0-2483-46f1-ad83-c2c9dbc01334 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:16.900048 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe61c0-2483-46f1-ad83-c2c9dbc01334 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:16.900321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe61c0-2483-46f1-ad83-c2c9dbc01334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:16.936889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-44fe61c0-2483-46f1-ad83-c2c9dbc01334 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:16.941914 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-44fe61c0-2483-46f1-ad83-c2c9dbc01334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:16.961105 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:16.982530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdebe5e-c2b4-494c-87bc-21518f453bed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:16.984057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdebe5e-c2b4-494c-87bc-21518f453bed None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:17.090960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:17.143938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 85/170] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:12:17.145679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdebe5e-c2b4-494c-87bc-21518f453bed None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:17.167446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 86/171] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:17.169408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe61c0-2483-46f1-ad83-c2c9dbc01334 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:17.296783 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdebe5e-c2b4-494c-87bc-21518f453bed None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:17.346028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66ff52-d9c3-4968-8c8b-f4ceb34edf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:17.347074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66ff52-d9c3-4968-8c8b-f4ceb34edf95 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:17.347507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66ff52-d9c3-4968-8c8b-f4ceb34edf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:17.347930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66ff52-d9c3-4968-8c8b-f4ceb34edf95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:17.353267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66ff52-d9c3-4968-8c8b-f4ceb34edf95 None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4, user.id=51be48ea284046818e95b0cd55b089e7) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:17.353868 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66ff52-d9c3-4968-8c8b-f4ceb34edf95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:17.355555 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66ff52-d9c3-4968-8c8b-f4ceb34edf95 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:17.367216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 86/172] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:17 2022] GET /identity/v3/role_assignments?user.id=51be48ea284046818e95b0cd55b089e7&scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:17.368388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66ff52-d9c3-4968-8c8b-f4ceb34edf95 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:17.430943 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:17.579310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe61c0-2483-46f1-ad83-c2c9dbc01334 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:17.600935 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66ff52-d9c3-4968-8c8b-f4ceb34edf95 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:17.633391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5b88-223a-425a-b4f8-2e2348982c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:17.638000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5b88-223a-425a-b4f8-2e2348982c89 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:17.638620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5b88-223a-425a-b4f8-2e2348982c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:17.639118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5b88-223a-425a-b4f8-2e2348982c89 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:17.641066 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5b88-223a-425a-b4f8-2e2348982c89 None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:17.644243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5b88-223a-425a-b4f8-2e2348982c89 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:17.654465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 87/173] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:17 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:17.657243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63486c02-ad4a-437b-a4a3-23a0a827f734 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:17.658017 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63486c02-ad4a-437b-a4a3-23a0a827f734 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:17.660193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63486c02-ad4a-437b-a4a3-23a0a827f734 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:17.662925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 88/174] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:17.670356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63486c02-ad4a-437b-a4a3-23a0a827f734 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:17.689376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b2ca2-cb2d-4520-8e23-882a677e752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:17.692545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b2ca2-cb2d-4520-8e23-882a677e752c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:17.693065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:17.693315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b2ca2-cb2d-4520-8e23-882a677e752c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:17.693633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b2ca2-cb2d-4520-8e23-882a677e752c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:17.721200 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b2ca2-cb2d-4520-8e23-882a677e752c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-401b2ca2-cb2d-4520-8e23-882a677e752c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:17.737697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:17.739524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:17.741318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:17.741318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:17.741318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:17.741318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:17.741318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:17.741318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:17.741318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:17.741318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:17.741318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:17.741318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:17.741318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:17.741318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:17.745826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 87/175] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:17.748770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eca3ec-366d-4d44-909c-eeb55f990e6f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:17.749625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eca3ec-366d-4d44-909c-eeb55f990e6f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:17.750340 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eca3ec-366d-4d44-909c-eeb55f990e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:17.784383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-63eca3ec-366d-4d44-909c-eeb55f990e6f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:17.786495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-63eca3ec-366d-4d44-909c-eeb55f990e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:17.831480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63486c02-ad4a-437b-a4a3-23a0a827f734 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:17.891212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5093b-0aee-4569-9f14-f6e11de577da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:17.892234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5093b-0aee-4569-9f14-f6e11de577da None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:17.892735 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5093b-0aee-4569-9f14-f6e11de577da None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:17.892839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 88/176] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:17.893278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5093b-0aee-4569-9f14-f6e11de577da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:17.894371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5093b-0aee-4569-9f14-f6e11de577da None admin] RBAC: Adding query filter params (role.id=2363304f42424934b09a0ff0bc62315d, scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4, user.id=c91018e1aa094e4cbbd6eadad3738ae0) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:17.894485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692ade7-8fbf-4d3b-893d-e4090d6f83ec None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:17.894665 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692ade7-8fbf-4d3b-893d-e4090d6f83ec None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:17.894948 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692ade7-8fbf-4d3b-893d-e4090d6f83ec None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:17.895290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5093b-0aee-4569-9f14-f6e11de577da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:17.897033 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 89/177] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:17.901887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5093b-0aee-4569-9f14-f6e11de577da None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:17.902081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968c941-c51c-443a-a5b4-8373eed3d91e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:17.902081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968c941-c51c-443a-a5b4-8373eed3d91e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:17.902081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968c941-c51c-443a-a5b4-8373eed3d91e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:17.902081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 90/178] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:17.902081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968c941-c51c-443a-a5b4-8373eed3d91e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:17.914720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 89/179] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:17 2022] GET /identity/v3/role_assignments?user.id=c91018e1aa094e4cbbd6eadad3738ae0&scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4&role.id=2363304f42424934b09a0ff0bc62315d => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:17.918729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9fc5e-28cc-4bff-b1e9-19edfb25ea03 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:17.919604 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9fc5e-28cc-4bff-b1e9-19edfb25ea03 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:17.920329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9fc5e-28cc-4bff-b1e9-19edfb25ea03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:17.934181 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:17.953139 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-69a9fc5e-28cc-4bff-b1e9-19edfb25ea03 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:17.955401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-69a9fc5e-28cc-4bff-b1e9-19edfb25ea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:18.060197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 90/180] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:18.068019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feffcc-c07b-49a5-877b-e1cf15849e7b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:18.068019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feffcc-c07b-49a5-877b-e1cf15849e7b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:18.068019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feffcc-c07b-49a5-877b-e1cf15849e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:18.069356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:18.072401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968c941-c51c-443a-a5b4-8373eed3d91e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:18.085209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-11feffcc-c07b-49a5-877b-e1cf15849e7b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:18.086362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-11feffcc-c07b-49a5-877b-e1cf15849e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:18.145116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962395d2-0ae3-4d0e-a982-6ac3d3dba3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:18.146324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962395d2-0ae3-4d0e-a982-6ac3d3dba3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:18.146715 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962395d2-0ae3-4d0e-a982-6ac3d3dba3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:18.146998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962395d2-0ae3-4d0e-a982-6ac3d3dba3a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:18.147891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962395d2-0ae3-4d0e-a982-6ac3d3dba3a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:18.148207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962395d2-0ae3-4d0e-a982-6ac3d3dba3a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:18.151088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962395d2-0ae3-4d0e-a982-6ac3d3dba3a8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:18.162692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 91/181] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:18.167945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962395d2-0ae3-4d0e-a982-6ac3d3dba3a8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:18.212929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 91/182] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:18.214691 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feffcc-c07b-49a5-877b-e1cf15849e7b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:18.322593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:18.348216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962395d2-0ae3-4d0e-a982-6ac3d3dba3a8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:18.366897 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feffcc-c07b-49a5-877b-e1cf15849e7b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:18.390791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eebb42-f4b3-4ce3-aeda-2244b9b269fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:18.392169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eebb42-f4b3-4ce3-aeda-2244b9b269fc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:18.392712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eebb42-f4b3-4ce3-aeda-2244b9b269fc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:18.393208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eebb42-f4b3-4ce3-aeda-2244b9b269fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:18.408033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99b06a-3c3a-492f-acfe-4068fb14dc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:18.408880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99b06a-3c3a-492f-acfe-4068fb14dc43 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:18.409165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99b06a-3c3a-492f-acfe-4068fb14dc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:18.409435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99b06a-3c3a-492f-acfe-4068fb14dc43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:18.411851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:18.413755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eebb42-f4b3-4ce3-aeda-2244b9b269fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:18.423280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99b06a-3c3a-492f-acfe-4068fb14dc43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-28eebb42-f4b3-4ce3-aeda-2244b9b269fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:18.429258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:18.430194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:18.431002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:18.431002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:18.431002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:18.431002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:18.431002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:18.431002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:18.431002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:18.431002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:18.431002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:18.431002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:18.431002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:18.431002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9e99b06a-3c3a-492f-acfe-4068fb14dc43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:18.431595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:18.438173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:18.439399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:18.439399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:18.439399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:18.439399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:18.439399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:18.439399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:18.439399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:18.439399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:18.439399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:18.439399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:18.439399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:18.439399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:18.440000 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 92/183] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:18.440074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 92/184] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:18.440139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eebb42-f4b3-4ce3-aeda-2244b9b269fc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:18.440205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99b06a-3c3a-492f-acfe-4068fb14dc43 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:18.556419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eebb42-f4b3-4ce3-aeda-2244b9b269fc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:18.601348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddb38c-3f1c-421b-ba17-8795526ebbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:18.602142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddb38c-3f1c-421b-ba17-8795526ebbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:18.602441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddb38c-3f1c-421b-ba17-8795526ebbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:18.602713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddb38c-3f1c-421b-ba17-8795526ebbb3 None admin] PATH_INFO: `/v3/users/c91018e1aa094e4cbbd6eadad3738ae0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:18.604044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddb38c-3f1c-421b-ba17-8795526ebbb3 None admin] RBAC: Authorizing `identity:get_user(user_id=c91018e1aa094e4cbbd6eadad3738ae0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:18.605641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddb38c-3f1c-421b-ba17-8795526ebbb3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:18.611977 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 93/185] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:18 2022] GET /identity/v3/users/c91018e1aa094e4cbbd6eadad3738ae0 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:18.611977 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddb38c-3f1c-421b-ba17-8795526ebbb3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:18.623842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:18.635649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99b06a-3c3a-492f-acfe-4068fb14dc43 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:18.690936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a53a2-8fac-4ced-8fd8-f2440c67131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:18.691797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a53a2-8fac-4ced-8fd8-f2440c67131c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:18.692067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a53a2-8fac-4ced-8fd8-f2440c67131c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:18.692353 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a53a2-8fac-4ced-8fd8-f2440c67131c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:18.705469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a53a2-8fac-4ced-8fd8-f2440c67131c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2d7a53a2-8fac-4ced-8fd8-f2440c67131c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:18.713870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:18.714828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 93/186] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:12:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:18.721183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a53a2-8fac-4ced-8fd8-f2440c67131c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:18.749930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddb38c-3f1c-421b-ba17-8795526ebbb3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:18.790324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c95701-7e7c-479e-8d48-b237964d3809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:18.791415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95701-7e7c-479e-8d48-b237964d3809 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:18.791898 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95701-7e7c-479e-8d48-b237964d3809 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:18.792392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95701-7e7c-479e-8d48-b237964d3809 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:18.793418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c95701-7e7c-479e-8d48-b237964d3809 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:18.793992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c95701-7e7c-479e-8d48-b237964d3809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:18.795629 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c95701-7e7c-479e-8d48-b237964d3809 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:18.810748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 94/187] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:18.812652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c95701-7e7c-479e-8d48-b237964d3809 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:18.819851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:18.876644 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a53a2-8fac-4ced-8fd8-f2440c67131c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:18.924027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467297d3-289d-42f5-b29c-c84b0e60aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:18.925796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467297d3-289d-42f5-b29c-c84b0e60aa7a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:18.926300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467297d3-289d-42f5-b29c-c84b0e60aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:18.926798 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467297d3-289d-42f5-b29c-c84b0e60aa7a None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:18.928321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467297d3-289d-42f5-b29c-c84b0e60aa7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:18.928893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467297d3-289d-42f5-b29c-c84b0e60aa7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:18.931664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467297d3-289d-42f5-b29c-c84b0e60aa7a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:18.941736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:18.950379 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 94/188] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:18.954594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467297d3-289d-42f5-b29c-c84b0e60aa7a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:18.983022 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c95701-7e7c-479e-8d48-b237964d3809 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:19.027344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03209bd7-dd5e-485c-b5de-b7e6be2e1934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:19.028199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03209bd7-dd5e-485c-b5de-b7e6be2e1934 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:19.028650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03209bd7-dd5e-485c-b5de-b7e6be2e1934 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:19.029109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03209bd7-dd5e-485c-b5de-b7e6be2e1934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:19.108568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467297d3-289d-42f5-b29c-c84b0e60aa7a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:19.115443 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03209bd7-dd5e-485c-b5de-b7e6be2e1934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:19.117840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03209bd7-dd5e-485c-b5de-b7e6be2e1934 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:19.128824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:19.155510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa7fca-bcea-45da-ae11-1bc845ebaa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:19.156222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa7fca-bcea-45da-ae11-1bc845ebaa8a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:19.156545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa7fca-bcea-45da-ae11-1bc845ebaa8a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:19.156814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa7fca-bcea-45da-ae11-1bc845ebaa8a None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:19.157601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa7fca-bcea-45da-ae11-1bc845ebaa8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:19.157919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa7fca-bcea-45da-ae11-1bc845ebaa8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:19.159382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa7fca-bcea-45da-ae11-1bc845ebaa8a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:19.170141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 95/189] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:12:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:19.171233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa7fca-bcea-45da-ae11-1bc845ebaa8a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:19.217272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:19.266208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 95/190] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:19.267664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03209bd7-dd5e-485c-b5de-b7e6be2e1934 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:19.316865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa7fca-bcea-45da-ae11-1bc845ebaa8a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:19.361565 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b15873-6c8d-4f4f-a43a-1864a0309ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:19.362639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b15873-6c8d-4f4f-a43a-1864a0309ffb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:19.363058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b15873-6c8d-4f4f-a43a-1864a0309ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:19.363546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b15873-6c8d-4f4f-a43a-1864a0309ffb None admin] PATH_INFO: `/v3/users/f746bd4f3b944c48aa38e26ef39d5fdf` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:19.381581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b15873-6c8d-4f4f-a43a-1864a0309ffb None admin] RBAC: Authorizing `identity:get_user(user_id=f746bd4f3b944c48aa38e26ef39d5fdf)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:19.383311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b15873-6c8d-4f4f-a43a-1864a0309ffb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:19.385547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 96/191] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:19 2022] GET /identity/v3/users/f746bd4f3b944c48aa38e26ef39d5fdf => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:19.385547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c9a0a-d839-4eff-bf72-8465a4c77171 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:19.385547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c9a0a-d839-4eff-bf72-8465a4c77171 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:19.385547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c9a0a-d839-4eff-bf72-8465a4c77171 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:19.385547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 97/192] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:19.385547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c9a0a-d839-4eff-bf72-8465a4c77171 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:19.418434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03209bd7-dd5e-485c-b5de-b7e6be2e1934 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:19.447209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:19.458551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fecf7-611f-4e98-9909-8be4fa9905f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:19.459616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fecf7-611f-4e98-9909-8be4fa9905f4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:19.459897 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fecf7-611f-4e98-9909-8be4fa9905f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:19.460170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fecf7-611f-4e98-9909-8be4fa9905f4 None admin] PATH_INFO: `/v3/users/41cac483807745bf8baed735b53437e7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:19.461574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fecf7-611f-4e98-9909-8be4fa9905f4 None admin] RBAC: Authorizing `identity:get_user(user_id=41cac483807745bf8baed735b53437e7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:19.463120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fecf7-611f-4e98-9909-8be4fa9905f4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:19.464962 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 96/193] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:19 2022] GET /identity/v3/users/41cac483807745bf8baed735b53437e7 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:19.472031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fecf7-611f-4e98-9909-8be4fa9905f4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:19.524304 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:19.540711 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c9a0a-d839-4eff-bf72-8465a4c77171 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:19.598838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9594d-06bc-485d-b7fc-eabbcef2a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:19.599793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9594d-06bc-485d-b7fc-eabbcef2a68c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:19.600075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9594d-06bc-485d-b7fc-eabbcef2a68c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:19.600355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9594d-06bc-485d-b7fc-eabbcef2a68c None admin] PATH_INFO: `/v3/users/f746bd4f3b944c48aa38e26ef39d5fdf` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:19.601149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fecf7-611f-4e98-9909-8be4fa9905f4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:19.601786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9594d-06bc-485d-b7fc-eabbcef2a68c None admin] RBAC: Authorizing `identity:get_user(user_id=f746bd4f3b944c48aa38e26ef39d5fdf)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:19.603331 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9594d-06bc-485d-b7fc-eabbcef2a68c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:19.605207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 98/194] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:19 2022] GET /identity/v3/users/f746bd4f3b944c48aa38e26ef39d5fdf => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:19.610541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9594d-06bc-485d-b7fc-eabbcef2a68c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:19.671285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93431d81-d7a8-4dba-aceb-b7ec30d8c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:19.672722 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93431d81-d7a8-4dba-aceb-b7ec30d8c628 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:19.673216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93431d81-d7a8-4dba-aceb-b7ec30d8c628 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:19.673620 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93431d81-d7a8-4dba-aceb-b7ec30d8c628 None admin] PATH_INFO: `/v3/projects/920e3b8181264a9b9731c88a1d4bef70` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:19.675703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93431d81-d7a8-4dba-aceb-b7ec30d8c628 None admin] RBAC: Authorizing `identity:get_project(project_id=920e3b8181264a9b9731c88a1d4bef70)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:19.678077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93431d81-d7a8-4dba-aceb-b7ec30d8c628 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:19.680654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 97/195] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:19 2022] GET /identity/v3/projects/920e3b8181264a9b9731c88a1d4bef70 => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:19.686387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2256df-d140-4538-af09-0a807d71f662 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:19.686652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2256df-d140-4538-af09-0a807d71f662 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:19.686999 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2256df-d140-4538-af09-0a807d71f662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:19.714054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8f2256df-d140-4538-af09-0a807d71f662 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:19.715974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8f2256df-d140-4538-af09-0a807d71f662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:19.741962 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9594d-06bc-485d-b7fc-eabbcef2a68c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:19.745037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:19.799636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4ed54-b7db-4f9f-9d32-8466bf4130e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:19.800798 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4ed54-b7db-4f9f-9d32-8466bf4130e7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:19.801283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4ed54-b7db-4f9f-9d32-8466bf4130e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:19.801750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4ed54-b7db-4f9f-9d32-8466bf4130e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:19.801915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 98/196] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:19.806204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2256df-d140-4538-af09-0a807d71f662 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:19.863186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:19.913210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4ed54-b7db-4f9f-9d32-8466bf4130e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:19.915991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4ed54-b7db-4f9f-9d32-8466bf4130e7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:19.946413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2256df-d140-4538-af09-0a807d71f662 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:19.988634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9dd9-7b3e-4855-ab1b-92509099c2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:19.989314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9dd9-7b3e-4855-ab1b-92509099c2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:19.989594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9dd9-7b3e-4855-ab1b-92509099c2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:19.989870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9dd9-7b3e-4855-ab1b-92509099c2b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:20.069215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 99/197] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:20.069215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4ed54-b7db-4f9f-9d32-8466bf4130e7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:20.071404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:20.080108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f9dd9-7b3e-4855-ab1b-92509099c2b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:20.082188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f9dd9-7b3e-4855-ab1b-92509099c2b7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:20.136672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:20.202119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4ed54-b7db-4f9f-9d32-8466bf4130e7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:20.239630 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 99/198] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:20.239630 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9dd9-7b3e-4855-ab1b-92509099c2b7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:20.265717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153316f-1070-4122-b347-79828c590023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:20.266805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153316f-1070-4122-b347-79828c590023 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:20.267298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153316f-1070-4122-b347-79828c590023 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:20.267722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153316f-1070-4122-b347-79828c590023 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:20.374562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153316f-1070-4122-b347-79828c590023 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:20.376869 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153316f-1070-4122-b347-79828c590023 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:20.381807 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:20.397294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9dd9-7b3e-4855-ab1b-92509099c2b7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:20.455775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdf564-7632-48b9-b67b-85a64f5a513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:20.456428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdf564-7632-48b9-b67b-85a64f5a513d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:20.456855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdf564-7632-48b9-b67b-85a64f5a513d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:20.457227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdf564-7632-48b9-b67b-85a64f5a513d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:20.458205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdf564-7632-48b9-b67b-85a64f5a513d None admin] RBAC: Adding query filter params (role.id=2363304f42424934b09a0ff0bc62315d, scope.project.id=920e3b8181264a9b9731c88a1d4bef70, user.id=c91018e1aa094e4cbbd6eadad3738ae0) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:20.458597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdf564-7632-48b9-b67b-85a64f5a513d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:20.460718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdf564-7632-48b9-b67b-85a64f5a513d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:20.464676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:20.472554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 100/199] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:20 2022] GET /identity/v3/role_assignments?user.id=c91018e1aa094e4cbbd6eadad3738ae0&scope.project.id=920e3b8181264a9b9731c88a1d4bef70&role.id=2363304f42424934b09a0ff0bc62315d => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:20.477683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdf564-7632-48b9-b67b-85a64f5a513d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:20.574157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 100/200] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:20.574157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153316f-1070-4122-b347-79828c590023 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:20.652342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdf564-7632-48b9-b67b-85a64f5a513d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:20.705501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1904a-dd2f-4bd8-84d8-ddd770b7ad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:20.706266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1904a-dd2f-4bd8-84d8-ddd770b7ad15 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:20.706813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1904a-dd2f-4bd8-84d8-ddd770b7ad15 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:20.707162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1904a-dd2f-4bd8-84d8-ddd770b7ad15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:20.709610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1904a-dd2f-4bd8-84d8-ddd770b7ad15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:20.712559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1904a-dd2f-4bd8-84d8-ddd770b7ad15 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:20.716554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 101/201] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:12:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:20.717088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1904a-dd2f-4bd8-84d8-ddd770b7ad15 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:20.762079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153316f-1070-4122-b347-79828c590023 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:20.766975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:20.826838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a963c9-918b-4c28-a8aa-e53a098faa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:20.828140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a963c9-918b-4c28-a8aa-e53a098faa76 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:20.828617 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a963c9-918b-4c28-a8aa-e53a098faa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:20.829074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a963c9-918b-4c28-a8aa-e53a098faa76 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:20.831110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a963c9-918b-4c28-a8aa-e53a098faa76 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:20.833586 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a963c9-918b-4c28-a8aa-e53a098faa76 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:20.835964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:20.836456 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 101/202] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:20 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:20.838079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a963c9-918b-4c28-a8aa-e53a098faa76 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:20.894116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1904a-dd2f-4bd8-84d8-ddd770b7ad15 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:20.945428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0ba4f-a96e-43e6-ac9d-945a8ed74f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:20.946436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0ba4f-a96e-43e6-ac9d-945a8ed74f7c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:20.946863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0ba4f-a96e-43e6-ac9d-945a8ed74f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:20.947306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0ba4f-a96e-43e6-ac9d-945a8ed74f7c None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:20.948808 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0ba4f-a96e-43e6-ac9d-945a8ed74f7c None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:20.950725 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0ba4f-a96e-43e6-ac9d-945a8ed74f7c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:20.953040 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 102/203] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:20 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:20.953980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0ba4f-a96e-43e6-ac9d-945a8ed74f7c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:20.983073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a963c9-918b-4c28-a8aa-e53a098faa76 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:21.024620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c4dea-3d7b-4f1b-83bf-b6faa900b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:21.025526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c4dea-3d7b-4f1b-83bf-b6faa900b557 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:21.025806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c4dea-3d7b-4f1b-83bf-b6faa900b557 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:21.026080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c4dea-3d7b-4f1b-83bf-b6faa900b557 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:21.027384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c4dea-3d7b-4f1b-83bf-b6faa900b557 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:21.028931 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c4dea-3d7b-4f1b-83bf-b6faa900b557 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:21.031009 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 102/204] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:20 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:21.031615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c4dea-3d7b-4f1b-83bf-b6faa900b557 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:21.078737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0ba4f-a96e-43e6-ac9d-945a8ed74f7c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:21.094247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:21.123007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de291c9f-d493-4044-a5ca-4ee6ea8f211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:21.124120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de291c9f-d493-4044-a5ca-4ee6ea8f211b None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:21.124595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de291c9f-d493-4044-a5ca-4ee6ea8f211b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:21.125044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de291c9f-d493-4044-a5ca-4ee6ea8f211b None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:21.126132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de291c9f-d493-4044-a5ca-4ee6ea8f211b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:21.128827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de291c9f-d493-4044-a5ca-4ee6ea8f211b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:21.146415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:21.173000 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 103/205] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:12:20 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:12:21.174342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de291c9f-d493-4044-a5ca-4ee6ea8f211b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:21.209369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c4dea-3d7b-4f1b-83bf-b6faa900b557 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:21.266789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836b171-e529-4d20-8e65-9c134843ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:21.267616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836b171-e529-4d20-8e65-9c134843ce7c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:21.268022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836b171-e529-4d20-8e65-9c134843ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:21.268423 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836b171-e529-4d20-8e65-9c134843ce7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:21.269541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836b171-e529-4d20-8e65-9c134843ce7c None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=4efc2482ceab4826af36f260dbc35af4, user.id=f746bd4f3b944c48aa38e26ef39d5fdf) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:21.269992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836b171-e529-4d20-8e65-9c134843ce7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:21.272579 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836b171-e529-4d20-8e65-9c134843ce7c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:21.281439 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 103/206] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:21 2022] GET /identity/v3/role_assignments?user.id=f746bd4f3b944c48aa38e26ef39d5fdf&scope.project.id=4efc2482ceab4826af36f260dbc35af4&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:21.282983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836b171-e529-4d20-8e65-9c134843ce7c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:21.417259 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de291c9f-d493-4044-a5ca-4ee6ea8f211b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:21.490354 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81a20a-cbef-4339-a085-17c242951a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:21.491284 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81a20a-cbef-4339-a085-17c242951a8d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:21.491747 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81a20a-cbef-4339-a085-17c242951a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:21.492414 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81a20a-cbef-4339-a085-17c242951a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:21.493549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81a20a-cbef-4339-a085-17c242951a8d None admin] RBAC: Adding query filter params (role.id=b59cdb5ce7164e609a36d41dfe3d0ef2, scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4, user.id=41cac483807745bf8baed735b53437e7) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:21.494109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81a20a-cbef-4339-a085-17c242951a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:21.497223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81a20a-cbef-4339-a085-17c242951a8d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:21.510112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 104/207] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:21 2022] GET /identity/v3/role_assignments?user.id=41cac483807745bf8baed735b53437e7&scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4&role.id=b59cdb5ce7164e609a36d41dfe3d0ef2 => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:21.538074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836b171-e529-4d20-8e65-9c134843ce7c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:21.557997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:21.613103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720410c-29c6-4cb6-863c-803b46b6679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:21.614285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720410c-29c6-4cb6-863c-803b46b6679f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:21.614774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720410c-29c6-4cb6-863c-803b46b6679f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:21.615438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720410c-29c6-4cb6-863c-803b46b6679f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:21.617307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720410c-29c6-4cb6-863c-803b46b6679f None admin] RBAC: Adding query filter params (role.id=cbcda598469c41f19a1d3109e5d4c236, scope.project.id=4efc2482ceab4826af36f260dbc35af4, user.id=f746bd4f3b944c48aa38e26ef39d5fdf) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:21.617930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720410c-29c6-4cb6-863c-803b46b6679f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:21.620888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720410c-29c6-4cb6-863c-803b46b6679f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:21.633252 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 104/208] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:21 2022] GET /identity/v3/role_assignments?user.id=f746bd4f3b944c48aa38e26ef39d5fdf&scope.project.id=4efc2482ceab4826af36f260dbc35af4&role.id=cbcda598469c41f19a1d3109e5d4c236 => generated 259 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:23.629568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff36ab-6f55-423e-82c1-383430b4076f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:23.630623 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff36ab-6f55-423e-82c1-383430b4076f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:23.630623 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff36ab-6f55-423e-82c1-383430b4076f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:23.631781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 105/209] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:23.640595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0bfe-ea95-4748-b940-da7c6a267d20 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:23.641576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0bfe-ea95-4748-b940-da7c6a267d20 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:23.641576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0bfe-ea95-4748-b940-da7c6a267d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:23.672658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-90bb0bfe-ea95-4748-b940-da7c6a267d20 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:23.674821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-90bb0bfe-ea95-4748-b940-da7c6a267d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:23.758568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb7eb9-eb50-4bf1-8293-29edeabe0605 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:23.759034 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb7eb9-eb50-4bf1-8293-29edeabe0605 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:23.759270 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb7eb9-eb50-4bf1-8293-29edeabe0605 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:23.761347 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 106/210] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:23.770788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef535510-8ab6-4283-b7ba-778570fe9347 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:23.771347 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef535510-8ab6-4283-b7ba-778570fe9347 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:23.771858 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef535510-8ab6-4283-b7ba-778570fe9347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:23.794485 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 105/211] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:23.805244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ef535510-8ab6-4283-b7ba-778570fe9347 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:23.807376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ef535510-8ab6-4283-b7ba-778570fe9347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:23.819116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb0bfe-ea95-4748-b940-da7c6a267d20 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:23.938328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:23.940173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:23.945383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb0bfe-ea95-4748-b940-da7c6a267d20 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:23.981808 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 107/212] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:12:23.990342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab9b15-5637-4adf-a5b2-8c6e4bacf40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:23.991754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab9b15-5637-4adf-a5b2-8c6e4bacf40e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:23.992138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab9b15-5637-4adf-a5b2-8c6e4bacf40e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:23.992523 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab9b15-5637-4adf-a5b2-8c6e4bacf40e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:24.004863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab9b15-5637-4adf-a5b2-8c6e4bacf40e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f7ab9b15-5637-4adf-a5b2-8c6e4bacf40e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:24.013131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:24.015502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:24.018041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 106/213] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:12:24.024628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef535510-8ab6-4283-b7ba-778570fe9347 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:24.029645 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab9b15-5637-4adf-a5b2-8c6e4bacf40e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:24.191358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef535510-8ab6-4283-b7ba-778570fe9347 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:24.196068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab9b15-5637-4adf-a5b2-8c6e4bacf40e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:24.235900 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019d497-f15f-4757-9649-b416aa0e7a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:24.236766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019d497-f15f-4757-9649-b416aa0e7a88 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:24.237049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019d497-f15f-4757-9649-b416aa0e7a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:24.237334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019d497-f15f-4757-9649-b416aa0e7a88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:24.237489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7584a-4693-4565-96ec-d1dd5798de35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:24.238220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7584a-4693-4565-96ec-d1dd5798de35 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:24.238570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7584a-4693-4565-96ec-d1dd5798de35 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:24.238906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7584a-4693-4565-96ec-d1dd5798de35 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:24.239879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7584a-4693-4565-96ec-d1dd5798de35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:24.240315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7584a-4693-4565-96ec-d1dd5798de35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:24.241982 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7584a-4693-4565-96ec-d1dd5798de35 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:24.252107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019d497-f15f-4757-9649-b416aa0e7a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:24.252526 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 108/214] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:24.258386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7584a-4693-4565-96ec-d1dd5798de35 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a019d497-f15f-4757-9649-b416aa0e7a88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:24.260372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:24.262517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:24.264227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 107/215] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:12:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:24.276094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019d497-f15f-4757-9649-b416aa0e7a88 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:24.315982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:24.322424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:24.423272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019d497-f15f-4757-9649-b416aa0e7a88 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:24.437680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7584a-4693-4565-96ec-d1dd5798de35 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:24.466591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ae51-38e5-4015-aed2-d15c9a3ffdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:24.467290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ae51-38e5-4015-aed2-d15c9a3ffdbf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:24.467574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ae51-38e5-4015-aed2-d15c9a3ffdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:24.467856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ae51-38e5-4015-aed2-d15c9a3ffdbf None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:24.468657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9ae51-38e5-4015-aed2-d15c9a3ffdbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:24.468969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9ae51-38e5-4015-aed2-d15c9a3ffdbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:24.470642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9ae51-38e5-4015-aed2-d15c9a3ffdbf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:24.481238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 108/216] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:24.486915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ae51-38e5-4015-aed2-d15c9a3ffdbf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:24.514037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff2222-d881-480c-a7a5-78a9eae5a56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:24.516327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff2222-d881-480c-a7a5-78a9eae5a56f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:24.517239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff2222-d881-480c-a7a5-78a9eae5a56f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:24.517981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff2222-d881-480c-a7a5-78a9eae5a56f None admin] PATH_INFO: `/v3/users/486eaeaa65d049f8ac758de240ea070f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:24.550367 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff2222-d881-480c-a7a5-78a9eae5a56f None admin] RBAC: Authorizing `identity:get_user(user_id=486eaeaa65d049f8ac758de240ea070f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:24.554102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff2222-d881-480c-a7a5-78a9eae5a56f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:24.558517 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 109/217] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:24 2022] GET /identity/v3/users/486eaeaa65d049f8ac758de240ea070f => generated 297 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:24.567535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff2222-d881-480c-a7a5-78a9eae5a56f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:24.620052 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:24.646145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ae51-38e5-4015-aed2-d15c9a3ffdbf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:24.690048 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5933c16-9f2d-4437-983f-5a718bd333cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:24.691401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5933c16-9f2d-4437-983f-5a718bd333cb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:24.691886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5933c16-9f2d-4437-983f-5a718bd333cb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:24.692380 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5933c16-9f2d-4437-983f-5a718bd333cb None admin] PATH_INFO: `/v3/users/f746bd4f3b944c48aa38e26ef39d5fdf` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:24.694643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5933c16-9f2d-4437-983f-5a718bd333cb None admin] RBAC: Authorizing `identity:get_user(user_id=f746bd4f3b944c48aa38e26ef39d5fdf)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:24.696662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5933c16-9f2d-4437-983f-5a718bd333cb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:24.699092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 109/218] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:24 2022] GET /identity/v3/users/f746bd4f3b944c48aa38e26ef39d5fdf => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:24.706027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5933c16-9f2d-4437-983f-5a718bd333cb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:24.771579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff2222-d881-480c-a7a5-78a9eae5a56f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:24.787693 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:24.830965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5933c16-9f2d-4437-983f-5a718bd333cb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:24.841481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47dc1c-10ea-4bd6-ad31-e7fffc7ff936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:24.842641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47dc1c-10ea-4bd6-ad31-e7fffc7ff936 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:24.843122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47dc1c-10ea-4bd6-ad31-e7fffc7ff936 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:24.843602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47dc1c-10ea-4bd6-ad31-e7fffc7ff936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:24.869276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1701df-f5ff-4f21-a1b5-8b242132b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:24.870186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1701df-f5ff-4f21-a1b5-8b242132b089 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:24.870467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1701df-f5ff-4f21-a1b5-8b242132b089 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:24.870739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1701df-f5ff-4f21-a1b5-8b242132b089 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:24.872071 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1701df-f5ff-4f21-a1b5-8b242132b089 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:24.873737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1701df-f5ff-4f21-a1b5-8b242132b089 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:24.875621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 110/219] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:24 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:24.882149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3047e7-513d-4a95-be2d-5cffbd25b23f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:24.882553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3047e7-513d-4a95-be2d-5cffbd25b23f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:24.882697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3047e7-513d-4a95-be2d-5cffbd25b23f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:24.889333 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 111/220] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:24.889333 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3047e7-513d-4a95-be2d-5cffbd25b23f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:24.913238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:24.984121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47dc1c-10ea-4bd6-ad31-e7fffc7ff936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:24.987097 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47dc1c-10ea-4bd6-ad31-e7fffc7ff936 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:25.036723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3047e7-513d-4a95-be2d-5cffbd25b23f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:25.078814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a2d6a-f38a-4d02-8960-8ad18dd75e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:25.079983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a2d6a-f38a-4d02-8960-8ad18dd75e57 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:25.080359 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a2d6a-f38a-4d02-8960-8ad18dd75e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:25.080745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a2d6a-f38a-4d02-8960-8ad18dd75e57 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4/users/f746bd4f3b944c48aa38e26ef39d5fdf/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:25.083331 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a2d6a-f38a-4d02-8960-8ad18dd75e57 None admin] RBAC: Authorizing `identity:create_grant(project_id=4efc2482ceab4826af36f260dbc35af4, user_id=f746bd4f3b944c48aa38e26ef39d5fdf, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:25.085206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a2d6a-f38a-4d02-8960-8ad18dd75e57 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:25.101850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 112/221] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:12:24 2022] PUT /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4/users/f746bd4f3b944c48aa38e26ef39d5fdf/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:25.112816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ea923-a9d7-48b7-ad55-8d35aaea6851 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:25.112816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ea923-a9d7-48b7-ad55-8d35aaea6851 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:25.112816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ea923-a9d7-48b7-ad55-8d35aaea6851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:25.137059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-114ea923-a9d7-48b7-ad55-8d35aaea6851 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:25.138722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-114ea923-a9d7-48b7-ad55-8d35aaea6851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:25.157832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 110/222] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:25.157832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5915a5-10e0-406e-88a0-bde21e437fcf None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:25.157832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5915a5-10e0-406e-88a0-bde21e437fcf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:25.158414 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5915a5-10e0-406e-88a0-bde21e437fcf None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:25.160893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 111/223] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:25.162323 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5915a5-10e0-406e-88a0-bde21e437fcf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:25.177798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:25.255239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 113/224] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:25.263825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d853ca-5da6-487b-94c7-45475a8edcf7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:25.263825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d853ca-5da6-487b-94c7-45475a8edcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:25.263825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d853ca-5da6-487b-94c7-45475a8edcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:25.275741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:25.289383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-21d853ca-5da6-487b-94c7-45475a8edcf7 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:25.290903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-21d853ca-5da6-487b-94c7-45475a8edcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:25.345564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5915a5-10e0-406e-88a0-bde21e437fcf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:25.392249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bdb72-5503-429e-84a8-90099cbc2438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:25.393255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bdb72-5503-429e-84a8-90099cbc2438 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:25.393523 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bdb72-5503-429e-84a8-90099cbc2438 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:25.393754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bdb72-5503-429e-84a8-90099cbc2438 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:25.395103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bdb72-5503-429e-84a8-90099cbc2438 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:25.397094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bdb72-5503-429e-84a8-90099cbc2438 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:25.400449 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 112/225] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:25 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:25.401108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bdb72-5503-429e-84a8-90099cbc2438 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:25.413470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 114/226] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:25.415441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d853ca-5da6-487b-94c7-45475a8edcf7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:25.547345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:25.571108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d853ca-5da6-487b-94c7-45475a8edcf7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:25.596779 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bdb72-5503-429e-84a8-90099cbc2438 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:25.619344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b34e-2599-4f9f-9791-82d67ad200df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:25.620241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b34e-2599-4f9f-9791-82d67ad200df None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:25.620735 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b34e-2599-4f9f-9791-82d67ad200df None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:25.621166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b34e-2599-4f9f-9791-82d67ad200df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:25.622666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800b34e-2599-4f9f-9791-82d67ad200df None admin] RBAC: Adding query filter params (role.id=2363304f42424934b09a0ff0bc62315d, scope.project.id=4efc2482ceab4826af36f260dbc35af4, user.id=486eaeaa65d049f8ac758de240ea070f) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:25.623057 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800b34e-2599-4f9f-9791-82d67ad200df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:25.625443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800b34e-2599-4f9f-9791-82d67ad200df None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:25.630859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:25.637527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 115/227] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:25 2022] GET /identity/v3/role_assignments?user.id=486eaeaa65d049f8ac758de240ea070f&scope.project.id=4efc2482ceab4826af36f260dbc35af4&role.id=2363304f42424934b09a0ff0bc62315d => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:25.638650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b34e-2599-4f9f-9791-82d67ad200df None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:25.682147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58ba04-75cf-479d-a6a5-bdfed7732f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:25.684439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58ba04-75cf-479d-a6a5-bdfed7732f7e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:25.686107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58ba04-75cf-479d-a6a5-bdfed7732f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:25.687074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58ba04-75cf-479d-a6a5-bdfed7732f7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:25.690159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58ba04-75cf-479d-a6a5-bdfed7732f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:25.694435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58ba04-75cf-479d-a6a5-bdfed7732f7e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:25.698993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 113/228] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:12:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:25.708586 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58ba04-75cf-479d-a6a5-bdfed7732f7e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:25.789626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b34e-2599-4f9f-9791-82d67ad200df None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:25.831249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456f79c-9077-4db1-a84f-f7b4b21a887d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:25.832005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456f79c-9077-4db1-a84f-f7b4b21a887d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:25.832286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456f79c-9077-4db1-a84f-f7b4b21a887d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:25.832595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456f79c-9077-4db1-a84f-f7b4b21a887d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:25.846834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456f79c-9077-4db1-a84f-f7b4b21a887d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4456f79c-9077-4db1-a84f-f7b4b21a887d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:25.855466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:25.857453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:25.859250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 116/229] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:12:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:25.867756 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456f79c-9077-4db1-a84f-f7b4b21a887d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:25.942781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58ba04-75cf-479d-a6a5-bdfed7732f7e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:25.965127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:26.009648 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669521e-71aa-4416-9143-452e476ec6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:26.011207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669521e-71aa-4416-9143-452e476ec6bb None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:26.011888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669521e-71aa-4416-9143-452e476ec6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:26.012644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669521e-71aa-4416-9143-452e476ec6bb None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:26.014342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669521e-71aa-4416-9143-452e476ec6bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:26.017420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669521e-71aa-4416-9143-452e476ec6bb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:26.046046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:26.057239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456f79c-9077-4db1-a84f-f7b4b21a887d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:26.068838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 114/230] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:12:25 2022] POST /identity/v3/users => generated 297 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:12:26.139377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b602c5-aae9-4e99-98f6-2e15103ad45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:26.140699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b602c5-aae9-4e99-98f6-2e15103ad45f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:26.141218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b602c5-aae9-4e99-98f6-2e15103ad45f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:26.141782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b602c5-aae9-4e99-98f6-2e15103ad45f None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:26.143351 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b602c5-aae9-4e99-98f6-2e15103ad45f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:26.144022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b602c5-aae9-4e99-98f6-2e15103ad45f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:26.147367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b602c5-aae9-4e99-98f6-2e15103ad45f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:26.167533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 117/231] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:12:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:26.173423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669521e-71aa-4416-9143-452e476ec6bb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:26.346851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669521e-71aa-4416-9143-452e476ec6bb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:26.409735 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdaf08-0b17-4e4a-8029-15be60326eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:26.410776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdaf08-0b17-4e4a-8029-15be60326eeb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:26.411177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdaf08-0b17-4e4a-8029-15be60326eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:26.411589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdaf08-0b17-4e4a-8029-15be60326eeb None admin] PATH_INFO: `/v3/users/f746bd4f3b944c48aa38e26ef39d5fdf` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:26.416930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdaf08-0b17-4e4a-8029-15be60326eeb None admin] RBAC: Authorizing `identity:get_user(user_id=f746bd4f3b944c48aa38e26ef39d5fdf)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:26.417275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdaf08-0b17-4e4a-8029-15be60326eeb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:26.420165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 115/232] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:26 2022] GET /identity/v3/users/f746bd4f3b944c48aa38e26ef39d5fdf => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:26.427540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b602c5-aae9-4e99-98f6-2e15103ad45f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:26.596823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b602c5-aae9-4e99-98f6-2e15103ad45f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:26.628543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:26.648452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5cc03-107f-4ea9-81d0-a9133cac93a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:26.649729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5cc03-107f-4ea9-81d0-a9133cac93a0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:26.650178 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5cc03-107f-4ea9-81d0-a9133cac93a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:26.650586 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5cc03-107f-4ea9-81d0-a9133cac93a0 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:26.652361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5cc03-107f-4ea9-81d0-a9133cac93a0 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:26.654201 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5cc03-107f-4ea9-81d0-a9133cac93a0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:26.656868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 118/233] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:26 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:26.662954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdaf08-0b17-4e4a-8029-15be60326eeb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:26.794913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:26.864200 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdaf08-0b17-4e4a-8029-15be60326eeb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:26.924035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0984f6-579a-42e5-9366-34d8e11aa62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:26.925410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0984f6-579a-42e5-9366-34d8e11aa62f None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:26.925959 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0984f6-579a-42e5-9366-34d8e11aa62f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:26.926437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0984f6-579a-42e5-9366-34d8e11aa62f None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4/users/f746bd4f3b944c48aa38e26ef39d5fdf/roles/cbcda598469c41f19a1d3109e5d4c236` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:26.931376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0984f6-579a-42e5-9366-34d8e11aa62f None admin] RBAC: Authorizing `identity:create_grant(project_id=4efc2482ceab4826af36f260dbc35af4, user_id=f746bd4f3b944c48aa38e26ef39d5fdf, role_id=cbcda598469c41f19a1d3109e5d4c236)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:26.933362 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0984f6-579a-42e5-9366-34d8e11aa62f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:26.958896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 116/234] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:12:26 2022] PUT /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4/users/f746bd4f3b944c48aa38e26ef39d5fdf/roles/cbcda598469c41f19a1d3109e5d4c236 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:27.671073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc6069-2157-42f3-9524-acf60de9d787 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:27.671770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc6069-2157-42f3-9524-acf60de9d787 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:27.671770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc6069-2157-42f3-9524-acf60de9d787 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:27.673279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 119/235] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:27.679523 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6187-5016-4a4c-ac4c-8e1b4c8e0638 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:27.679928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6187-5016-4a4c-ac4c-8e1b4c8e0638 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:27.680076 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6187-5016-4a4c-ac4c-8e1b4c8e0638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:27.703205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-381b6187-5016-4a4c-ac4c-8e1b4c8e0638 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:27.704461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-381b6187-5016-4a4c-ac4c-8e1b4c8e0638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:27.818669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 117/236] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:12:27.851234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc6069-2157-42f3-9524-acf60de9d787 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:28.115418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc6069-2157-42f3-9524-acf60de9d787 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:28.191169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3b9be-63ee-4b26-95ca-2c0a9b498a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:28.192441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3b9be-63ee-4b26-95ca-2c0a9b498a4b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:28.192931 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3b9be-63ee-4b26-95ca-2c0a9b498a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:28.193458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3b9be-63ee-4b26-95ca-2c0a9b498a4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:28.212202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3b9be-63ee-4b26-95ca-2c0a9b498a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0fa3b9be-63ee-4b26-95ca-2c0a9b498a4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:28.227660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:28.229486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:28.230588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 120/237] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:28.237717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b6187-5016-4a4c-ac4c-8e1b4c8e0638 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:28.391972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:28.492163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f0fa1-d520-4395-86c4-676c7c11b517 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:28.492468 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f0fa1-d520-4395-86c4-676c7c11b517 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:28.492840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f0fa1-d520-4395-86c4-676c7c11b517 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:28.494255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 121/238] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:12:28.500446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bca9e-4912-44ac-a4c7-6dd6a74a6919 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:28.500918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bca9e-4912-44ac-a4c7-6dd6a74a6919 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:28.501298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bca9e-4912-44ac-a4c7-6dd6a74a6919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:28.502458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b6187-5016-4a4c-ac4c-8e1b4c8e0638 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:28.521925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-cd4bca9e-4912-44ac-a4c7-6dd6a74a6919 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:28.523357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cd4bca9e-4912-44ac-a4c7-6dd6a74a6919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:28.605075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:28.629379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c917e-c6f4-4939-8bea-98fc1a7be075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:28.630571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c917e-c6f4-4939-8bea-98fc1a7be075 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:28.631068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c917e-c6f4-4939-8bea-98fc1a7be075 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:28.631558 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c917e-c6f4-4939-8bea-98fc1a7be075 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:28.635337 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c917e-c6f4-4939-8bea-98fc1a7be075 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:28.635860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c917e-c6f4-4939-8bea-98fc1a7be075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:28.638547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c917e-c6f4-4939-8bea-98fc1a7be075 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:28.670455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 118/239] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:28.679732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c917e-c6f4-4939-8bea-98fc1a7be075 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:28.684704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 122/240] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:12:28.711656 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bca9e-4912-44ac-a4c7-6dd6a74a6919 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:28.872200 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c917e-c6f4-4939-8bea-98fc1a7be075 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:28.893478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:28.921430 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaa265-89de-43af-aa80-e934977adbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:28.922240 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaa265-89de-43af-aa80-e934977adbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:28.922513 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaa265-89de-43af-aa80-e934977adbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:28.922772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaa265-89de-43af-aa80-e934977adbc5 None admin] PATH_INFO: `/v3/users/f746bd4f3b944c48aa38e26ef39d5fdf` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:28.925464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfaa265-89de-43af-aa80-e934977adbc5 None admin] RBAC: Authorizing `identity:get_user(user_id=f746bd4f3b944c48aa38e26ef39d5fdf)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:28.927061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfaa265-89de-43af-aa80-e934977adbc5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:28.929266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 119/241] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:28 2022] GET /identity/v3/users/f746bd4f3b944c48aa38e26ef39d5fdf => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:28.935619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaa265-89de-43af-aa80-e934977adbc5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:28.936976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bca9e-4912-44ac-a4c7-6dd6a74a6919 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:29.001901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21166a34-d26e-49d8-9367-0be1e66f929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:29.002737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21166a34-d26e-49d8-9367-0be1e66f929d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:29.003018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21166a34-d26e-49d8-9367-0be1e66f929d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:29.003303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21166a34-d26e-49d8-9367-0be1e66f929d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:29.023259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21166a34-d26e-49d8-9367-0be1e66f929d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-21166a34-d26e-49d8-9367-0be1e66f929d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:29.042759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:29.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:29.046167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 123/242] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:12:29.057717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21166a34-d26e-49d8-9367-0be1e66f929d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:29.063074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaa265-89de-43af-aa80-e934977adbc5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:29.110864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599cfee-f82b-4e11-995a-a4cabaaabeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:29.111558 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599cfee-f82b-4e11-995a-a4cabaaabeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:29.111833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599cfee-f82b-4e11-995a-a4cabaaabeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:29.112099 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599cfee-f82b-4e11-995a-a4cabaaabeb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:29.145215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:29.249036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:29.297371 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599cfee-f82b-4e11-995a-a4cabaaabeb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:29.300388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599cfee-f82b-4e11-995a-a4cabaaabeb2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:29.316339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21166a34-d26e-49d8-9367-0be1e66f929d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:29.394363 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07f79c-cc27-4909-8402-393ef73f6932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:29.395076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07f79c-cc27-4909-8402-393ef73f6932 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:29.395729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07f79c-cc27-4909-8402-393ef73f6932 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:29.396007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07f79c-cc27-4909-8402-393ef73f6932 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:29.396848 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07f79c-cc27-4909-8402-393ef73f6932 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:29.397158 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07f79c-cc27-4909-8402-393ef73f6932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:29.398734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07f79c-cc27-4909-8402-393ef73f6932 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:29.416780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 124/243] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:29.422826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07f79c-cc27-4909-8402-393ef73f6932 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:29.479300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 120/244] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:29.485109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599cfee-f82b-4e11-995a-a4cabaaabeb2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:29.587703 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07f79c-cc27-4909-8402-393ef73f6932 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:29.592889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:29.613114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:29.621641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599cfee-f82b-4e11-995a-a4cabaaabeb2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:29.665866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedad9e6-0ba4-4f54-bd45-429c0f127511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:29.666786 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedad9e6-0ba4-4f54-bd45-429c0f127511 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:29.667068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedad9e6-0ba4-4f54-bd45-429c0f127511 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:29.667363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedad9e6-0ba4-4f54-bd45-429c0f127511 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:29.669369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedad9e6-0ba4-4f54-bd45-429c0f127511 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:29.670937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedad9e6-0ba4-4f54-bd45-429c0f127511 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:29.673118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 121/245] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:29 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:29.679380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedad9e6-0ba4-4f54-bd45-429c0f127511 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:29.730012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cd32c-262a-4a23-bf85-147349ebb56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:29.730934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cd32c-262a-4a23-bf85-147349ebb56f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:29.731399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cd32c-262a-4a23-bf85-147349ebb56f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:29.731679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cd32c-262a-4a23-bf85-147349ebb56f None admin] PATH_INFO: `/v3/users/486eaeaa65d049f8ac758de240ea070f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:29.733043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cd32c-262a-4a23-bf85-147349ebb56f None admin] RBAC: Authorizing `identity:get_user(user_id=486eaeaa65d049f8ac758de240ea070f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:29.734542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cd32c-262a-4a23-bf85-147349ebb56f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:29.736285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 125/246] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:29 2022] GET /identity/v3/users/486eaeaa65d049f8ac758de240ea070f => generated 297 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:29.745632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cd32c-262a-4a23-bf85-147349ebb56f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:29.887885 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedad9e6-0ba4-4f54-bd45-429c0f127511 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:29.935839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cd32c-262a-4a23-bf85-147349ebb56f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:29.959757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ab41e-1ce8-465e-bdb9-775a52cd1b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:29.960463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab41e-1ce8-465e-bdb9-775a52cd1b33 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:29.960764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab41e-1ce8-465e-bdb9-775a52cd1b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:29.961207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab41e-1ce8-465e-bdb9-775a52cd1b33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:29.962222 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ab41e-1ce8-465e-bdb9-775a52cd1b33 None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=4efc2482ceab4826af36f260dbc35af4, user.id=f746bd4f3b944c48aa38e26ef39d5fdf) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:29.963631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ab41e-1ce8-465e-bdb9-775a52cd1b33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:29.965388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ab41e-1ce8-465e-bdb9-775a52cd1b33 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:29.980236 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 122/247] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:29 2022] GET /identity/v3/role_assignments?user.id=f746bd4f3b944c48aa38e26ef39d5fdf&scope.project.id=4efc2482ceab4826af36f260dbc35af4&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:29.995229 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55245473-8dda-4430-abf1-428021ff5d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:29.996382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55245473-8dda-4430-abf1-428021ff5d71 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:29.996849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55245473-8dda-4430-abf1-428021ff5d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:29.997285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55245473-8dda-4430-abf1-428021ff5d71 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:29.998927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55245473-8dda-4430-abf1-428021ff5d71 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:30.000746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55245473-8dda-4430-abf1-428021ff5d71 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:30.003286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 126/248] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:29 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:30.009660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55245473-8dda-4430-abf1-428021ff5d71 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:30.010283 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c6adf-fa05-415a-bc40-6ab8313514d8 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:30.010538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c6adf-fa05-415a-bc40-6ab8313514d8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:30.010821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c6adf-fa05-415a-bc40-6ab8313514d8 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:30.012273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 123/249] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:30.022437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b64ab-ddac-4972-917a-a27beb08a899 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:30.023028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b64ab-ddac-4972-917a-a27beb08a899 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:30.023483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b64ab-ddac-4972-917a-a27beb08a899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:30.058455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-934b64ab-ddac-4972-917a-a27beb08a899 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:30.059722 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-934b64ab-ddac-4972-917a-a27beb08a899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:30.076926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:30.078514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:30.161764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 124/250] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:30.163770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518befb-eed6-4681-a8df-56151f34e21b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:30.164297 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518befb-eed6-4681-a8df-56151f34e21b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:30.164761 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518befb-eed6-4681-a8df-56151f34e21b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:30.166790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 125/251] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:30.179680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3fb81-4749-44fd-a754-fa6904739e3c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:30.180138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3fb81-4749-44fd-a754-fa6904739e3c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:30.180644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3fb81-4749-44fd-a754-fa6904739e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:30.191303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55245473-8dda-4430-abf1-428021ff5d71 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:30.209692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0eb3fb81-4749-44fd-a754-fa6904739e3c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:30.211919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0eb3fb81-4749-44fd-a754-fa6904739e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:30.242975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d995e45-259e-402c-8662-46c227ac62d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:30.244813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d995e45-259e-402c-8662-46c227ac62d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:30.245447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d995e45-259e-402c-8662-46c227ac62d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:30.246053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d995e45-259e-402c-8662-46c227ac62d3 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4/users/486eaeaa65d049f8ac758de240ea070f/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:30.250142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d995e45-259e-402c-8662-46c227ac62d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4efc2482ceab4826af36f260dbc35af4, user_id=486eaeaa65d049f8ac758de240ea070f, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:30.253479 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d995e45-259e-402c-8662-46c227ac62d3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:30.289517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 127/252] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:12:30 2022] PUT /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4/users/486eaeaa65d049f8ac758de240ea070f/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:30.290557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d995e45-259e-402c-8662-46c227ac62d3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:30.388818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 126/253] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:30.390300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b3803-5062-4a12-8211-a89ab747ad05 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:30.390621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b3803-5062-4a12-8211-a89ab747ad05 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:30.391028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b3803-5062-4a12-8211-a89ab747ad05 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:30.392766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 127/254] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:30.399475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd5b6f-afa9-4c27-bdc0-4cdc62338ca1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:30.399797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd5b6f-afa9-4c27-bdc0-4cdc62338ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:30.400424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd5b6f-afa9-4c27-bdc0-4cdc62338ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:30.422492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6bdd5b6f-afa9-4c27-bdc0-4cdc62338ca1 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:30.423637 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6bdd5b6f-afa9-4c27-bdc0-4cdc62338ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:30.449849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:30.456219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d995e45-259e-402c-8662-46c227ac62d3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:30.504873 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5fcd2-3ffa-4c4a-86be-64ffe9f69f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:30.505850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5fcd2-3ffa-4c4a-86be-64ffe9f69f4a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:30.506129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5fcd2-3ffa-4c4a-86be-64ffe9f69f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:30.506403 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5fcd2-3ffa-4c4a-86be-64ffe9f69f4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:30.516874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 128/255] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:30.521797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd5b6f-afa9-4c27-bdc0-4cdc62338ca1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:30.522934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5fcd2-3ffa-4c4a-86be-64ffe9f69f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-35e5fcd2-3ffa-4c4a-86be-64ffe9f69f4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:30.531037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:30.533077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:30.534131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 128/256] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:30.544610 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5fcd2-3ffa-4c4a-86be-64ffe9f69f4a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:30.546080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:30.673898 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd5b6f-afa9-4c27-bdc0-4cdc62338ca1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:30.679699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5fcd2-3ffa-4c4a-86be-64ffe9f69f4a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:30.722478 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d97c6-4ed7-43f2-b18e-1cee74a4d44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:30.723197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d97c6-4ed7-43f2-b18e-1cee74a4d44c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:30.723471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d97c6-4ed7-43f2-b18e-1cee74a4d44c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:30.723753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d97c6-4ed7-43f2-b18e-1cee74a4d44c None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:30.724615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d97c6-4ed7-43f2-b18e-1cee74a4d44c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:30.724924 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d97c6-4ed7-43f2-b18e-1cee74a4d44c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:30.726493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d97c6-4ed7-43f2-b18e-1cee74a4d44c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:30.726712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab283b-5d19-46e7-bcd5-6d9401f71641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:30.727496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab283b-5d19-46e7-bcd5-6d9401f71641 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:30.727776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab283b-5d19-46e7-bcd5-6d9401f71641 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:30.728058 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab283b-5d19-46e7-bcd5-6d9401f71641 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:30.729467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab283b-5d19-46e7-bcd5-6d9401f71641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:30.731027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab283b-5d19-46e7-bcd5-6d9401f71641 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:30.740660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 129/257] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:12:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:30.740660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab283b-5d19-46e7-bcd5-6d9401f71641 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:30.746261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 129/258] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:30.751620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d97c6-4ed7-43f2-b18e-1cee74a4d44c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:30.782473 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:30.847194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:30.881506 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab283b-5d19-46e7-bcd5-6d9401f71641 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:30.898410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d97c6-4ed7-43f2-b18e-1cee74a4d44c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:30.931986 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b341-6a78-4671-ac69-de4252e9e76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:30.932782 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b341-6a78-4671-ac69-de4252e9e76b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:30.933064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b341-6a78-4671-ac69-de4252e9e76b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:30.933336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b341-6a78-4671-ac69-de4252e9e76b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:30.943998 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58eaa-138e-431a-9dab-bf94ee88fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:30.944738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58eaa-138e-431a-9dab-bf94ee88fd5a None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:30.945022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58eaa-138e-431a-9dab-bf94ee88fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:30.945297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58eaa-138e-431a-9dab-bf94ee88fd5a None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:30.946042 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd58eaa-138e-431a-9dab-bf94ee88fd5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:30.947686 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd58eaa-138e-431a-9dab-bf94ee88fd5a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:30.950092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47b341-6a78-4671-ac69-de4252e9e76b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3c47b341-6a78-4671-ac69-de4252e9e76b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:30.968870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:30.969895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:30.970719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:30.970719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:30.970719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:30.970719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:30.970719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:30.970719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:30.970719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:30.970719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:30.970719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:30.970719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:30.970719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:30.970719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:30.971325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 130/259] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:12:30 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:12:30.978757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 130/260] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:12:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:30.980270 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58eaa-138e-431a-9dab-bf94ee88fd5a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:30.981410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b341-6a78-4671-ac69-de4252e9e76b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:31.106413 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:31.139612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58eaa-138e-431a-9dab-bf94ee88fd5a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:31.189760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b341-6a78-4671-ac69-de4252e9e76b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:31.195077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cd1d0-6af1-4ae5-b231-90b532fef537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:31.198126 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cd1d0-6af1-4ae5-b231-90b532fef537 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:31.199152 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cd1d0-6af1-4ae5-b231-90b532fef537 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:31.199707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cd1d0-6af1-4ae5-b231-90b532fef537 None admin] PATH_INFO: `/v3/users/3d478c8a373f4e24bba00aede605565f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:31.227030 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cd1d0-6af1-4ae5-b231-90b532fef537 None admin] RBAC: Authorizing `identity:get_user(user_id=3d478c8a373f4e24bba00aede605565f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:31.228929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cd1d0-6af1-4ae5-b231-90b532fef537 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:31.230973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 131/261] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:30 2022] GET /identity/v3/users/3d478c8a373f4e24bba00aede605565f => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:31.241153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cd1d0-6af1-4ae5-b231-90b532fef537 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:31.244043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9bb96-25ef-4a8e-9560-c321319c453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:31.245302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9bb96-25ef-4a8e-9560-c321319c453d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:31.245795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9bb96-25ef-4a8e-9560-c321319c453d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:31.246274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9bb96-25ef-4a8e-9560-c321319c453d None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:31.247745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9bb96-25ef-4a8e-9560-c321319c453d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:31.248282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9bb96-25ef-4a8e-9560-c321319c453d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:31.251275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9bb96-25ef-4a8e-9560-c321319c453d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:31.262523 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:31.276899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 131/262] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:12:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:31.280891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9bb96-25ef-4a8e-9560-c321319c453d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:31.421331 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cd1d0-6af1-4ae5-b231-90b532fef537 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:31.472791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26f49f-07e4-406b-b11c-591683e77b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:31.474335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26f49f-07e4-406b-b11c-591683e77b8c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:31.475202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26f49f-07e4-406b-b11c-591683e77b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:31.475884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26f49f-07e4-406b-b11c-591683e77b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:31.482227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:31.490086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9bb96-25ef-4a8e-9560-c321319c453d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:31.540676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6644ef-2ce6-47f3-8dbf-16129f2bc81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:31.541582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6644ef-2ce6-47f3-8dbf-16129f2bc81d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:31.541856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6644ef-2ce6-47f3-8dbf-16129f2bc81d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:31.542124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6644ef-2ce6-47f3-8dbf-16129f2bc81d None admin] PATH_INFO: `/v3/users/f746bd4f3b944c48aa38e26ef39d5fdf` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:31.543395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6644ef-2ce6-47f3-8dbf-16129f2bc81d None admin] RBAC: Authorizing `identity:get_user(user_id=f746bd4f3b944c48aa38e26ef39d5fdf)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:31.544926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6644ef-2ce6-47f3-8dbf-16129f2bc81d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:31.546993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 132/263] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:31 2022] GET /identity/v3/users/f746bd4f3b944c48aa38e26ef39d5fdf => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:31.556872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6644ef-2ce6-47f3-8dbf-16129f2bc81d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:31.623810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26f49f-07e4-406b-b11c-591683e77b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:31.627480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26f49f-07e4-406b-b11c-591683e77b8c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:31.641162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:31.702129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6644ef-2ce6-47f3-8dbf-16129f2bc81d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:31.748997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9164b2f-c08c-48a9-8750-aa91c28739ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:31.749461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9164b2f-c08c-48a9-8750-aa91c28739ad None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:31.749711 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9164b2f-c08c-48a9-8750-aa91c28739ad None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:31.749954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9164b2f-c08c-48a9-8750-aa91c28739ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:31.857973 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9164b2f-c08c-48a9-8750-aa91c28739ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:31.864531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9164b2f-c08c-48a9-8750-aa91c28739ad None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:31.867128 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 132/264] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:12:31.873505 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26f49f-07e4-406b-b11c-591683e77b8c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:31.949364 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:31.973338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 133/265] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:31.983761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:31.985498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9164b2f-c08c-48a9-8750-aa91c28739ad None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:32.134744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9164b2f-c08c-48a9-8750-aa91c28739ad None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:32.196353 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2583f-981f-4708-b753-5e7ef4901839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:32.197535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2583f-981f-4708-b753-5e7ef4901839 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:32.197849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2583f-981f-4708-b753-5e7ef4901839 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:32.198262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2583f-981f-4708-b753-5e7ef4901839 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:32.199554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2583f-981f-4708-b753-5e7ef4901839 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:32.201451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2583f-981f-4708-b753-5e7ef4901839 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:32.204945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 134/266] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:31 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:32.217267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2583f-981f-4708-b753-5e7ef4901839 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:32.240999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26f49f-07e4-406b-b11c-591683e77b8c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:32.340908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:32.362755 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eba19c-2696-465a-b1b0-fe1730979572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:32.364045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eba19c-2696-465a-b1b0-fe1730979572 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:32.364555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eba19c-2696-465a-b1b0-fe1730979572 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:32.365253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eba19c-2696-465a-b1b0-fe1730979572 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:32.370526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eba19c-2696-465a-b1b0-fe1730979572 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:32.373418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eba19c-2696-465a-b1b0-fe1730979572 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:32.382030 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 133/267] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:31 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:32.392998 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eba19c-2696-465a-b1b0-fe1730979572 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:32.490610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2583f-981f-4708-b753-5e7ef4901839 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:32.544404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db437437-8341-43ec-a038-934013f00ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:32.545669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db437437-8341-43ec-a038-934013f00ccd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:32.546157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db437437-8341-43ec-a038-934013f00ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:32.546624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db437437-8341-43ec-a038-934013f00ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:32.548327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db437437-8341-43ec-a038-934013f00ccd None admin] RBAC: Adding query filter params (role.id=cbcda598469c41f19a1d3109e5d4c236, scope.project.id=4efc2482ceab4826af36f260dbc35af4, user.id=f746bd4f3b944c48aa38e26ef39d5fdf) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:32.550880 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db437437-8341-43ec-a038-934013f00ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:32.553826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db437437-8341-43ec-a038-934013f00ccd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:32.580688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 135/268] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:32 2022] GET /identity/v3/role_assignments?user.id=f746bd4f3b944c48aa38e26ef39d5fdf&scope.project.id=4efc2482ceab4826af36f260dbc35af4&role.id=cbcda598469c41f19a1d3109e5d4c236 => generated 608 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:32.702800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eba19c-2696-465a-b1b0-fe1730979572 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:32.704632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:32.763330 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e0ee8-4a86-4516-922d-aee1fd84c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:32.764038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e0ee8-4a86-4516-922d-aee1fd84c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:32.764326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e0ee8-4a86-4516-922d-aee1fd84c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:32.764634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e0ee8-4a86-4516-922d-aee1fd84c9d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:32.765526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e0ee8-4a86-4516-922d-aee1fd84c9d7 None admin] RBAC: Adding query filter params (role.id=b59cdb5ce7164e609a36d41dfe3d0ef2, scope.project.id=4efc2482ceab4826af36f260dbc35af4, user.id=3d478c8a373f4e24bba00aede605565f) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:32.765841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e0ee8-4a86-4516-922d-aee1fd84c9d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:32.767433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e0ee8-4a86-4516-922d-aee1fd84c9d7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:32.777789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 134/269] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:32 2022] GET /identity/v3/role_assignments?user.id=3d478c8a373f4e24bba00aede605565f&scope.project.id=4efc2482ceab4826af36f260dbc35af4&role.id=b59cdb5ce7164e609a36d41dfe3d0ef2 => generated 259 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:32.963307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512fb6-100a-41b6-983d-8c7558035047 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:32.964407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512fb6-100a-41b6-983d-8c7558035047 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:32.965039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512fb6-100a-41b6-983d-8c7558035047 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:32.967306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 136/270] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:32.973636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc53e33-0f23-43eb-90b1-100e3b9a0584 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:32.974266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc53e33-0f23-43eb-90b1-100e3b9a0584 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:32.974266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc53e33-0f23-43eb-90b1-100e3b9a0584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:33.001098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5fc53e33-0f23-43eb-90b1-100e3b9a0584 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:33.002390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5fc53e33-0f23-43eb-90b1-100e3b9a0584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:33.098286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 135/271] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:33.123746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea512fb6-100a-41b6-983d-8c7558035047 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:33.239386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:33.245816 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea512fb6-100a-41b6-983d-8c7558035047 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:33.295059 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71bee3-91b1-4410-9599-e828f64e04de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:33.296335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71bee3-91b1-4410-9599-e828f64e04de None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:33.296875 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71bee3-91b1-4410-9599-e828f64e04de None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:33.297374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71bee3-91b1-4410-9599-e828f64e04de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:33.311269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71bee3-91b1-4410-9599-e828f64e04de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-fa71bee3-91b1-4410-9599-e828f64e04de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:33.320073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:33.321189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:33.321955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 137/272] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:33.327920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc53e33-0f23-43eb-90b1-100e3b9a0584 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:33.439865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:33.446394 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc53e33-0f23-43eb-90b1-100e3b9a0584 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:33.486053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83544212-61db-4d88-9af8-fa18c4805c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:33.486793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83544212-61db-4d88-9af8-fa18c4805c30 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:33.487079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83544212-61db-4d88-9af8-fa18c4805c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:33.487349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83544212-61db-4d88-9af8-fa18c4805c30 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:33.488125 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83544212-61db-4d88-9af8-fa18c4805c30 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:33.488435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83544212-61db-4d88-9af8-fa18c4805c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:33.490097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83544212-61db-4d88-9af8-fa18c4805c30 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:33.500256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 136/273] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:33.506779 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71bee3-91b1-4410-9599-e828f64e04de None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:33.631321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71bee3-91b1-4410-9599-e828f64e04de None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:33.677550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae853f-d498-4f6c-bbcb-8d360152a199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:33.678479 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae853f-d498-4f6c-bbcb-8d360152a199 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:33.678759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae853f-d498-4f6c-bbcb-8d360152a199 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:33.679039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae853f-d498-4f6c-bbcb-8d360152a199 None admin] PATH_INFO: `/v3/users/486eaeaa65d049f8ac758de240ea070f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:33.680537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae853f-d498-4f6c-bbcb-8d360152a199 None admin] RBAC: Authorizing `identity:get_user(user_id=486eaeaa65d049f8ac758de240ea070f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:33.683039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae853f-d498-4f6c-bbcb-8d360152a199 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:33.686019 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 138/274] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:33 2022] GET /identity/v3/users/486eaeaa65d049f8ac758de240ea070f => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:33.693743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83544212-61db-4d88-9af8-fa18c4805c30 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:33.837807 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83544212-61db-4d88-9af8-fa18c4805c30 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:33.877824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6846a-fa1c-47a0-b5ef-e0eda1612720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:33.878804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6846a-fa1c-47a0-b5ef-e0eda1612720 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:33.879093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6846a-fa1c-47a0-b5ef-e0eda1612720 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:33.879367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6846a-fa1c-47a0-b5ef-e0eda1612720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:33.884855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cbaee-ae93-44b4-ab78-b47a005c5c70 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:33.885796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cbaee-ae93-44b4-ab78-b47a005c5c70 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:33.886555 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cbaee-ae93-44b4-ab78-b47a005c5c70 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:33.889908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 139/275] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:33.898076 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d232c77-2081-469e-b419-92cfcc45ecc6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:33.899290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d232c77-2081-469e-b419-92cfcc45ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:33.900732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d232c77-2081-469e-b419-92cfcc45ecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:33.924951 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:33.939747 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7d232c77-2081-469e-b419-92cfcc45ecc6 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:33.943877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d232c77-2081-469e-b419-92cfcc45ecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:33.969533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6846a-fa1c-47a0-b5ef-e0eda1612720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:33.971276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6846a-fa1c-47a0-b5ef-e0eda1612720 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:34.040925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:34.092798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 140/276] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:34.092798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d251e5c-ad7e-4993-acdc-a9d9b8940e38 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:34.092798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d251e5c-ad7e-4993-acdc-a9d9b8940e38 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:34.092798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d251e5c-ad7e-4993-acdc-a9d9b8940e38 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:34.092798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 141/277] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:34.094500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852ba04-238f-4d9d-a448-890aff0315b4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:34.094788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852ba04-238f-4d9d-a448-890aff0315b4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:34.095065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852ba04-238f-4d9d-a448-890aff0315b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:34.109022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 137/278] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:34.115559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6846a-fa1c-47a0-b5ef-e0eda1612720 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:34.122301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f852ba04-238f-4d9d-a448-890aff0315b4 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:34.123842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f852ba04-238f-4d9d-a448-890aff0315b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:34.189945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:34.212667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 142/279] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:34.217706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852ba04-238f-4d9d-a448-890aff0315b4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:34.261900 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6846a-fa1c-47a0-b5ef-e0eda1612720 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:34.326831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76504987-cb6a-4014-a69d-d37bf8273d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:34.328016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76504987-cb6a-4014-a69d-d37bf8273d9e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:34.328480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76504987-cb6a-4014-a69d-d37bf8273d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:34.328941 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76504987-cb6a-4014-a69d-d37bf8273d9e None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:34.331032 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76504987-cb6a-4014-a69d-d37bf8273d9e None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:34.333398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76504987-cb6a-4014-a69d-d37bf8273d9e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:34.336765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 138/280] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:34 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:34.337911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76504987-cb6a-4014-a69d-d37bf8273d9e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:34.386537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:34.417165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852ba04-238f-4d9d-a448-890aff0315b4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:34.476979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16314015-3c8f-426d-90f9-de8d33c4a22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:34.478275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16314015-3c8f-426d-90f9-de8d33c4a22c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:34.478756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16314015-3c8f-426d-90f9-de8d33c4a22c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:34.479237 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16314015-3c8f-426d-90f9-de8d33c4a22c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:34.481363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16314015-3c8f-426d-90f9-de8d33c4a22c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:34.483840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16314015-3c8f-426d-90f9-de8d33c4a22c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:34.491522 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 143/281] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:12:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:34.491522 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16314015-3c8f-426d-90f9-de8d33c4a22c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:34.515301 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76504987-cb6a-4014-a69d-d37bf8273d9e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:34.550058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:34.563093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22663ad3-0c78-4a79-89e0-8d366db50f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:34.564037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22663ad3-0c78-4a79-89e0-8d366db50f32 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:34.564314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22663ad3-0c78-4a79-89e0-8d366db50f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:34.564622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22663ad3-0c78-4a79-89e0-8d366db50f32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:34.578100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22663ad3-0c78-4a79-89e0-8d366db50f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-22663ad3-0c78-4a79-89e0-8d366db50f32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:34.586103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:34.587943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 139/282] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:34.590526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22663ad3-0c78-4a79-89e0-8d366db50f32 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:34.639637 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16314015-3c8f-426d-90f9-de8d33c4a22c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:34.688762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71872b41-a573-40df-9c26-b96056ab4f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:34.689619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872b41-a573-40df-9c26-b96056ab4f88 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:34.690075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872b41-a573-40df-9c26-b96056ab4f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:34.690469 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872b41-a573-40df-9c26-b96056ab4f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:34.691496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71872b41-a573-40df-9c26-b96056ab4f88 None admin] RBAC: Adding query filter params (role.id=2363304f42424934b09a0ff0bc62315d, scope.project.id=4efc2482ceab4826af36f260dbc35af4, user.id=486eaeaa65d049f8ac758de240ea070f) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:34.691924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71872b41-a573-40df-9c26-b96056ab4f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:34.693829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71872b41-a573-40df-9c26-b96056ab4f88 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:34.702305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 144/283] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:34 2022] GET /identity/v3/role_assignments?user.id=486eaeaa65d049f8ac758de240ea070f&scope.project.id=4efc2482ceab4826af36f260dbc35af4&role.id=2363304f42424934b09a0ff0bc62315d => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:34.703760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71872b41-a573-40df-9c26-b96056ab4f88 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:34.739335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22663ad3-0c78-4a79-89e0-8d366db50f32 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:34.751963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:34.816563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cad312-6eaa-45b4-88ec-25aa84382779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:34.818675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cad312-6eaa-45b4-88ec-25aa84382779 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:34.819594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cad312-6eaa-45b4-88ec-25aa84382779 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:34.820378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cad312-6eaa-45b4-88ec-25aa84382779 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:34.822376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cad312-6eaa-45b4-88ec-25aa84382779 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:34.825857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cad312-6eaa-45b4-88ec-25aa84382779 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:34.868046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 140/284] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:12:34 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:12:34.871035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71872b41-a573-40df-9c26-b96056ab4f88 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:34.944910 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e06710-0a3a-47c3-bf6d-b19a2f67cd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:34.946670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e06710-0a3a-47c3-bf6d-b19a2f67cd5d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:34.947434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e06710-0a3a-47c3-bf6d-b19a2f67cd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:34.948152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e06710-0a3a-47c3-bf6d-b19a2f67cd5d None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:34.949861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e06710-0a3a-47c3-bf6d-b19a2f67cd5d None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:34.950472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e06710-0a3a-47c3-bf6d-b19a2f67cd5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:34.952183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e06710-0a3a-47c3-bf6d-b19a2f67cd5d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:34.966448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 145/285] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:34.972742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cad312-6eaa-45b4-88ec-25aa84382779 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:35.038709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:35.126567 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cad312-6eaa-45b4-88ec-25aa84382779 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:35.175055 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d47da-02f2-4dce-a365-fdff4b1f9a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:35.176748 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d47da-02f2-4dce-a365-fdff4b1f9a8e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:35.177428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d47da-02f2-4dce-a365-fdff4b1f9a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:35.178063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d47da-02f2-4dce-a365-fdff4b1f9a8e None admin] PATH_INFO: `/v3/users/31b5779d3df649ff987fbe592c583ab8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:35.202846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d47da-02f2-4dce-a365-fdff4b1f9a8e None admin] RBAC: Authorizing `identity:get_user(user_id=31b5779d3df649ff987fbe592c583ab8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:35.205848 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d47da-02f2-4dce-a365-fdff4b1f9a8e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:35.209831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 141/286] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:34 2022] GET /identity/v3/users/31b5779d3df649ff987fbe592c583ab8 => generated 293 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:35.218168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e06710-0a3a-47c3-bf6d-b19a2f67cd5d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:35.260044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435ac30-d2cb-45e2-8eb8-ee22041bc330 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:35.260365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435ac30-d2cb-45e2-8eb8-ee22041bc330 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:35.260729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435ac30-d2cb-45e2-8eb8-ee22041bc330 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:35.262585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 142/287] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:12:35.268941 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ed6e5-d9e0-4540-985b-47b8b1e376f3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:35.269232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ed6e5-d9e0-4540-985b-47b8b1e376f3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:35.269516 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ed6e5-d9e0-4540-985b-47b8b1e376f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:35.303128 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-589ed6e5-d9e0-4540-985b-47b8b1e376f3 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:35.305598 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-589ed6e5-d9e0-4540-985b-47b8b1e376f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:35.356997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:35.373785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e06710-0a3a-47c3-bf6d-b19a2f67cd5d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:35.424675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34083859-53af-4b84-954d-9b32a83c918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:35.425857 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34083859-53af-4b84-954d-9b32a83c918a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:35.426199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34083859-53af-4b84-954d-9b32a83c918a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:35.426541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34083859-53af-4b84-954d-9b32a83c918a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:35.427615 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34083859-53af-4b84-954d-9b32a83c918a None admin] RBAC: Adding query filter params (role.id=2363304f42424934b09a0ff0bc62315d, user.id=31b5779d3df649ff987fbe592c583ab8, scope.system=all) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:35.427998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34083859-53af-4b84-954d-9b32a83c918a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:35.430885 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34083859-53af-4b84-954d-9b32a83c918a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:35.447015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 146/288] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jul 21 08:12:35 2022] GET /identity/v3/role_assignments?user.id=31b5779d3df649ff987fbe592c583ab8&scope.system=all&role.id=2363304f42424934b09a0ff0bc62315d => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:35.478402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 143/289] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:12:35.519900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34083859-53af-4b84-954d-9b32a83c918a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:35.736895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34083859-53af-4b84-954d-9b32a83c918a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:35.807330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4e87e-86a5-405f-bcdb-4f5171d11dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:35.808804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4e87e-86a5-405f-bcdb-4f5171d11dfe None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:35.809300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4e87e-86a5-405f-bcdb-4f5171d11dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:35.809792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4e87e-86a5-405f-bcdb-4f5171d11dfe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:35.831292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4e87e-86a5-405f-bcdb-4f5171d11dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d6e4e87e-86a5-405f-bcdb-4f5171d11dfe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:35.847383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:35.848334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:35.851342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 147/290] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:35.860473 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ed6e5-d9e0-4540-985b-47b8b1e376f3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:35.932912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:36.070085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ed6e5-d9e0-4540-985b-47b8b1e376f3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:36.139459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12a016-44dd-468a-b62c-8dc6218f7bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:36.140789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12a016-44dd-468a-b62c-8dc6218f7bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:36.141151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12a016-44dd-468a-b62c-8dc6218f7bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:36.141640 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12a016-44dd-468a-b62c-8dc6218f7bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:36.143252 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12a016-44dd-468a-b62c-8dc6218f7bd6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:36.143824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12a016-44dd-468a-b62c-8dc6218f7bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:36.147173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12a016-44dd-468a-b62c-8dc6218f7bd6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:36.165987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 144/291] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:36.178823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4e87e-86a5-405f-bcdb-4f5171d11dfe None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:36.185988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:36.394089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4e87e-86a5-405f-bcdb-4f5171d11dfe None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:36.465466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be1f55-b113-4657-9619-aa3e0780c210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:36.466822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1f55-b113-4657-9619-aa3e0780c210 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:36.467328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1f55-b113-4657-9619-aa3e0780c210 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:36.467815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1f55-b113-4657-9619-aa3e0780c210 None admin] PATH_INFO: `/v3/users/3d478c8a373f4e24bba00aede605565f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:36.470229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be1f55-b113-4657-9619-aa3e0780c210 None admin] RBAC: Authorizing `identity:get_user(user_id=3d478c8a373f4e24bba00aede605565f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:36.473152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be1f55-b113-4657-9619-aa3e0780c210 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:36.477173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 148/292] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:36 2022] GET /identity/v3/users/3d478c8a373f4e24bba00aede605565f => generated 297 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:36.486759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12a016-44dd-468a-b62c-8dc6218f7bd6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:36.689083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:36.700469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12a016-44dd-468a-b62c-8dc6218f7bd6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:36.743365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed7c6e-e976-424d-b8c4-0406e755462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:36.744280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed7c6e-e976-424d-b8c4-0406e755462b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:36.744594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed7c6e-e976-424d-b8c4-0406e755462b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:36.744870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed7c6e-e976-424d-b8c4-0406e755462b None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:36.746376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed7c6e-e976-424d-b8c4-0406e755462b None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:36.747961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed7c6e-e976-424d-b8c4-0406e755462b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:36.750232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 145/293] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:36 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:36.759225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be1f55-b113-4657-9619-aa3e0780c210 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:36.896524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:36.944301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be1f55-b113-4657-9619-aa3e0780c210 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:36.987485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcc6ee-8348-4d4c-84df-675095320e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:36.988467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcc6ee-8348-4d4c-84df-675095320e49 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:36.988790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcc6ee-8348-4d4c-84df-675095320e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:36.989082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcc6ee-8348-4d4c-84df-675095320e49 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4/users/3d478c8a373f4e24bba00aede605565f/roles/b59cdb5ce7164e609a36d41dfe3d0ef2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:36.991571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcc6ee-8348-4d4c-84df-675095320e49 None admin] RBAC: Authorizing `identity:create_grant(project_id=4efc2482ceab4826af36f260dbc35af4, user_id=3d478c8a373f4e24bba00aede605565f, role_id=b59cdb5ce7164e609a36d41dfe3d0ef2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:36.993191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcc6ee-8348-4d4c-84df-675095320e49 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:37.013194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 149/294] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:12:36 2022] PUT /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4/users/3d478c8a373f4e24bba00aede605565f/roles/b59cdb5ce7164e609a36d41dfe3d0ef2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:37.550435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40b40-25dd-4a09-8515-91b1d76a6059 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:37.551204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40b40-25dd-4a09-8515-91b1d76a6059 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:37.551204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40b40-25dd-4a09-8515-91b1d76a6059 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:37.552856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 146/295] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:37.559053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3522e-a48d-442d-bfa3-92c707fab22d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:37.559284 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3522e-a48d-442d-bfa3-92c707fab22d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:37.559527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3522e-a48d-442d-bfa3-92c707fab22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:37.579228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5aa3522e-a48d-442d-bfa3-92c707fab22d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:37.580524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5aa3522e-a48d-442d-bfa3-92c707fab22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:37.716705 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 150/296] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:37.745121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb40b40-25dd-4a09-8515-91b1d76a6059 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:37.873541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb40b40-25dd-4a09-8515-91b1d76a6059 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:37.876332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b557071-2003-46d6-937f-4c00144c191e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:37.877264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b557071-2003-46d6-937f-4c00144c191e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:37.877264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b557071-2003-46d6-937f-4c00144c191e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:37.879827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 151/297] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:12:37.884785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672033df-b89c-448a-b5d6-e6b1eee7bffd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:37.885183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672033df-b89c-448a-b5d6-e6b1eee7bffd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:37.885450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672033df-b89c-448a-b5d6-e6b1eee7bffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:37.910796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-672033df-b89c-448a-b5d6-e6b1eee7bffd None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:37.913329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-672033df-b89c-448a-b5d6-e6b1eee7bffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:37.916772 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85647ca-f3a2-4389-9cfc-310cc839ceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:37.917884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85647ca-f3a2-4389-9cfc-310cc839ceff None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:37.918158 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85647ca-f3a2-4389-9cfc-310cc839ceff None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:37.918434 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85647ca-f3a2-4389-9cfc-310cc839ceff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:37.934274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85647ca-f3a2-4389-9cfc-310cc839ceff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e85647ca-f3a2-4389-9cfc-310cc839ceff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:37.943118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:37.946590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 147/298] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:12:37.957982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85647ca-f3a2-4389-9cfc-310cc839ceff None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:37.980623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:38.026500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:38.049468 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 152/299] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:12:38.097312 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672033df-b89c-448a-b5d6-e6b1eee7bffd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:38.101675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85647ca-f3a2-4389-9cfc-310cc839ceff None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:38.160281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fd2ed-20ed-48da-9366-ce1e30941ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:38.161283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fd2ed-20ed-48da-9366-ce1e30941ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:38.161799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fd2ed-20ed-48da-9366-ce1e30941ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:38.162234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fd2ed-20ed-48da-9366-ce1e30941ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:38.163165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fd2ed-20ed-48da-9366-ce1e30941ae1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:38.163623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fd2ed-20ed-48da-9366-ce1e30941ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:38.165388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fd2ed-20ed-48da-9366-ce1e30941ae1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:38.180667 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 148/300] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:38.181988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fd2ed-20ed-48da-9366-ce1e30941ae1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:38.283433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:38.312783 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672033df-b89c-448a-b5d6-e6b1eee7bffd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:38.321551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fd2ed-20ed-48da-9366-ce1e30941ae1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:38.384995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102ae7e-c7ef-4b41-9d8e-19776e936d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:38.386770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102ae7e-c7ef-4b41-9d8e-19776e936d29 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:38.387345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102ae7e-c7ef-4b41-9d8e-19776e936d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:38.388038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102ae7e-c7ef-4b41-9d8e-19776e936d29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:38.390455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455565f-4086-44e4-996e-ac1d8ff41980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:38.390683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102ae7e-c7ef-4b41-9d8e-19776e936d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:38.392455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455565f-4086-44e4-996e-ac1d8ff41980 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:38.393266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455565f-4086-44e4-996e-ac1d8ff41980 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:38.393642 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102ae7e-c7ef-4b41-9d8e-19776e936d29 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:38.394130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455565f-4086-44e4-996e-ac1d8ff41980 None admin] PATH_INFO: `/v3/users/1da9889913b048369989c1122cdbca63` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:38.397778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 153/301] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:12:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:38.406923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102ae7e-c7ef-4b41-9d8e-19776e936d29 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:38.424399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455565f-4086-44e4-996e-ac1d8ff41980 None admin] RBAC: Authorizing `identity:get_user(user_id=1da9889913b048369989c1122cdbca63)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:38.427808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455565f-4086-44e4-996e-ac1d8ff41980 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:38.431522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 149/302] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:38 2022] GET /identity/v3/users/1da9889913b048369989c1122cdbca63 => generated 293 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:38.441421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455565f-4086-44e4-996e-ac1d8ff41980 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:38.527672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:38.595257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455565f-4086-44e4-996e-ac1d8ff41980 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:38.610866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102ae7e-c7ef-4b41-9d8e-19776e936d29 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:38.646513 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a29554-7a6c-4093-93af-fbf90ffd80a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:38.647406 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a29554-7a6c-4093-93af-fbf90ffd80a0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:38.647871 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a29554-7a6c-4093-93af-fbf90ffd80a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:38.648320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a29554-7a6c-4093-93af-fbf90ffd80a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:38.649366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a29554-7a6c-4093-93af-fbf90ffd80a0 None admin] RBAC: Adding query filter params (role.id=b59cdb5ce7164e609a36d41dfe3d0ef2, user.id=1da9889913b048369989c1122cdbca63, scope.system=all) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:38.649861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a29554-7a6c-4093-93af-fbf90ffd80a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:38.651560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a29554-7a6c-4093-93af-fbf90ffd80a0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:38.668548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 150/303] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jul 21 08:12:38 2022] GET /identity/v3/role_assignments?user.id=1da9889913b048369989c1122cdbca63&scope.system=all&role.id=b59cdb5ce7164e609a36d41dfe3d0ef2 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:38.668548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a23ff3-13a1-4228-a1a8-b43e6bec1154 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:38.668548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a23ff3-13a1-4228-a1a8-b43e6bec1154 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:38.668548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a23ff3-13a1-4228-a1a8-b43e6bec1154 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:38.668548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 151/304] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:38.672215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf0227-93b5-457a-afd9-cbe858295b7a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:38.672875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf0227-93b5-457a-afd9-cbe858295b7a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:38.673289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf0227-93b5-457a-afd9-cbe858295b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:38.679511 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71b763-f0dc-4bb1-af71-77c6f62a91b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:38.680563 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71b763-f0dc-4bb1-af71-77c6f62a91b8 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:38.680991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71b763-f0dc-4bb1-af71-77c6f62a91b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:38.681664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71b763-f0dc-4bb1-af71-77c6f62a91b8 None admin] PATH_INFO: `/v3/groups` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:38.683082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71b763-f0dc-4bb1-af71-77c6f62a91b8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:38.684329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:38.685445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71b763-f0dc-4bb1-af71-77c6f62a91b8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:38.704410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-cadf0227-93b5-457a-afd9-cbe858295b7a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:38.707027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cadf0227-93b5-457a-afd9-cbe858295b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:38.714499 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 154/305] 10.222.0.40 () {60 vars in 1134 bytes} [Thu Jul 21 08:12:38 2022] POST /identity/v3/groups => generated 229 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:12:38.808145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 152/306] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:38.832939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71b763-f0dc-4bb1-af71-77c6f62a91b8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:39.035641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71b763-f0dc-4bb1-af71-77c6f62a91b8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:39.074119 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:39.104024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2213573-e440-4731-8acd-ff9a0f90f0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:39.105438 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2213573-e440-4731-8acd-ff9a0f90f0fb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:39.105914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2213573-e440-4731-8acd-ff9a0f90f0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:39.106405 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2213573-e440-4731-8acd-ff9a0f90f0fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:39.128542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2213573-e440-4731-8acd-ff9a0f90f0fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d2213573-e440-4731-8acd-ff9a0f90f0fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:39.144459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:39.145867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:39.146663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:39.146663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:39.146663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:39.146663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:39.146663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:39.146663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:39.146663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:39.146663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:39.146663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:39.146663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:39.146663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:39.146663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:39.147851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 155/307] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:39.154163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf0227-93b5-457a-afd9-cbe858295b7a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:39.304296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf0227-93b5-457a-afd9-cbe858295b7a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:39.374921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092f597-5d12-4bc3-9437-beed459736e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:39.376086 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092f597-5d12-4bc3-9437-beed459736e4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:39.376581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092f597-5d12-4bc3-9437-beed459736e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:39.377041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092f597-5d12-4bc3-9437-beed459736e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:39.378443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092f597-5d12-4bc3-9437-beed459736e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:39.378940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092f597-5d12-4bc3-9437-beed459736e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:39.381673 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092f597-5d12-4bc3-9437-beed459736e4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:39.384310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:39.399320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 153/308] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:39.405064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2213573-e440-4731-8acd-ff9a0f90f0fb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:39.561437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2213573-e440-4731-8acd-ff9a0f90f0fb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:39.627107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c11a50-8c46-4e6e-ad80-2158b7e21d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:39.628719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c11a50-8c46-4e6e-ad80-2158b7e21d6a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:39.629400 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c11a50-8c46-4e6e-ad80-2158b7e21d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:39.629882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c11a50-8c46-4e6e-ad80-2158b7e21d6a None admin] PATH_INFO: `/v3/users/31b5779d3df649ff987fbe592c583ab8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:39.632315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c11a50-8c46-4e6e-ad80-2158b7e21d6a None admin] RBAC: Authorizing `identity:get_user(user_id=31b5779d3df649ff987fbe592c583ab8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:39.635069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c11a50-8c46-4e6e-ad80-2158b7e21d6a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:39.638767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 156/309] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:39 2022] GET /identity/v3/users/31b5779d3df649ff987fbe592c583ab8 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:39.647433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092f597-5d12-4bc3-9437-beed459736e4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:39.773764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092f597-5d12-4bc3-9437-beed459736e4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:39.810775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902da62-30c9-4177-8700-b68040ebbde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:39.811731 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902da62-30c9-4177-8700-b68040ebbde4 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:39.811970 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902da62-30c9-4177-8700-b68040ebbde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:39.812185 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902da62-30c9-4177-8700-b68040ebbde4 None admin] PATH_INFO: `/v3/system/users/31b5779d3df649ff987fbe592c583ab8/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:39.813785 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902da62-30c9-4177-8700-b68040ebbde4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=31b5779d3df649ff987fbe592c583ab8, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:39.815198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902da62-30c9-4177-8700-b68040ebbde4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:39.827026 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 154/310] 10.222.0.40 () {58 vars in 1334 bytes} [Thu Jul 21 08:12:39 2022] PUT /identity/v3/system/users/31b5779d3df649ff987fbe592c583ab8/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:40.111542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cf031-f9a4-451a-a743-e823d11d012e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:40.112302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cf031-f9a4-451a-a743-e823d11d012e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:40.112302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cf031-f9a4-451a-a743-e823d11d012e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:40.114392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 157/311] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:40.120288 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5a718-5bea-4ed3-9678-e7843537df92 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:40.120708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5a718-5bea-4ed3-9678-e7843537df92 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:40.120925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5a718-5bea-4ed3-9678-e7843537df92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:40.140408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-00c5a718-5bea-4ed3-9678-e7843537df92 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:40.141734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-00c5a718-5bea-4ed3-9678-e7843537df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:40.218727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:40.235820 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 155/312] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:40.261637 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cf031-f9a4-451a-a743-e823d11d012e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:40.332468 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:40.398797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cf031-f9a4-451a-a743-e823d11d012e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:40.438036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e07b-bbfc-47ff-901f-b85bf42b9cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:40.438869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e07b-bbfc-47ff-901f-b85bf42b9cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:40.439143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e07b-bbfc-47ff-901f-b85bf42b9cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:40.439404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e07b-bbfc-47ff-901f-b85bf42b9cc8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:40.460650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96e07b-bbfc-47ff-901f-b85bf42b9cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-5f96e07b-bbfc-47ff-901f-b85bf42b9cc8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:40.476260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:40.479581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:40.482628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 158/313] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:40.487773 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5a718-5bea-4ed3-9678-e7843537df92 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:40.607451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5a718-5bea-4ed3-9678-e7843537df92 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:40.647884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb151ab4-4a23-4131-b13e-862e1ca3a649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:40.648975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb151ab4-4a23-4131-b13e-862e1ca3a649 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:40.648975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb151ab4-4a23-4131-b13e-862e1ca3a649 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:40.649249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb151ab4-4a23-4131-b13e-862e1ca3a649 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:40.649928 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb151ab4-4a23-4131-b13e-862e1ca3a649 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:40.650232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb151ab4-4a23-4131-b13e-862e1ca3a649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:40.651687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb151ab4-4a23-4131-b13e-862e1ca3a649 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:40.662462 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 156/314] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:40.671314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e07b-bbfc-47ff-901f-b85bf42b9cc8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:40.883204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e07b-bbfc-47ff-901f-b85bf42b9cc8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:40.904296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:40.945486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca9756-ac44-42b0-ade4-f6262fd27f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:40.946406 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca9756-ac44-42b0-ade4-f6262fd27f1d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:40.946680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca9756-ac44-42b0-ade4-f6262fd27f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:40.946948 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca9756-ac44-42b0-ade4-f6262fd27f1d None admin] PATH_INFO: `/v3/users/3d478c8a373f4e24bba00aede605565f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:40.948334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca9756-ac44-42b0-ade4-f6262fd27f1d None admin] RBAC: Authorizing `identity:get_user(user_id=3d478c8a373f4e24bba00aede605565f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:40.949871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca9756-ac44-42b0-ade4-f6262fd27f1d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:40.951939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 159/315] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:40 2022] GET /identity/v3/users/3d478c8a373f4e24bba00aede605565f => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:40.960970 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb151ab4-4a23-4131-b13e-862e1ca3a649 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:41.029922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:41.093701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb151ab4-4a23-4131-b13e-862e1ca3a649 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:41.134074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa0f4-7727-4174-9881-472b81dca553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:41.134743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa0f4-7727-4174-9881-472b81dca553 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:41.135020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa0f4-7727-4174-9881-472b81dca553 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:41.135288 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa0f4-7727-4174-9881-472b81dca553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:41.214078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fa0f4-7727-4174-9881-472b81dca553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:41.215588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fa0f4-7727-4174-9881-472b81dca553 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:41.232820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625077fe-601e-4ff1-9ad8-858f3905fe58 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:41.233618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625077fe-601e-4ff1-9ad8-858f3905fe58 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:41.233618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625077fe-601e-4ff1-9ad8-858f3905fe58 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:41.236405 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 160/316] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:12:41.242281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1834cf-87dd-4fe0-a444-0af28810bb44 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:41.242705 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1834cf-87dd-4fe0-a444-0af28810bb44 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:41.242999 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1834cf-87dd-4fe0-a444-0af28810bb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:41.266803 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5a1834cf-87dd-4fe0-a444-0af28810bb44 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:41.268237 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5a1834cf-87dd-4fe0-a444-0af28810bb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:41.279405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:41.360602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 157/317] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:41.368780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa0f4-7727-4174-9881-472b81dca553 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:41.386245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 161/318] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:41.409157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1834cf-87dd-4fe0-a444-0af28810bb44 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:41.514026 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa0f4-7727-4174-9881-472b81dca553 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:41.556537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b51b3-0531-45dc-b23b-78d6db6e299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:41.557553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b51b3-0531-45dc-b23b-78d6db6e299b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:41.557835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b51b3-0531-45dc-b23b-78d6db6e299b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:41.558113 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b51b3-0531-45dc-b23b-78d6db6e299b None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:41.559538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b51b3-0531-45dc-b23b-78d6db6e299b None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:41.561081 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b51b3-0531-45dc-b23b-78d6db6e299b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:41.563363 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 158/319] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:41 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:41.574165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b51b3-0531-45dc-b23b-78d6db6e299b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:41.603216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1834cf-87dd-4fe0-a444-0af28810bb44 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:41.613914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:41.620336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:41.656215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c639547-bb4f-45fb-9c3f-d2ce7638f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:41.657470 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c639547-bb4f-45fb-9c3f-d2ce7638f423 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:41.657980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c639547-bb4f-45fb-9c3f-d2ce7638f423 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:41.658465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c639547-bb4f-45fb-9c3f-d2ce7638f423 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:41.672199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c639547-bb4f-45fb-9c3f-d2ce7638f423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-9c639547-bb4f-45fb-9c3f-d2ce7638f423 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:41.683133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:41.684207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:41.685025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:41.685025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:41.685025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:41.685025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:41.685025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:41.685025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:41.685025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:41.685025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:41.685025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:41.685025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:41.685025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:41.685025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:41.687589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 162/320] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:12:41.696549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c639547-bb4f-45fb-9c3f-d2ce7638f423 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:41.762413 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b51b3-0531-45dc-b23b-78d6db6e299b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:41.823843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78d464-77c9-4570-8e13-0ffb76610579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:41.825616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78d464-77c9-4570-8e13-0ffb76610579 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:41.825783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78d464-77c9-4570-8e13-0ffb76610579 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:41.826159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78d464-77c9-4570-8e13-0ffb76610579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:41.827830 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78d464-77c9-4570-8e13-0ffb76610579 None admin] RBAC: Adding query filter params (role.id=b59cdb5ce7164e609a36d41dfe3d0ef2, scope.project.id=4efc2482ceab4826af36f260dbc35af4, user.id=3d478c8a373f4e24bba00aede605565f) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:41.828388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78d464-77c9-4570-8e13-0ffb76610579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:41.831547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78d464-77c9-4570-8e13-0ffb76610579 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:41.852784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 159/321] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:12:41 2022] GET /identity/v3/role_assignments?user.id=3d478c8a373f4e24bba00aede605565f&scope.project.id=4efc2482ceab4826af36f260dbc35af4&role.id=b59cdb5ce7164e609a36d41dfe3d0ef2 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:41.875152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c639547-bb4f-45fb-9c3f-d2ce7638f423 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:41.939124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb170e1-a2cf-4bc9-a6e4-58e3b4ea5d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:41.940261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb170e1-a2cf-4bc9-a6e4-58e3b4ea5d1c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:41.940796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb170e1-a2cf-4bc9-a6e4-58e3b4ea5d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:41.941273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb170e1-a2cf-4bc9-a6e4-58e3b4ea5d1c None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:41.942861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb170e1-a2cf-4bc9-a6e4-58e3b4ea5d1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:41.943430 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb170e1-a2cf-4bc9-a6e4-58e3b4ea5d1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:41.946114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb170e1-a2cf-4bc9-a6e4-58e3b4ea5d1c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:41.972742 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 163/322] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:41.974654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0a9e5-1532-485e-91b1-b1e89656bf5d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:41.974947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0a9e5-1532-485e-91b1-b1e89656bf5d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:41.975227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0a9e5-1532-485e-91b1-b1e89656bf5d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:41.976853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 160/323] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:41.981234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb170e1-a2cf-4bc9-a6e4-58e3b4ea5d1c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:41.982970 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58c1ab-9d0d-431d-a924-70dbf0dd4ced None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:41.983259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58c1ab-9d0d-431d-a924-70dbf0dd4ced None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:41.983537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58c1ab-9d0d-431d-a924-70dbf0dd4ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:42.008741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7d58c1ab-9d0d-431d-a924-70dbf0dd4ced None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:42.010488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7d58c1ab-9d0d-431d-a924-70dbf0dd4ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:42.055619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:42.129626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 161/324] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:42.152707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58c1ab-9d0d-431d-a924-70dbf0dd4ced None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:42.173089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:42.209440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb170e1-a2cf-4bc9-a6e4-58e3b4ea5d1c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:42.248235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fb394-97fb-45a9-bb5e-0ab8ac949d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:42.249208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fb394-97fb-45a9-bb5e-0ab8ac949d73 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:42.249486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fb394-97fb-45a9-bb5e-0ab8ac949d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:42.249756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fb394-97fb-45a9-bb5e-0ab8ac949d73 None admin] PATH_INFO: `/v3/users/1da9889913b048369989c1122cdbca63` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:42.251127 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fb394-97fb-45a9-bb5e-0ab8ac949d73 None admin] RBAC: Authorizing `identity:get_user(user_id=1da9889913b048369989c1122cdbca63)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:42.252692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fb394-97fb-45a9-bb5e-0ab8ac949d73 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:42.254687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 164/325] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:41 2022] GET /identity/v3/users/1da9889913b048369989c1122cdbca63 => generated 293 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:42.260627 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fb394-97fb-45a9-bb5e-0ab8ac949d73 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:42.307481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58c1ab-9d0d-431d-a924-70dbf0dd4ced None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:42.358425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8b293-c2f9-4f3c-94cb-069095f54b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:42.359560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8b293-c2f9-4f3c-94cb-069095f54b0c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:42.359841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8b293-c2f9-4f3c-94cb-069095f54b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:42.360117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8b293-c2f9-4f3c-94cb-069095f54b0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:42.361493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8b293-c2f9-4f3c-94cb-069095f54b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:42.363063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8b293-c2f9-4f3c-94cb-069095f54b0c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:42.365182 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 162/326] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:12:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:42.371068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8b293-c2f9-4f3c-94cb-069095f54b0c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:42.395793 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:42.404012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fb394-97fb-45a9-bb5e-0ab8ac949d73 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:42.451741 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4f7c-dcd4-4d61-8cad-aebe40edfef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:42.452711 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4f7c-dcd4-4d61-8cad-aebe40edfef7 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:42.453275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4f7c-dcd4-4d61-8cad-aebe40edfef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:42.453577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4f7c-dcd4-4d61-8cad-aebe40edfef7 None admin] PATH_INFO: `/v3/system/users/1da9889913b048369989c1122cdbca63/roles/b59cdb5ce7164e609a36d41dfe3d0ef2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:42.455791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b4f7c-dcd4-4d61-8cad-aebe40edfef7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1da9889913b048369989c1122cdbca63, role_id=b59cdb5ce7164e609a36d41dfe3d0ef2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:42.457282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b4f7c-dcd4-4d61-8cad-aebe40edfef7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:42.471636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 165/327] 10.222.0.40 () {58 vars in 1334 bytes} [Thu Jul 21 08:12:42 2022] PUT /identity/v3/system/users/1da9889913b048369989c1122cdbca63/roles/b59cdb5ce7164e609a36d41dfe3d0ef2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:12:42.503019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:42.532116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8b293-c2f9-4f3c-94cb-069095f54b0c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:42.580561 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dc9da-eb56-4b7e-87b3-d5ef57adc36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:42.581276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dc9da-eb56-4b7e-87b3-d5ef57adc36f None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:42.581556 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dc9da-eb56-4b7e-87b3-d5ef57adc36f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:42.581831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dc9da-eb56-4b7e-87b3-d5ef57adc36f None admin] PATH_INFO: `/v3/groups` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:42.582573 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dc9da-eb56-4b7e-87b3-d5ef57adc36f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:42.584143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dc9da-eb56-4b7e-87b3-d5ef57adc36f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:42.603910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 163/328] 10.222.0.40 () {60 vars in 1134 bytes} [Thu Jul 21 08:12:42 2022] POST /identity/v3/groups => generated 226 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:12:42.678851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c724f-b1a9-4978-ae37-0e58665c2492 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:42.679275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c724f-b1a9-4978-ae37-0e58665c2492 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:42.679724 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c724f-b1a9-4978-ae37-0e58665c2492 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:42.682742 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 166/329] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:42.692422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238b95e-83d0-426a-bc6e-188af80ed799 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:42.692947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238b95e-83d0-426a-bc6e-188af80ed799 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:42.693419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238b95e-83d0-426a-bc6e-188af80ed799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:42.724551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9238b95e-83d0-426a-bc6e-188af80ed799 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:42.726822 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9238b95e-83d0-426a-bc6e-188af80ed799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:42.855161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 164/330] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:42.897296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c724f-b1a9-4978-ae37-0e58665c2492 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:43.099404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c724f-b1a9-4978-ae37-0e58665c2492 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:43.166895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1d02b-c0fe-40fe-8f09-90d2f7f02501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:43.168394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1d02b-c0fe-40fe-8f09-90d2f7f02501 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:43.169023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1d02b-c0fe-40fe-8f09-90d2f7f02501 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:43.169665 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1d02b-c0fe-40fe-8f09-90d2f7f02501 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:43.193423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1d02b-c0fe-40fe-8f09-90d2f7f02501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-9ad1d02b-c0fe-40fe-8f09-90d2f7f02501 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:43.208930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:43.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:43.212078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 167/331] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:43.222196 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238b95e-83d0-426a-bc6e-188af80ed799 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:43.374040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:43.440028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238b95e-83d0-426a-bc6e-188af80ed799 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:43.510146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958afc42-b4f7-4638-b642-273f8e82f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:43.510860 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958afc42-b4f7-4638-b642-273f8e82f9fa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:43.511150 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958afc42-b4f7-4638-b642-273f8e82f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:43.511429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958afc42-b4f7-4638-b642-273f8e82f9fa None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:43.512221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958afc42-b4f7-4638-b642-273f8e82f9fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:43.512557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958afc42-b4f7-4638-b642-273f8e82f9fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:43.514039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958afc42-b4f7-4638-b642-273f8e82f9fa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:43.527744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 165/332] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:43.537432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1d02b-c0fe-40fe-8f09-90d2f7f02501 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:43.600218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:43.811705 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1d02b-c0fe-40fe-8f09-90d2f7f02501 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:43.867904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c417c4a-93b7-43ed-8b4c-42cc1941b7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:43.869446 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c417c4a-93b7-43ed-8b4c-42cc1941b7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:43.869965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c417c4a-93b7-43ed-8b4c-42cc1941b7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:43.870432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c417c4a-93b7-43ed-8b4c-42cc1941b7f1 None admin] PATH_INFO: `/v3/users/31b5779d3df649ff987fbe592c583ab8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:43.872732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c417c4a-93b7-43ed-8b4c-42cc1941b7f1 None admin] RBAC: Authorizing `identity:get_user(user_id=31b5779d3df649ff987fbe592c583ab8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:43.874963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c417c4a-93b7-43ed-8b4c-42cc1941b7f1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:43.877988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 168/333] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:43 2022] GET /identity/v3/users/31b5779d3df649ff987fbe592c583ab8 => generated 293 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:43.889762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958afc42-b4f7-4638-b642-273f8e82f9fa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:44.153309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958afc42-b4f7-4638-b642-273f8e82f9fa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:44.246708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f00654-9e65-49ba-8ac6-390ed344a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:44.247900 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f00654-9e65-49ba-8ac6-390ed344a030 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:44.248413 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f00654-9e65-49ba-8ac6-390ed344a030 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:44.248954 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f00654-9e65-49ba-8ac6-390ed344a030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:44.250636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f00654-9e65-49ba-8ac6-390ed344a030 None admin] RBAC: Adding query filter params (role.id=2363304f42424934b09a0ff0bc62315d, user.id=31b5779d3df649ff987fbe592c583ab8, scope.system=all) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:44.251149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f00654-9e65-49ba-8ac6-390ed344a030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:44.262659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f00654-9e65-49ba-8ac6-390ed344a030 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:44.273207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:44.300538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 166/334] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jul 21 08:12:43 2022] GET /identity/v3/role_assignments?user.id=31b5779d3df649ff987fbe592c583ab8&scope.system=all&role.id=2363304f42424934b09a0ff0bc62315d => generated 510 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:45.734159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852339f9-ebac-4254-b360-56b3f02f3b7f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:45.734690 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852339f9-ebac-4254-b360-56b3f02f3b7f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:45.735009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852339f9-ebac-4254-b360-56b3f02f3b7f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:45.736287 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c55ce-9f25-4669-8751-affe11c96fda None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:45.736716 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c55ce-9f25-4669-8751-affe11c96fda None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:45.737114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c55ce-9f25-4669-8751-affe11c96fda None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:45.737230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 169/335] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:45.738762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 167/336] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:45.744143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40954a8-3694-4b7b-9f0f-654332acef7e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:45.744737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40954a8-3694-4b7b-9f0f-654332acef7e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:45.745260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40954a8-3694-4b7b-9f0f-654332acef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:45.750513 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c11d9f-6c97-4824-9096-448d6f9f3a2a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:45.751052 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c11d9f-6c97-4824-9096-448d6f9f3a2a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:45.751572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c11d9f-6c97-4824-9096-448d6f9f3a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:45.804806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b40954a8-3694-4b7b-9f0f-654332acef7e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:45.814468 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-77c11d9f-6c97-4824-9096-448d6f9f3a2a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:45.817321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-77c11d9f-6c97-4824-9096-448d6f9f3a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:45.821985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b40954a8-3694-4b7b-9f0f-654332acef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:46.010865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 168/337] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:46.013986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978eea2-f220-4646-a99c-85cc64490f7f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:46.014750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978eea2-f220-4646-a99c-85cc64490f7f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:46.015448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978eea2-f220-4646-a99c-85cc64490f7f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:46.018410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 169/338] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:46.031724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72e93e-bfe5-428f-81bf-fe3437f3622f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:46.032619 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72e93e-bfe5-428f-81bf-fe3437f3622f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:46.033315 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72e93e-bfe5-428f-81bf-fe3437f3622f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:46.034061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 170/339] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:46.052596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40954a8-3694-4b7b-9f0f-654332acef7e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:46.084059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bc72e93e-bfe5-428f-81bf-fe3437f3622f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:46.084866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:46.085780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bc72e93e-bfe5-428f-81bf-fe3437f3622f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:46.190840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40954a8-3694-4b7b-9f0f-654332acef7e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:46.231685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cdad2-bf59-481d-9be6-3e7d50546e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:46.232932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cdad2-bf59-481d-9be6-3e7d50546e44 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:46.233388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 170/340] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:46.234490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72e93e-bfe5-428f-81bf-fe3437f3622f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:46.234946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cdad2-bf59-481d-9be6-3e7d50546e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:46.235355 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cdad2-bf59-481d-9be6-3e7d50546e44 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:46.251713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cdad2-bf59-481d-9be6-3e7d50546e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-769cdad2-bf59-481d-9be6-3e7d50546e44 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:46.260117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:46.261318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:46.262315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:46.262315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:46.262315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:46.262315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:46.262315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:46.262315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:46.262315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:46.262315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:46.262315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:46.262315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:46.262315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:12:46.262315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:46.268994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 171/341] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:46.272748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cdad2-bf59-481d-9be6-3e7d50546e44 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:46.374022 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:46.391481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:46.401848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cdad2-bf59-481d-9be6-3e7d50546e44 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:46.444285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2eb71-ac8d-4db4-b73e-d14c0e800b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:46.445287 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2eb71-ac8d-4db4-b73e-d14c0e800b42 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:46.445709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2eb71-ac8d-4db4-b73e-d14c0e800b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:46.446153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2eb71-ac8d-4db4-b73e-d14c0e800b42 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:46.447071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2eb71-ac8d-4db4-b73e-d14c0e800b42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:46.447530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2eb71-ac8d-4db4-b73e-d14c0e800b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:46.449140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2eb71-ac8d-4db4-b73e-d14c0e800b42 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:46.463862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 172/342] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:46.465224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2eb71-ac8d-4db4-b73e-d14c0e800b42 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:46.494418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72e93e-bfe5-428f-81bf-fe3437f3622f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:46.565484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c9f24-4cf1-48f9-a9a0-826976c9c406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:46.566574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c9f24-4cf1-48f9-a9a0-826976c9c406 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:46.566997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c9f24-4cf1-48f9-a9a0-826976c9c406 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:46.567459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c9f24-4cf1-48f9-a9a0-826976c9c406 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:46.578824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2eb71-ac8d-4db4-b73e-d14c0e800b42 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:46.597701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c9f24-4cf1-48f9-a9a0-826976c9c406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9c1c9f24-4cf1-48f9-a9a0-826976c9c406 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:46.606501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:46.607647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:46.616768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:46.616768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:46.616768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:46.616768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:46.616768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:46.616768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:46.616768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:46.616768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:46.616768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:46.616768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:46.616768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:46.616768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:46.617420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b07101-fabc-4bd1-b583-75a8702e79d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:46.617539 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b07101-fabc-4bd1-b583-75a8702e79d2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:46.618080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b07101-fabc-4bd1-b583-75a8702e79d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:46.618529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b07101-fabc-4bd1-b583-75a8702e79d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:46.619233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 171/343] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:12:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:46.620288 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c9f24-4cf1-48f9-a9a0-826976c9c406 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:46.628537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:46.631795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b07101-fabc-4bd1-b583-75a8702e79d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d4b07101-fabc-4bd1-b583-75a8702e79d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:46.640599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:46.641578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:46.642378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:46.642378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:46.642378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:46.642378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:46.642378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:46.642378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:46.642378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:46.642378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:46.642378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:46.642378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:46.642378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:46.642378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:46.644858 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 173/344] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:46.646550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b07101-fabc-4bd1-b583-75a8702e79d2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:46.761723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b07101-fabc-4bd1-b583-75a8702e79d2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:46.805423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead46362-2034-49be-bab0-8c0db3a4c7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:46.806385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead46362-2034-49be-bab0-8c0db3a4c7cb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:46.806805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead46362-2034-49be-bab0-8c0db3a4c7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:46.807223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead46362-2034-49be-bab0-8c0db3a4c7cb None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:46.808130 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead46362-2034-49be-bab0-8c0db3a4c7cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:46.808736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead46362-2034-49be-bab0-8c0db3a4c7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:46.810299 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead46362-2034-49be-bab0-8c0db3a4c7cb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:46.828717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 174/345] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:12:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:46.829961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead46362-2034-49be-bab0-8c0db3a4c7cb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:46.896598 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c9f24-4cf1-48f9-a9a0-826976c9c406 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:46.906437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:46.951762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead46362-2034-49be-bab0-8c0db3a4c7cb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:46.955778 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:46.993827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34ff72-1435-4023-a6f5-1bf2c03e38e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:46.994776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34ff72-1435-4023-a6f5-1bf2c03e38e9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:46.995222 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34ff72-1435-4023-a6f5-1bf2c03e38e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:46.996117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34ff72-1435-4023-a6f5-1bf2c03e38e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:46.997086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34ff72-1435-4023-a6f5-1bf2c03e38e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:46.997537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34ff72-1435-4023-a6f5-1bf2c03e38e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:46.999114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34ff72-1435-4023-a6f5-1bf2c03e38e9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:47.010608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 175/346] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:47.011837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34ff72-1435-4023-a6f5-1bf2c03e38e9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:47.043922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be514-2eae-41f0-a41c-86ac3411b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:47.045650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be514-2eae-41f0-a41c-86ac3411b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:47.046203 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be514-2eae-41f0-a41c-86ac3411b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:47.046835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be514-2eae-41f0-a41c-86ac3411b8a7 None admin] PATH_INFO: `/v3/users/1da9889913b048369989c1122cdbca63` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:47.049586 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313be514-2eae-41f0-a41c-86ac3411b8a7 None admin] RBAC: Authorizing `identity:get_user(user_id=1da9889913b048369989c1122cdbca63)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:47.058007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313be514-2eae-41f0-a41c-86ac3411b8a7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:47.060919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 172/347] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:12:46 2022] GET /identity/v3/users/1da9889913b048369989c1122cdbca63 => generated 293 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:47.062472 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be514-2eae-41f0-a41c-86ac3411b8a7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:47.147131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34ff72-1435-4023-a6f5-1bf2c03e38e9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:47.213806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16854186-6086-496f-9038-951b7acae980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:47.215155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16854186-6086-496f-9038-951b7acae980 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:47.215599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16854186-6086-496f-9038-951b7acae980 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:47.216136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16854186-6086-496f-9038-951b7acae980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:47.232948 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:47.280400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be514-2eae-41f0-a41c-86ac3411b8a7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:47.317520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16854186-6086-496f-9038-951b7acae980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:47.320913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16854186-6086-496f-9038-951b7acae980 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:47.369422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efb496-6c66-4b9a-b3da-f50f4147f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:47.371349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efb496-6c66-4b9a-b3da-f50f4147f068 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:47.372051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efb496-6c66-4b9a-b3da-f50f4147f068 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:47.373029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efb496-6c66-4b9a-b3da-f50f4147f068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:47.550606 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 176/348] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:47.552007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:47.553964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16854186-6086-496f-9038-951b7acae980 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:47.612924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:47.642547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efb496-6c66-4b9a-b3da-f50f4147f068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:47.645908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efb496-6c66-4b9a-b3da-f50f4147f068 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:47.761240 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16854186-6086-496f-9038-951b7acae980 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:47.836291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6207-0eb7-4a9b-a1af-cddec7736669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:47.838713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6207-0eb7-4a9b-a1af-cddec7736669 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:47.839392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6207-0eb7-4a9b-a1af-cddec7736669 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:47.840045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6207-0eb7-4a9b-a1af-cddec7736669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:47.842048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f6207-0eb7-4a9b-a1af-cddec7736669 None admin] RBAC: Adding query filter params (role.id=b59cdb5ce7164e609a36d41dfe3d0ef2, user.id=1da9889913b048369989c1122cdbca63, scope.system=all) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:47.842888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f6207-0eb7-4a9b-a1af-cddec7736669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:47.844700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f6207-0eb7-4a9b-a1af-cddec7736669 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:47.870663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 177/349] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jul 21 08:12:47 2022] GET /identity/v3/role_assignments?user.id=1da9889913b048369989c1122cdbca63&scope.system=all&role.id=b59cdb5ce7164e609a36d41dfe3d0ef2 => generated 510 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:47.876593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6207-0eb7-4a9b-a1af-cddec7736669 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:47.916642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 173/350] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 855 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:47.923484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efb496-6c66-4b9a-b3da-f50f4147f068 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:48.117028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:48.156923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6207-0eb7-4a9b-a1af-cddec7736669 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:48.164553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:48.216014 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efb496-6c66-4b9a-b3da-f50f4147f068 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:48.231921 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d854be2-8b45-4c93-9ca5-b26dee8ee50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:48.233792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d854be2-8b45-4c93-9ca5-b26dee8ee50b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:48.234466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d854be2-8b45-4c93-9ca5-b26dee8ee50b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:48.235115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d854be2-8b45-4c93-9ca5-b26dee8ee50b None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:48.237526 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d854be2-8b45-4c93-9ca5-b26dee8ee50b None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:48.240631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d854be2-8b45-4c93-9ca5-b26dee8ee50b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:48.244701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 178/351] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:47 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:48.247754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf743afd-94db-4f8c-b63a-c9b7a8b0e519 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:48.248700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf743afd-94db-4f8c-b63a-c9b7a8b0e519 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:48.249393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf743afd-94db-4f8c-b63a-c9b7a8b0e519 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:48.253710 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 179/352] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:48.255672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf743afd-94db-4f8c-b63a-c9b7a8b0e519 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:48.333851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558afbc-a357-41eb-ab33-93d5d0d5f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:48.335393 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558afbc-a357-41eb-ab33-93d5d0d5f581 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:48.335907 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558afbc-a357-41eb-ab33-93d5d0d5f581 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:48.336394 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558afbc-a357-41eb-ab33-93d5d0d5f581 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:48.342047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558afbc-a357-41eb-ab33-93d5d0d5f581 None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:48.345033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558afbc-a357-41eb-ab33-93d5d0d5f581 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:48.349030 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 174/353] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:47 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:48.351316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63399-31bf-4fee-b4de-74f7a1f1607c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:48.351800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63399-31bf-4fee-b4de-74f7a1f1607c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:48.352279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63399-31bf-4fee-b4de-74f7a1f1607c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:48.396256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-49a63399-31bf-4fee-b4de-74f7a1f1607c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:48.397965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-49a63399-31bf-4fee-b4de-74f7a1f1607c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:48.474038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf743afd-94db-4f8c-b63a-c9b7a8b0e519 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:48.500747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 175/354] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:48.501912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63399-31bf-4fee-b4de-74f7a1f1607c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:48.534840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da4cfa-93e4-4001-a709-cf3304535e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:48.536171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da4cfa-93e4-4001-a709-cf3304535e3b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:48.536703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da4cfa-93e4-4001-a709-cf3304535e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:48.537291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da4cfa-93e4-4001-a709-cf3304535e3b None admin] PATH_INFO: `/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:48.546776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da4cfa-93e4-4001-a709-cf3304535e3b None admin] RBAC: Authorizing `identity:get_group(group_id=a2daabeac6824d9badc5e6dfa571f6b1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:48.547929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da4cfa-93e4-4001-a709-cf3304535e3b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:48.549897 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 180/355] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:12:48 2022] GET /identity/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1 => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:48.551258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79c34-7c18-421b-bae8-78b7301701a3 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:48.551540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79c34-7c18-421b-bae8-78b7301701a3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:48.551842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79c34-7c18-421b-bae8-78b7301701a3 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:48.553285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 181/356] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:48.560544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba666cb-b18b-4371-a031-2f527cc7778f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:48.561084 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba666cb-b18b-4371-a031-2f527cc7778f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:48.561573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba666cb-b18b-4371-a031-2f527cc7778f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:48.564289 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 182/357] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:48.566636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba666cb-b18b-4371-a031-2f527cc7778f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:48.598321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:48.618161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:48.656119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63399-31bf-4fee-b4de-74f7a1f1607c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:48.710876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ada844-250a-4c2b-8100-1a39f3a205da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:48.711797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ada844-250a-4c2b-8100-1a39f3a205da None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:48.712077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ada844-250a-4c2b-8100-1a39f3a205da None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:48.712350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ada844-250a-4c2b-8100-1a39f3a205da None admin] PATH_INFO: `/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:48.713715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ada844-250a-4c2b-8100-1a39f3a205da None admin] RBAC: Authorizing `identity:get_group(group_id=a2daabeac6824d9badc5e6dfa571f6b1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:48.715258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ada844-250a-4c2b-8100-1a39f3a205da None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:48.717087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 176/358] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:12:48 2022] GET /identity/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:48.718421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da30e-a3d4-4ee3-b8d5-246566216f87 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:48.718737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da30e-a3d4-4ee3-b8d5-246566216f87 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:48.718979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da30e-a3d4-4ee3-b8d5-246566216f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:48.738062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ea2da30e-a3d4-4ee3-b8d5-246566216f87 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:48.739372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ea2da30e-a3d4-4ee3-b8d5-246566216f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:48.774649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba666cb-b18b-4371-a031-2f527cc7778f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:48.835607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5491c-c6db-4ea6-a231-b365a9964e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:48.836994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5491c-c6db-4ea6-a231-b365a9964e4b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:48.838207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5491c-c6db-4ea6-a231-b365a9964e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:48.838859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5491c-c6db-4ea6-a231-b365a9964e4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:48.858137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5491c-c6db-4ea6-a231-b365a9964e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-83d5491c-c6db-4ea6-a231-b365a9964e4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:48.866599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:48.867694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:48.868668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 183/359] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:48.869346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5491c-c6db-4ea6-a231-b365a9964e4b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:48.869415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 177/360] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:48.872283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8c450-355a-4e45-80fd-99c9718485f8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:48.872459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8c450-355a-4e45-80fd-99c9718485f8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:48.873084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8c450-355a-4e45-80fd-99c9718485f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:48.905061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1ab8c450-355a-4e45-80fd-99c9718485f8 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:48.906561 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1ab8c450-355a-4e45-80fd-99c9718485f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:48.988296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:49.031778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5491c-c6db-4ea6-a231-b365a9964e4b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:49.039451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 178/361] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:49.041133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8c450-355a-4e45-80fd-99c9718485f8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:49.053060 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:49.098476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67956e-0323-4492-9d47-a0cf21d1ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:49.099274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67956e-0323-4492-9d47-a0cf21d1ba59 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:49.099557 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67956e-0323-4492-9d47-a0cf21d1ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:49.099828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67956e-0323-4492-9d47-a0cf21d1ba59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:49.100728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67956e-0323-4492-9d47-a0cf21d1ba59 None admin] RBAC: Adding query filter params (group.id=a2daabeac6824d9badc5e6dfa571f6b1, role.id=cbcda598469c41f19a1d3109e5d4c236, scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:49.101064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67956e-0323-4492-9d47-a0cf21d1ba59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:49.103272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67956e-0323-4492-9d47-a0cf21d1ba59 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:49.116543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 184/362] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 21 08:12:48 2022] GET /identity/v3/role_assignments?group.id=a2daabeac6824d9badc5e6dfa571f6b1&scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4&role.id=cbcda598469c41f19a1d3109e5d4c236 => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:49.116543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67956e-0323-4492-9d47-a0cf21d1ba59 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:49.226107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8c450-355a-4e45-80fd-99c9718485f8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:49.281583 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cad2b-e0fd-4133-a462-e3f023028784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:49.282281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cad2b-e0fd-4133-a462-e3f023028784 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:49.282560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cad2b-e0fd-4133-a462-e3f023028784 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:49.282842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cad2b-e0fd-4133-a462-e3f023028784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:49.283759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cad2b-e0fd-4133-a462-e3f023028784 None admin] RBAC: Adding query filter params (group.id=a2daabeac6824d9badc5e6dfa571f6b1, role.id=2363304f42424934b09a0ff0bc62315d, scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:49.284069 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cad2b-e0fd-4133-a462-e3f023028784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:49.285708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cad2b-e0fd-4133-a462-e3f023028784 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:49.293543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 179/363] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 21 08:12:49 2022] GET /identity/v3/role_assignments?group.id=a2daabeac6824d9badc5e6dfa571f6b1&scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4&role.id=2363304f42424934b09a0ff0bc62315d => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:49.294509 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cad2b-e0fd-4133-a462-e3f023028784 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:49.335322 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67956e-0323-4492-9d47-a0cf21d1ba59 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:49.428251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:49.434121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335eb20-1b64-4f22-aaee-626ba3a6da7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:49.435139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335eb20-1b64-4f22-aaee-626ba3a6da7c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:49.435595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335eb20-1b64-4f22-aaee-626ba3a6da7c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:49.436904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335eb20-1b64-4f22-aaee-626ba3a6da7c None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:49.438010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335eb20-1b64-4f22-aaee-626ba3a6da7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:49.438516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335eb20-1b64-4f22-aaee-626ba3a6da7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:49.440266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335eb20-1b64-4f22-aaee-626ba3a6da7c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:49.449270 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:49.454703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 185/364] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:49.455439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335eb20-1b64-4f22-aaee-626ba3a6da7c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:49.476404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cad2b-e0fd-4133-a462-e3f023028784 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:49.536023 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabe5a5-641d-44ce-9e61-dca6fa0362a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:49.537274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabe5a5-641d-44ce-9e61-dca6fa0362a4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:49.537570 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabe5a5-641d-44ce-9e61-dca6fa0362a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:49.537863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabe5a5-641d-44ce-9e61-dca6fa0362a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:49.553804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabe5a5-641d-44ce-9e61-dca6fa0362a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9cabe5a5-641d-44ce-9e61-dca6fa0362a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:49.563618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:49.565400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 180/365] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:12:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:49.566958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabe5a5-641d-44ce-9e61-dca6fa0362a4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:49.675582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335eb20-1b64-4f22-aaee-626ba3a6da7c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:49.721365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabe5a5-641d-44ce-9e61-dca6fa0362a4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:49.773382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:49.779095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312fa4-10c1-4083-879c-3d0d8d385873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:49.779995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312fa4-10c1-4083-879c-3d0d8d385873 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:49.780273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312fa4-10c1-4083-879c-3d0d8d385873 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:49.780604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312fa4-10c1-4083-879c-3d0d8d385873 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:49.783908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25632a-8339-4114-8987-77d94691efe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:49.784580 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25632a-8339-4114-8987-77d94691efe6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:49.784821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25632a-8339-4114-8987-77d94691efe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:49.785778 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25632a-8339-4114-8987-77d94691efe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:49.811305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69312fa4-10c1-4083-879c-3d0d8d385873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-69312fa4-10c1-4083-879c-3d0d8d385873 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:49.820984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:49.821997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:49.822794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 186/366] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:12:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:49.823435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312fa4-10c1-4083-879c-3d0d8d385873 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:49.930203 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25632a-8339-4114-8987-77d94691efe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:49.934451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25632a-8339-4114-8987-77d94691efe6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:49.971667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:50.077730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312fa4-10c1-4083-879c-3d0d8d385873 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:50.151393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd6c1f-2cf3-46f5-8505-a12e0c70169e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:50.152967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd6c1f-2cf3-46f5-8505-a12e0c70169e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:50.154507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd6c1f-2cf3-46f5-8505-a12e0c70169e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:50.155244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd6c1f-2cf3-46f5-8505-a12e0c70169e None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:50.157056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd6c1f-2cf3-46f5-8505-a12e0c70169e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:50.157527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd6c1f-2cf3-46f5-8505-a12e0c70169e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:50.161178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd6c1f-2cf3-46f5-8505-a12e0c70169e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:50.175564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 187/367] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:50.177196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd6c1f-2cf3-46f5-8505-a12e0c70169e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:50.198112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 181/368] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:50.199330 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25632a-8339-4114-8987-77d94691efe6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:50.264457 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:50.366081 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25632a-8339-4114-8987-77d94691efe6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:50.369979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd6c1f-2cf3-46f5-8505-a12e0c70169e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:50.404084 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:50.426025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24917d4d-889a-428e-a5f4-dff2f196f9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:50.428984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24917d4d-889a-428e-a5f4-dff2f196f9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:50.429554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24917d4d-889a-428e-a5f4-dff2f196f9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:50.430024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24917d4d-889a-428e-a5f4-dff2f196f9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:50.431488 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24917d4d-889a-428e-a5f4-dff2f196f9d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:50.432355 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24917d4d-889a-428e-a5f4-dff2f196f9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:50.434052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24917d4d-889a-428e-a5f4-dff2f196f9d3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:50.445935 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 188/369] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:12:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:50.447155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24917d4d-889a-428e-a5f4-dff2f196f9d3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:50.447494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f361c28-1d19-429e-abab-5e4f669b7414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:50.448845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f361c28-1d19-429e-abab-5e4f669b7414 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:50.449435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f361c28-1d19-429e-abab-5e4f669b7414 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:50.450021 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f361c28-1d19-429e-abab-5e4f669b7414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:50.583775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24917d4d-889a-428e-a5f4-dff2f196f9d3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:50.592545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f361c28-1d19-429e-abab-5e4f669b7414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:50.595597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f361c28-1d19-429e-abab-5e4f669b7414 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:50.637478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cc828-bad4-4ad7-ba81-a6c59e4c8089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:50.638318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cc828-bad4-4ad7-ba81-a6c59e4c8089 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:50.638716 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cc828-bad4-4ad7-ba81-a6c59e4c8089 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:50.638867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cc828-bad4-4ad7-ba81-a6c59e4c8089 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:50.644704 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cc828-bad4-4ad7-ba81-a6c59e4c8089 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:50.644704 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cc828-bad4-4ad7-ba81-a6c59e4c8089 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:50.644704 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 189/370] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:50 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:50.646742 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cc828-bad4-4ad7-ba81-a6c59e4c8089 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:50.659164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:50.747762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:50.822529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 182/371] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:50.824894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f361c28-1d19-429e-abab-5e4f669b7414 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:50.865697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cc828-bad4-4ad7-ba81-a6c59e4c8089 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:50.932224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f969204-779f-4243-ac57-9251d6b23319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:50.933308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f969204-779f-4243-ac57-9251d6b23319 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:50.933786 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f969204-779f-4243-ac57-9251d6b23319 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:50.934256 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f969204-779f-4243-ac57-9251d6b23319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:51.025438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f361c28-1d19-429e-abab-5e4f669b7414 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:51.031336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f969204-779f-4243-ac57-9251d6b23319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:51.033752 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f969204-779f-4243-ac57-9251d6b23319 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:51.085530 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:51.097228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e14cc5-15e3-4522-b9ff-bcdaaad372e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:51.098438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e14cc5-15e3-4522-b9ff-bcdaaad372e0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:51.098962 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e14cc5-15e3-4522-b9ff-bcdaaad372e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:51.099451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e14cc5-15e3-4522-b9ff-bcdaaad372e0 None admin] PATH_INFO: `/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:51.100238 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:51.103479 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e14cc5-15e3-4522-b9ff-bcdaaad372e0 None admin] RBAC: Authorizing `identity:get_group(group_id=a2daabeac6824d9badc5e6dfa571f6b1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:51.106637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e14cc5-15e3-4522-b9ff-bcdaaad372e0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:51.111497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 183/372] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:12:50 2022] GET /identity/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:51.113328 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e14cc5-15e3-4522-b9ff-bcdaaad372e0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:51.169273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 190/373] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:51.170463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f969204-779f-4243-ac57-9251d6b23319 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:51.289437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f969204-779f-4243-ac57-9251d6b23319 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:51.340364 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b4d1e-415c-4a9e-8568-7a6ed705c12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:51.341311 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b4d1e-415c-4a9e-8568-7a6ed705c12a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:51.341690 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b4d1e-415c-4a9e-8568-7a6ed705c12a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:51.342121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b4d1e-415c-4a9e-8568-7a6ed705c12a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:51.343100 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b4d1e-415c-4a9e-8568-7a6ed705c12a None admin] RBAC: Adding query filter params (group.id=a2daabeac6824d9badc5e6dfa571f6b1, role.id=2363304f42424934b09a0ff0bc62315d, scope.project.id=4efc2482ceab4826af36f260dbc35af4) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:51.343511 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b4d1e-415c-4a9e-8568-7a6ed705c12a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:51.344846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e14cc5-15e3-4522-b9ff-bcdaaad372e0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:51.345514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b4d1e-415c-4a9e-8568-7a6ed705c12a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:51.354044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 191/374] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 21 08:12:51 2022] GET /identity/v3/role_assignments?group.id=a2daabeac6824d9badc5e6dfa571f6b1&scope.project.id=4efc2482ceab4826af36f260dbc35af4&role.id=2363304f42424934b09a0ff0bc62315d => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:51.354820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b4d1e-415c-4a9e-8568-7a6ed705c12a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:51.383177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:51.443801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711be229-61fa-469c-af14-7698dd866810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:51.445743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711be229-61fa-469c-af14-7698dd866810 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:51.446631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711be229-61fa-469c-af14-7698dd866810 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:51.447361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711be229-61fa-469c-af14-7698dd866810 None admin] PATH_INFO: `/v3/projects/3a9abea4928641f4840c146c33d7e1f5` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:51.451448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711be229-61fa-469c-af14-7698dd866810 None admin] RBAC: Authorizing `identity:get_project(project_id=3a9abea4928641f4840c146c33d7e1f5)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:51.454736 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711be229-61fa-469c-af14-7698dd866810 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:51.458684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 184/375] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:51 2022] GET /identity/v3/projects/3a9abea4928641f4840c146c33d7e1f5 => generated 344 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:51.465535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711be229-61fa-469c-af14-7698dd866810 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:51.636063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b4d1e-415c-4a9e-8568-7a6ed705c12a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:51.690245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:51.724242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb467653-7554-4f0d-9416-8cc0c72f3bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:51.725183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb467653-7554-4f0d-9416-8cc0c72f3bde None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:51.725469 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb467653-7554-4f0d-9416-8cc0c72f3bde None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:51.725720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb467653-7554-4f0d-9416-8cc0c72f3bde None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:51.727083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb467653-7554-4f0d-9416-8cc0c72f3bde None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:51.737556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb467653-7554-4f0d-9416-8cc0c72f3bde None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:51.739569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 192/376] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:51 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:51.748598 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb467653-7554-4f0d-9416-8cc0c72f3bde None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:51.773187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711be229-61fa-469c-af14-7698dd866810 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:51.860780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec9cf2-0dc8-41eb-826f-956ec8a82703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:51.862853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec9cf2-0dc8-41eb-826f-956ec8a82703 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:51.864920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec9cf2-0dc8-41eb-826f-956ec8a82703 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:51.865814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec9cf2-0dc8-41eb-826f-956ec8a82703 None admin] PATH_INFO: `/v3/groups/c1ed64767be848c5a794a2881ff2fa9a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:51.880737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec9cf2-0dc8-41eb-826f-956ec8a82703 None admin] RBAC: Authorizing `identity:get_group(group_id=c1ed64767be848c5a794a2881ff2fa9a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:51.884581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec9cf2-0dc8-41eb-826f-956ec8a82703 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:51.890265 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 185/377] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:12:51 2022] GET /identity/v3/groups/c1ed64767be848c5a794a2881ff2fa9a => generated 229 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:51.898594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec9cf2-0dc8-41eb-826f-956ec8a82703 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:51.955260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:51.990596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb467653-7554-4f0d-9416-8cc0c72f3bde None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:52.065624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35526881-1516-44eb-ae90-de38e63a160c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:52.066612 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526881-1516-44eb-ae90-de38e63a160c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:52.066784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526881-1516-44eb-ae90-de38e63a160c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:52.067157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526881-1516-44eb-ae90-de38e63a160c None admin] PATH_INFO: `/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:52.068472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35526881-1516-44eb-ae90-de38e63a160c None admin] RBAC: Authorizing `identity:get_group(group_id=a2daabeac6824d9badc5e6dfa571f6b1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:52.070177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35526881-1516-44eb-ae90-de38e63a160c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:52.072386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 193/378] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:12:51 2022] GET /identity/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1 => generated 226 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:52.073895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739007b-099c-4191-beda-745332ab559a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:52.074195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739007b-099c-4191-beda-745332ab559a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:52.074461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739007b-099c-4191-beda-745332ab559a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:52.076193 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 194/379] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:52.081571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739007b-099c-4191-beda-745332ab559a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:52.150233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec9cf2-0dc8-41eb-826f-956ec8a82703 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:52.219390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:52.234055 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22065552-6a84-44f0-bb4c-6065695b93c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:52.234746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065552-6a84-44f0-bb4c-6065695b93c7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:52.235026 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065552-6a84-44f0-bb4c-6065695b93c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:52.235298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065552-6a84-44f0-bb4c-6065695b93c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:52.236180 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22065552-6a84-44f0-bb4c-6065695b93c7 None admin] RBAC: Adding query filter params (group.id=c1ed64767be848c5a794a2881ff2fa9a, role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=3a9abea4928641f4840c146c33d7e1f5) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:52.236557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22065552-6a84-44f0-bb4c-6065695b93c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:52.238054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22065552-6a84-44f0-bb4c-6065695b93c7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:52.245664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 186/380] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 21 08:12:51 2022] GET /identity/v3/role_assignments?group.id=c1ed64767be848c5a794a2881ff2fa9a&scope.project.id=3a9abea4928641f4840c146c33d7e1f5&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 260 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:52.247082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b47134-e1df-4b17-95a0-75a1a743ee3a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:52.247377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b47134-e1df-4b17-95a0-75a1a743ee3a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:52.247659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b47134-e1df-4b17-95a0-75a1a743ee3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:52.288403 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-15b47134-e1df-4b17-95a0-75a1a743ee3a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:52.289141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-15b47134-e1df-4b17-95a0-75a1a743ee3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:52.295697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739007b-099c-4191-beda-745332ab559a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:52.364706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3233d6-4ae5-4d85-b413-414f24fdad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:52.366068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3233d6-4ae5-4d85-b413-414f24fdad9e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:52.366927 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3233d6-4ae5-4d85-b413-414f24fdad9e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:52.367456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3233d6-4ae5-4d85-b413-414f24fdad9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:52.368666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3233d6-4ae5-4d85-b413-414f24fdad9e None admin] RBAC: Adding query filter params (group.id=a2daabeac6824d9badc5e6dfa571f6b1, role.id=cbcda598469c41f19a1d3109e5d4c236, scope.project.id=4efc2482ceab4826af36f260dbc35af4) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:52.369249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3233d6-4ae5-4d85-b413-414f24fdad9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:52.371084 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3233d6-4ae5-4d85-b413-414f24fdad9e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:52.384734 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 195/381] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 21 08:12:52 2022] GET /identity/v3/role_assignments?group.id=a2daabeac6824d9badc5e6dfa571f6b1&scope.project.id=4efc2482ceab4826af36f260dbc35af4&role.id=cbcda598469c41f19a1d3109e5d4c236 => generated 260 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:52.440178 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 187/382] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:52.471313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3233d6-4ae5-4d85-b413-414f24fdad9e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:52.495938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:52.608008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3233d6-4ae5-4d85-b413-414f24fdad9e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:52.656157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45006e2-f7cd-4377-9dbb-5acf44bb1165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:52.657445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45006e2-f7cd-4377-9dbb-5acf44bb1165 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:52.657750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45006e2-f7cd-4377-9dbb-5acf44bb1165 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:52.658028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45006e2-f7cd-4377-9dbb-5acf44bb1165 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:52.659234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bfb0e-bc09-472d-9efa-69b20c6c52f9 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:52.659531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bfb0e-bc09-472d-9efa-69b20c6c52f9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:52.659815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bfb0e-bc09-472d-9efa-69b20c6c52f9 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:52.662742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 188/383] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:52.669307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93c761-3f54-47cc-af43-90fc266d1daf None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:52.669986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93c761-3f54-47cc-af43-90fc266d1daf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:52.670486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93c761-3f54-47cc-af43-90fc266d1daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:52.674841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45006e2-f7cd-4377-9dbb-5acf44bb1165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c45006e2-f7cd-4377-9dbb-5acf44bb1165 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:52.686850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:52.687830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:52.689804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 196/384] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:12:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:52.693258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45006e2-f7cd-4377-9dbb-5acf44bb1165 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:52.712198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3c93c761-3f54-47cc-af43-90fc266d1daf None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:52.714038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3c93c761-3f54-47cc-af43-90fc266d1daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:52.800379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:52.804838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 189/385] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:12:52.840364 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45006e2-f7cd-4377-9dbb-5acf44bb1165 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:52.865091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93c761-3f54-47cc-af43-90fc266d1daf None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:52.900119 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c7edf-5a38-4da8-a914-e78fa528176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:52.900956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c7edf-5a38-4da8-a914-e78fa528176b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:52.901249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c7edf-5a38-4da8-a914-e78fa528176b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:52.901524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c7edf-5a38-4da8-a914-e78fa528176b None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:52.902293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c7edf-5a38-4da8-a914-e78fa528176b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:52.902606 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c7edf-5a38-4da8-a914-e78fa528176b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:52.904059 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c7edf-5a38-4da8-a914-e78fa528176b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:52.913944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 197/386] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:12:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:52.921623 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c7edf-5a38-4da8-a914-e78fa528176b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:52.937974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:53.025123 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93c761-3f54-47cc-af43-90fc266d1daf None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:53.084628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c7edf-5a38-4da8-a914-e78fa528176b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:53.112485 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b092f0-21ac-45ab-8448-4e1438f21766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:53.113464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b092f0-21ac-45ab-8448-4e1438f21766 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:53.113749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b092f0-21ac-45ab-8448-4e1438f21766 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:53.114023 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b092f0-21ac-45ab-8448-4e1438f21766 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:53.129156 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff2df7-c814-41e4-9b8c-d333eb1215f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:53.130123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff2df7-c814-41e4-9b8c-d333eb1215f0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:53.130402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff2df7-c814-41e4-9b8c-d333eb1215f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:53.130713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff2df7-c814-41e4-9b8c-d333eb1215f0 None admin] PATH_INFO: `/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:53.133491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff2df7-c814-41e4-9b8c-d333eb1215f0 None admin] RBAC: Authorizing `identity:get_group(group_id=a2daabeac6824d9badc5e6dfa571f6b1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:53.135007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff2df7-c814-41e4-9b8c-d333eb1215f0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:53.136839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 198/387] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:12:52 2022] GET /identity/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:53.146453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff2df7-c814-41e4-9b8c-d333eb1215f0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:53.148145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b092f0-21ac-45ab-8448-4e1438f21766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-05b092f0-21ac-45ab-8448-4e1438f21766 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:53.159752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:53.160740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:53.162075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 190/388] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:12:53.164900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:53.172785 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b092f0-21ac-45ab-8448-4e1438f21766 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:53.362280 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff2df7-c814-41e4-9b8c-d333eb1215f0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:53.413507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fb2d4-9307-46b1-bf65-99aa5dc1bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:53.415032 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fb2d4-9307-46b1-bf65-99aa5dc1bb50 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:53.415571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fb2d4-9307-46b1-bf65-99aa5dc1bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:53.416038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fb2d4-9307-46b1-bf65-99aa5dc1bb50 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:53.418243 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fb2d4-9307-46b1-bf65-99aa5dc1bb50 None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:53.419979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fb2d4-9307-46b1-bf65-99aa5dc1bb50 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:53.422715 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 199/389] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:53 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:53.431159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fb2d4-9307-46b1-bf65-99aa5dc1bb50 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:53.446046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b092f0-21ac-45ab-8448-4e1438f21766 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:53.482952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:53.534529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44d219-ab7a-44f1-8e8a-836cda1e1abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:53.535658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44d219-ab7a-44f1-8e8a-836cda1e1abc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:53.536515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44d219-ab7a-44f1-8e8a-836cda1e1abc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:53.537582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44d219-ab7a-44f1-8e8a-836cda1e1abc None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:53.538593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44d219-ab7a-44f1-8e8a-836cda1e1abc None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:53.540252 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44d219-ab7a-44f1-8e8a-836cda1e1abc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:53.543560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44d219-ab7a-44f1-8e8a-836cda1e1abc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:53.558494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 191/390] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:53.566333 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44d219-ab7a-44f1-8e8a-836cda1e1abc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:53.611972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:53.652058 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fb2d4-9307-46b1-bf65-99aa5dc1bb50 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:53.691288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18a43a-e31f-41c8-998f-7f613f539e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:53.692267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18a43a-e31f-41c8-998f-7f613f539e39 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:53.692643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18a43a-e31f-41c8-998f-7f613f539e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:53.692973 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18a43a-e31f-41c8-998f-7f613f539e39 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4/groups/a2daabeac6824d9badc5e6dfa571f6b1/roles/cbcda598469c41f19a1d3109e5d4c236` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:53.695530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18a43a-e31f-41c8-998f-7f613f539e39 None admin] RBAC: Authorizing `identity:create_grant(project_id=e72c20e824a34e33a3d2cec6cea56ca4, group_id=a2daabeac6824d9badc5e6dfa571f6b1, role_id=cbcda598469c41f19a1d3109e5d4c236)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:53.697097 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18a43a-e31f-41c8-998f-7f613f539e39 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:53.715350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 200/391] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 21 08:12:53 2022] PUT /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4/groups/a2daabeac6824d9badc5e6dfa571f6b1/roles/cbcda598469c41f19a1d3109e5d4c236 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:12:53.761409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44d219-ab7a-44f1-8e8a-836cda1e1abc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:53.815942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8ad29-8f63-43cb-9593-d183d6b82617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:53.816852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8ad29-8f63-43cb-9593-d183d6b82617 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:53.817140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8ad29-8f63-43cb-9593-d183d6b82617 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:53.817549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8ad29-8f63-43cb-9593-d183d6b82617 None admin] PATH_INFO: `/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:53.819008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8ad29-8f63-43cb-9593-d183d6b82617 None admin] RBAC: Authorizing `identity:get_group(group_id=a2daabeac6824d9badc5e6dfa571f6b1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:53.820699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8ad29-8f63-43cb-9593-d183d6b82617 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:53.823043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 192/392] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:12:53 2022] GET /identity/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:53.828470 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18a43a-e31f-41c8-998f-7f613f539e39 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:54.049089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18a43a-e31f-41c8-998f-7f613f539e39 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:54.145878 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcf86b-c07b-4d40-a79f-82d71b81fc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:54.147335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcf86b-c07b-4d40-a79f-82d71b81fc53 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:54.147830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcf86b-c07b-4d40-a79f-82d71b81fc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:54.148324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcf86b-c07b-4d40-a79f-82d71b81fc53 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:54.152954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcf86b-c07b-4d40-a79f-82d71b81fc53 None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:54.155820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcf86b-c07b-4d40-a79f-82d71b81fc53 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:54.159836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 201/393] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:53 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:54.170674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8ad29-8f63-43cb-9593-d183d6b82617 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:54.256689 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:54.345393 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8ad29-8f63-43cb-9593-d183d6b82617 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:54.417467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5884b72-7e25-47d9-b4d1-e1a0ffd183b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:54.418317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5884b72-7e25-47d9-b4d1-e1a0ffd183b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:54.418600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5884b72-7e25-47d9-b4d1-e1a0ffd183b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:54.418875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5884b72-7e25-47d9-b4d1-e1a0ffd183b9 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4/groups/a2daabeac6824d9badc5e6dfa571f6b1/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:54.421226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5884b72-7e25-47d9-b4d1-e1a0ffd183b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e72c20e824a34e33a3d2cec6cea56ca4, group_id=a2daabeac6824d9badc5e6dfa571f6b1, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:54.422714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5884b72-7e25-47d9-b4d1-e1a0ffd183b9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:54.452582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 193/394] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 21 08:12:54 2022] PUT /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4/groups/a2daabeac6824d9badc5e6dfa571f6b1/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:54.561045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4abcfc-a9eb-4560-9e43-2bbbdce310b4 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:54.561408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4abcfc-a9eb-4560-9e43-2bbbdce310b4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:54.561600 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4abcfc-a9eb-4560-9e43-2bbbdce310b4 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:54.563417 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 202/395] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:54.571030 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af3b99-0494-4288-879c-33136261b93c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:54.571515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af3b99-0494-4288-879c-33136261b93c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:54.572008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af3b99-0494-4288-879c-33136261b93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:54.613611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-35af3b99-0494-4288-879c-33136261b93c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:54.615792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-35af3b99-0494-4288-879c-33136261b93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:54.795243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 194/396] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:12:54.797457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e936-6218-4685-8e26-e68b20a6a6e0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:54.798036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e936-6218-4685-8e26-e68b20a6a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:54.798538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e936-6218-4685-8e26-e68b20a6a6e0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:54.802007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 203/397] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:54.807355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed42720-aba7-46e8-ad2b-f703b58b5c5f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:54.808019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed42720-aba7-46e8-ad2b-f703b58b5c5f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:54.808533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed42720-aba7-46e8-ad2b-f703b58b5c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:54.828152 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7ed42720-aba7-46e8-ad2b-f703b58b5c5f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:54.829788 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7ed42720-aba7-46e8-ad2b-f703b58b5c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:54.861297 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277e936-6218-4685-8e26-e68b20a6a6e0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:54.869039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:54.880919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:54.972649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 195/398] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:12:54.991385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed42720-aba7-46e8-ad2b-f703b58b5c5f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:55.075082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277e936-6218-4685-8e26-e68b20a6a6e0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:55.158778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1cd22-aa28-4048-88e6-9a8e14a81135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:55.160226 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1cd22-aa28-4048-88e6-9a8e14a81135 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:55.160759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1cd22-aa28-4048-88e6-9a8e14a81135 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:55.161319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1cd22-aa28-4048-88e6-9a8e14a81135 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:55.205423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1cd22-aa28-4048-88e6-9a8e14a81135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:55.211040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed42720-aba7-46e8-ad2b-f703b58b5c5f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4fb1cd22-aa28-4048-88e6-9a8e14a81135 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:55.225209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:55.226163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:55.226934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:55.226934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:55.226934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:55.226934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:55.226934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:55.226934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:55.226934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:55.226934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:55.226934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:55.226934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:55.226934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:55.226934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:55.229140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 204/399] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:55.235488 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1cd22-aa28-4048-88e6-9a8e14a81135 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:55.294406 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e98c95-5c2c-439f-96ef-58791c1395f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:55.301219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e98c95-5c2c-439f-96ef-58791c1395f2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:55.301219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e98c95-5c2c-439f-96ef-58791c1395f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:55.301404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e98c95-5c2c-439f-96ef-58791c1395f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:55.344621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:55.361280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e98c95-5c2c-439f-96ef-58791c1395f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-82e98c95-5c2c-439f-96ef-58791c1395f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:55.377414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:55.378396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:55.379179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:55.379179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:55.379179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:55.379179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:55.379179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:55.379179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:55.379179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:55.379179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:55.379179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:55.379179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:55.379179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:12:55.379179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:55.379839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 196/400] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:12:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:55.389629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e98c95-5c2c-439f-96ef-58791c1395f2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:55.397515 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1cd22-aa28-4048-88e6-9a8e14a81135 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:55.440995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6ee0-29f1-4a26-892e-54fe924b0947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:55.442102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6ee0-29f1-4a26-892e-54fe924b0947 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:55.442974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6ee0-29f1-4a26-892e-54fe924b0947 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:55.443455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6ee0-29f1-4a26-892e-54fe924b0947 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:55.444438 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee6ee0-29f1-4a26-892e-54fe924b0947 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:55.445045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee6ee0-29f1-4a26-892e-54fe924b0947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:55.446712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee6ee0-29f1-4a26-892e-54fe924b0947 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:55.458486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 205/401] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:55.467168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6ee0-29f1-4a26-892e-54fe924b0947 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:55.490255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:55.658771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e98c95-5c2c-439f-96ef-58791c1395f2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:55.715999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23716873-6b3d-4446-9ab1-c6cbb3d7688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:55.717198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23716873-6b3d-4446-9ab1-c6cbb3d7688b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:55.718063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23716873-6b3d-4446-9ab1-c6cbb3d7688b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:55.718545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23716873-6b3d-4446-9ab1-c6cbb3d7688b None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:55.719549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23716873-6b3d-4446-9ab1-c6cbb3d7688b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:55.720091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23716873-6b3d-4446-9ab1-c6cbb3d7688b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:55.721861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23716873-6b3d-4446-9ab1-c6cbb3d7688b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:55.730798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6ee0-29f1-4a26-892e-54fe924b0947 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:55.752309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 197/402] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:55.759226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23716873-6b3d-4446-9ab1-c6cbb3d7688b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:55.826607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:55.877958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95fb81-487d-41c7-acde-6e02988c9d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:55.879903 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95fb81-487d-41c7-acde-6e02988c9d77 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:55.880196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95fb81-487d-41c7-acde-6e02988c9d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:55.880727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95fb81-487d-41c7-acde-6e02988c9d77 None admin] PATH_INFO: `/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:55.883154 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95fb81-487d-41c7-acde-6e02988c9d77 None admin] RBAC: Authorizing `identity:get_group(group_id=a2daabeac6824d9badc5e6dfa571f6b1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:55.886200 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95fb81-487d-41c7-acde-6e02988c9d77 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:55.889928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 206/403] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:12:55 2022] GET /identity/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1 => generated 226 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:55.892719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965951b-c06d-40a0-b1dd-b9a683bdb363 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:55.892902 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965951b-c06d-40a0-b1dd-b9a683bdb363 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:55.893345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965951b-c06d-40a0-b1dd-b9a683bdb363 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:55.903110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 207/404] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:55.904787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965951b-c06d-40a0-b1dd-b9a683bdb363 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:55.958415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23716873-6b3d-4446-9ab1-c6cbb3d7688b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:55.960424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:56.013983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023a4b1-26ac-41cb-bb00-e861581bba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:56.015563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023a4b1-26ac-41cb-bb00-e861581bba41 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:56.016113 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023a4b1-26ac-41cb-bb00-e861581bba41 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:56.016642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023a4b1-26ac-41cb-bb00-e861581bba41 None admin] PATH_INFO: `/v3/groups/c1ed64767be848c5a794a2881ff2fa9a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:56.019699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023a4b1-26ac-41cb-bb00-e861581bba41 None admin] RBAC: Authorizing `identity:get_group(group_id=c1ed64767be848c5a794a2881ff2fa9a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:56.022685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023a4b1-26ac-41cb-bb00-e861581bba41 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:56.026745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 198/405] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:12:55 2022] GET /identity/v3/groups/c1ed64767be848c5a794a2881ff2fa9a => generated 229 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:56.029096 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0c14-3e45-4783-a108-77a3972df47e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:56.029589 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0c14-3e45-4783-a108-77a3972df47e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:56.030075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0c14-3e45-4783-a108-77a3972df47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:56.062722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ca2b0c14-3e45-4783-a108-77a3972df47e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:56.064078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ca2b0c14-3e45-4783-a108-77a3972df47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:56.082279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965951b-c06d-40a0-b1dd-b9a683bdb363 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:56.165632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 199/406] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:56.165632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b0c14-3e45-4783-a108-77a3972df47e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:56.181776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a392c33-b0dc-4643-bb34-3b8d7c6d64a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:56.184386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a392c33-b0dc-4643-bb34-3b8d7c6d64a8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:56.185176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a392c33-b0dc-4643-bb34-3b8d7c6d64a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:56.185857 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a392c33-b0dc-4643-bb34-3b8d7c6d64a8 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:56.188399 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a392c33-b0dc-4643-bb34-3b8d7c6d64a8 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:56.198499 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a392c33-b0dc-4643-bb34-3b8d7c6d64a8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:56.205427 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 208/407] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:55 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:56.218448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a392c33-b0dc-4643-bb34-3b8d7c6d64a8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:56.266573 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:56.288994 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b0c14-3e45-4783-a108-77a3972df47e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:56.328119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a02b3-635b-46e3-b3a8-3d6f3561e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:56.329004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a02b3-635b-46e3-b3a8-3d6f3561e0fb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:56.329279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a02b3-635b-46e3-b3a8-3d6f3561e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:56.329557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a02b3-635b-46e3-b3a8-3d6f3561e0fb None admin] PATH_INFO: `/v3/projects/3a9abea4928641f4840c146c33d7e1f5` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:56.330949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a02b3-635b-46e3-b3a8-3d6f3561e0fb None admin] RBAC: Authorizing `identity:get_project(project_id=3a9abea4928641f4840c146c33d7e1f5)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:56.332525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a02b3-635b-46e3-b3a8-3d6f3561e0fb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:56.334989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 200/408] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:56 2022] GET /identity/v3/projects/3a9abea4928641f4840c146c33d7e1f5 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:56.336182 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a02b3-635b-46e3-b3a8-3d6f3561e0fb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:56.385827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:56.457871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a392c33-b0dc-4643-bb34-3b8d7c6d64a8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:56.501184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeec14-bba0-4f16-88d3-44ead6a4321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:56.502747 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeec14-bba0-4f16-88d3-44ead6a4321c None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:56.503199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeec14-bba0-4f16-88d3-44ead6a4321c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:56.503621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeec14-bba0-4f16-88d3-44ead6a4321c None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4/groups/a2daabeac6824d9badc5e6dfa571f6b1/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:56.506642 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeec14-bba0-4f16-88d3-44ead6a4321c None admin] RBAC: Authorizing `identity:create_grant(project_id=4efc2482ceab4826af36f260dbc35af4, group_id=a2daabeac6824d9badc5e6dfa571f6b1, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:56.508384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeec14-bba0-4f16-88d3-44ead6a4321c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:56.537205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 209/409] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 21 08:12:56 2022] PUT /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4/groups/a2daabeac6824d9badc5e6dfa571f6b1/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:56.538739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeec14-bba0-4f16-88d3-44ead6a4321c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:56.555106 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a02b3-635b-46e3-b3a8-3d6f3561e0fb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:56.676399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d3c4b-9b85-475f-8a9c-c0e92892cb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:56.679306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d3c4b-9b85-475f-8a9c-c0e92892cb59 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:56.680211 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d3c4b-9b85-475f-8a9c-c0e92892cb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:56.681290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d3c4b-9b85-475f-8a9c-c0e92892cb59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:56.701224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d3c4b-9b85-475f-8a9c-c0e92892cb59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-221d3c4b-9b85-475f-8a9c-c0e92892cb59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:56.711934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:56.713112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:56.714188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:56.714188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:56.714188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:56.714188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:56.714188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:56.714188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:56.714188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:56.714188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:56.714188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:56.714188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:56.714188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:56.714188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:56.716843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 201/410] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:12:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:56.727352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d3c4b-9b85-475f-8a9c-c0e92892cb59 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:56.732567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeec14-bba0-4f16-88d3-44ead6a4321c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:56.756556 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:56.770579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:56.795560 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127760d6-68aa-457e-946b-7bde8b7afb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:56.797522 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127760d6-68aa-457e-946b-7bde8b7afb79 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:56.798386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127760d6-68aa-457e-946b-7bde8b7afb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:56.798904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127760d6-68aa-457e-946b-7bde8b7afb79 None admin] PATH_INFO: `/v3/projects/3a9abea4928641f4840c146c33d7e1f5/groups/c1ed64767be848c5a794a2881ff2fa9a/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:56.802772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127760d6-68aa-457e-946b-7bde8b7afb79 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a9abea4928641f4840c146c33d7e1f5, group_id=c1ed64767be848c5a794a2881ff2fa9a, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:56.805286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127760d6-68aa-457e-946b-7bde8b7afb79 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:56.837843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 210/411] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 21 08:12:56 2022] PUT /identity/v3/projects/3a9abea4928641f4840c146c33d7e1f5/groups/c1ed64767be848c5a794a2881ff2fa9a/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:56.840989 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82539200-c5ac-4102-913d-8228bc54d7ed None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:56.841672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82539200-c5ac-4102-913d-8228bc54d7ed None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:56.842249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82539200-c5ac-4102-913d-8228bc54d7ed None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:56.847389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 211/412] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:56.853934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a97906-c7c9-417e-a47d-7cfe86f8a964 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:56.854638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a97906-c7c9-417e-a47d-7cfe86f8a964 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:56.855271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a97906-c7c9-417e-a47d-7cfe86f8a964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:56.896331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c1a97906-c7c9-417e-a47d-7cfe86f8a964 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:56.900010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c1a97906-c7c9-417e-a47d-7cfe86f8a964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:56.903422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d3c4b-9b85-475f-8a9c-c0e92892cb59 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:56.975875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f70990-f1ba-4aba-b5d4-2e4bbb5aa4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:56.977561 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f70990-f1ba-4aba-b5d4-2e4bbb5aa4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:56.978011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f70990-f1ba-4aba-b5d4-2e4bbb5aa4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:56.978613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f70990-f1ba-4aba-b5d4-2e4bbb5aa4b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:56.980189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f70990-f1ba-4aba-b5d4-2e4bbb5aa4b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:56.980914 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f70990-f1ba-4aba-b5d4-2e4bbb5aa4b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:56.983880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f70990-f1ba-4aba-b5d4-2e4bbb5aa4b0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:57.000155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 212/413] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:12:57.002757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 202/414] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:12:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:57.011936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a97906-c7c9-417e-a47d-7cfe86f8a964 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:57.026401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f70990-f1ba-4aba-b5d4-2e4bbb5aa4b0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:57.174699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:57.188975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a97906-c7c9-417e-a47d-7cfe86f8a964 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:57.204738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:57.231306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f70990-f1ba-4aba-b5d4-2e4bbb5aa4b0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:57.256165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ee243-2f55-4d55-9c66-c005850b50c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:57.257541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ee243-2f55-4d55-9c66-c005850b50c5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:57.257823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ee243-2f55-4d55-9c66-c005850b50c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:57.258165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ee243-2f55-4d55-9c66-c005850b50c5 None admin] PATH_INFO: `/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:57.261083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ee243-2f55-4d55-9c66-c005850b50c5 None admin] RBAC: Authorizing `identity:get_group(group_id=a2daabeac6824d9badc5e6dfa571f6b1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:57.263289 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ee243-2f55-4d55-9c66-c005850b50c5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:57.265581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 213/415] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:12:57 2022] GET /identity/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:57.272252 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ee243-2f55-4d55-9c66-c005850b50c5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:57.307498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c44b8-442d-4400-b826-315b15236ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:57.309021 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c44b8-442d-4400-b826-315b15236ecd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:57.309523 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c44b8-442d-4400-b826-315b15236ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:57.310021 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c44b8-442d-4400-b826-315b15236ecd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:57.333279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c44b8-442d-4400-b826-315b15236ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2b0c44b8-442d-4400-b826-315b15236ecd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:57.349775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:57.350765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:57.351548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:57.351548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:57.351548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:57.351548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:57.351548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:57.351548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:57.351548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:57.351548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:57.351548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:57.351548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:57.351548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:12:57.351548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:12:57.352675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 203/416] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:12:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:12:57.359031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c44b8-442d-4400-b826-315b15236ecd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:57.555538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ee243-2f55-4d55-9c66-c005850b50c5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:57.607846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2187729-6ce7-43df-8e8d-fbea12cb6d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:57.608807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2187729-6ce7-43df-8e8d-fbea12cb6d08 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:57.609089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2187729-6ce7-43df-8e8d-fbea12cb6d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:57.609350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2187729-6ce7-43df-8e8d-fbea12cb6d08 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:57.614902 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2187729-6ce7-43df-8e8d-fbea12cb6d08 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:57.616429 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2187729-6ce7-43df-8e8d-fbea12cb6d08 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:57.618346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 214/417] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:57 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:57.627365 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2187729-6ce7-43df-8e8d-fbea12cb6d08 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:57.672304 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c44b8-442d-4400-b826-315b15236ecd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:57.696414 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:57.768820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2187729-6ce7-43df-8e8d-fbea12cb6d08 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:57.774209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4e37b-cad9-4324-84bc-1c585b89df41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:57.775496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4e37b-cad9-4324-84bc-1c585b89df41 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:57.775998 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4e37b-cad9-4324-84bc-1c585b89df41 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:57.776519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4e37b-cad9-4324-84bc-1c585b89df41 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:57.778030 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4e37b-cad9-4324-84bc-1c585b89df41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:57.778640 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4e37b-cad9-4324-84bc-1c585b89df41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:57.781362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4e37b-cad9-4324-84bc-1c585b89df41 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:57.784215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:57.806117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 204/418] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:12:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:57.806117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec95b1-eaf7-4ba5-86d0-c34b2fcec30b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:57.806117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec95b1-eaf7-4ba5-86d0-c34b2fcec30b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:57.806117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec95b1-eaf7-4ba5-86d0-c34b2fcec30b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:57.815139 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 205/419] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:57.816868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec95b1-eaf7-4ba5-86d0-c34b2fcec30b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:57.820557 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ad2b1-7702-4cfe-aeed-5803788494b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:57.821863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ad2b1-7702-4cfe-aeed-5803788494b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:57.822318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ad2b1-7702-4cfe-aeed-5803788494b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:57.822882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ad2b1-7702-4cfe-aeed-5803788494b1 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4/groups/a2daabeac6824d9badc5e6dfa571f6b1/roles/cbcda598469c41f19a1d3109e5d4c236` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:57.825467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ad2b1-7702-4cfe-aeed-5803788494b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4efc2482ceab4826af36f260dbc35af4, group_id=a2daabeac6824d9badc5e6dfa571f6b1, role_id=cbcda598469c41f19a1d3109e5d4c236)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:57.826956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ad2b1-7702-4cfe-aeed-5803788494b1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:57.844341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 215/420] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 21 08:12:57 2022] PUT /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4/groups/a2daabeac6824d9badc5e6dfa571f6b1/roles/cbcda598469c41f19a1d3109e5d4c236 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:12:57.845878 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b99a9a-e30f-457f-b81c-678ae1ed820f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:57.846188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b99a9a-e30f-457f-b81c-678ae1ed820f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:57.846519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b99a9a-e30f-457f-b81c-678ae1ed820f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:57.886422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-25b99a9a-e30f-457f-b81c-678ae1ed820f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:57.888100 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-25b99a9a-e30f-457f-b81c-678ae1ed820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:12:58.066858 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 216/421] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:12:58.083336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec95b1-eaf7-4ba5-86d0-c34b2fcec30b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:58.112085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b99a9a-e30f-457f-b81c-678ae1ed820f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:58.132869 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb5ff5-f2e4-48cf-ba34-89badcf0936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:58.133552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb5ff5-f2e4-48cf-ba34-89badcf0936c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:58.133827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb5ff5-f2e4-48cf-ba34-89badcf0936c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:58.134097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb5ff5-f2e4-48cf-ba34-89badcf0936c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:58.176151 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:58.287378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb5ff5-f2e4-48cf-ba34-89badcf0936c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:58.288908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb5ff5-f2e4-48cf-ba34-89badcf0936c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:58.305153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:58.306796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b99a9a-e30f-457f-b81c-678ae1ed820f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:58.416218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99525de-17f0-486c-8116-5959efb5c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:58.418050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99525de-17f0-486c-8116-5959efb5c236 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:58.418762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99525de-17f0-486c-8116-5959efb5c236 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:58.421007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99525de-17f0-486c-8116-5959efb5c236 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:58.463633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99525de-17f0-486c-8116-5959efb5c236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c99525de-17f0-486c-8116-5959efb5c236 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:12:58.486463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:12:58.488192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:12:58.490258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:12:58.490258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:12:58.490258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:12:58.490258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:12:58.490258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:12:58.490258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:12:58.490258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:12:58.490258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:12:58.490258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:12:58.490258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:12:58.490258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:12:58.490258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:12:58.506197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 217/422] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:12:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:12:58.512956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99525de-17f0-486c-8116-5959efb5c236 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:58.650373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 206/423] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 834 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:58.656782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb5ff5-f2e4-48cf-ba34-89badcf0936c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:58.698481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:58.710768 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99525de-17f0-486c-8116-5959efb5c236 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:58.770997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02994ade-c018-4945-8421-a5bf6ee74ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:58.772261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994ade-c018-4945-8421-a5bf6ee74ada None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:58.773565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994ade-c018-4945-8421-a5bf6ee74ada None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:58.775056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994ade-c018-4945-8421-a5bf6ee74ada None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:58.776175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02994ade-c018-4945-8421-a5bf6ee74ada None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:58.783244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02994ade-c018-4945-8421-a5bf6ee74ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:58.785143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02994ade-c018-4945-8421-a5bf6ee74ada None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:58.808655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 218/424] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:12:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:58.817797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02994ade-c018-4945-8421-a5bf6ee74ada None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:58.994722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:59.009081 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb5ff5-f2e4-48cf-ba34-89badcf0936c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:59.109343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038b58d-d638-4732-8def-f07df3a20060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:59.110357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038b58d-d638-4732-8def-f07df3a20060 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:59.110631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038b58d-d638-4732-8def-f07df3a20060 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:59.110932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038b58d-d638-4732-8def-f07df3a20060 None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:59.112382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038b58d-d638-4732-8def-f07df3a20060 None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:59.112605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02994ade-c018-4945-8421-a5bf6ee74ada None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:59.113955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038b58d-d638-4732-8def-f07df3a20060 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:59.117127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 207/425] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:58 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:12:59.121925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038b58d-d638-4732-8def-f07df3a20060 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:59.196227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd677bc6-051f-4c95-af77-5afcf26588d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:59.197444 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd677bc6-051f-4c95-af77-5afcf26588d0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:59.198096 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd677bc6-051f-4c95-af77-5afcf26588d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:59.198566 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd677bc6-051f-4c95-af77-5afcf26588d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:59.256435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:59.346265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd677bc6-051f-4c95-af77-5afcf26588d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:59.349384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd677bc6-051f-4c95-af77-5afcf26588d0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:59.396217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038b58d-d638-4732-8def-f07df3a20060 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:59.517475 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f5e4e-a469-4bc9-8a6e-a00ce8daa12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:59.518756 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f5e4e-a469-4bc9-8a6e-a00ce8daa12b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:59.519269 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f5e4e-a469-4bc9-8a6e-a00ce8daa12b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:59.519852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f5e4e-a469-4bc9-8a6e-a00ce8daa12b None admin] PATH_INFO: `/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:59.522036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f5e4e-a469-4bc9-8a6e-a00ce8daa12b None admin] RBAC: Authorizing `identity:get_group(group_id=a2daabeac6824d9badc5e6dfa571f6b1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:59.523844 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f5e4e-a469-4bc9-8a6e-a00ce8daa12b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:59.526281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 208/426] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:12:59 2022] GET /identity/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1 => generated 226 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:59.532068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f5e4e-a469-4bc9-8a6e-a00ce8daa12b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:59.558664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 219/427] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:12:59.566332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd677bc6-051f-4c95-af77-5afcf26588d0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:59.596720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:59.690906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:12:59.753258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f5e4e-a469-4bc9-8a6e-a00ce8daa12b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:59.800183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd677bc6-051f-4c95-af77-5afcf26588d0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:12:59.839103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab6025-ba7e-47d8-bdbf-b2fff2f79eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:59.840289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab6025-ba7e-47d8-bdbf-b2fff2f79eeb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:59.840751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab6025-ba7e-47d8-bdbf-b2fff2f79eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:59.841202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab6025-ba7e-47d8-bdbf-b2fff2f79eeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:59.842947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab6025-ba7e-47d8-bdbf-b2fff2f79eeb None admin] RBAC: Adding query filter params (group.id=a2daabeac6824d9badc5e6dfa571f6b1, role.id=cbcda598469c41f19a1d3109e5d4c236, scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:12:59.843483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab6025-ba7e-47d8-bdbf-b2fff2f79eeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:59.846097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab6025-ba7e-47d8-bdbf-b2fff2f79eeb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:59.857634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 209/428] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 21 08:12:59 2022] GET /identity/v3/role_assignments?group.id=a2daabeac6824d9badc5e6dfa571f6b1&scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4&role.id=cbcda598469c41f19a1d3109e5d4c236 => generated 611 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:59.859329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f6c58-692a-45e1-b8a8-7ffbd3ff61d1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:59.859705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f6c58-692a-45e1-b8a8-7ffbd3ff61d1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:59.860007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f6c58-692a-45e1-b8a8-7ffbd3ff61d1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:59.864552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 210/429] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:12:59.868236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac61837-699a-467c-9283-3dfdd1b7a82a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:59.868806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac61837-699a-467c-9283-3dfdd1b7a82a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:59.870074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac61837-699a-467c-9283-3dfdd1b7a82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:59.876067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ad3bc-2a25-4414-9d26-8c18c5bd706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:12:59.880091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ad3bc-2a25-4414-9d26-8c18c5bd706b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:12:59.881470 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ad3bc-2a25-4414-9d26-8c18c5bd706b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:12:59.884200 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ad3bc-2a25-4414-9d26-8c18c5bd706b None admin] PATH_INFO: `/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:12:59.890070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ad3bc-2a25-4414-9d26-8c18c5bd706b None admin] RBAC: Authorizing `identity:get_project(project_id=e72c20e824a34e33a3d2cec6cea56ca4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:12:59.895689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ad3bc-2a25-4414-9d26-8c18c5bd706b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:12:59.908410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 220/430] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:12:59 2022] GET /identity/v3/projects/e72c20e824a34e33a3d2cec6cea56ca4 => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:12:59.910304 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ad3bc-2a25-4414-9d26-8c18c5bd706b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:12:59.933496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bac61837-699a-467c-9283-3dfdd1b7a82a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:12:59.936028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bac61837-699a-467c-9283-3dfdd1b7a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:00.106349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 211/431] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:13:00.110624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea831c9-ea6f-49fd-a7d6-aa1cdf97e250 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:00.111376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea831c9-ea6f-49fd-a7d6-aa1cdf97e250 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:00.112043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea831c9-ea6f-49fd-a7d6-aa1cdf97e250 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:00.115574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 212/432] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:00.123825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ad3bc-2a25-4414-9d26-8c18c5bd706b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:00.126850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1da68-6170-497a-959d-6a77340b82c8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:00.127521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1da68-6170-497a-959d-6a77340b82c8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:00.128154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1da68-6170-497a-959d-6a77340b82c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:00.150868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-48a1da68-6170-497a-959d-6a77340b82c8 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:00.152595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-48a1da68-6170-497a-959d-6a77340b82c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:00.160429 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:00.173879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497a373-3b63-4ddb-890d-a44c497e6be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:00.174796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497a373-3b63-4ddb-890d-a44c497e6be8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:00.175074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497a373-3b63-4ddb-890d-a44c497e6be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:00.175634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497a373-3b63-4ddb-890d-a44c497e6be8 None admin] PATH_INFO: `/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:00.178102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497a373-3b63-4ddb-890d-a44c497e6be8 None admin] RBAC: Authorizing `identity:get_group(group_id=a2daabeac6824d9badc5e6dfa571f6b1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:00.179604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497a373-3b63-4ddb-890d-a44c497e6be8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:00.180919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:00.182329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 221/433] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:12:59 2022] GET /identity/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:00.183554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497a373-3b63-4ddb-890d-a44c497e6be8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:00.256475 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 213/434] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:00.256475 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1da68-6170-497a-959d-6a77340b82c8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:00.332444 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497a373-3b63-4ddb-890d-a44c497e6be8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:00.376242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92024018-b7a8-484f-91a6-4dbf94a9f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:00.377350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92024018-b7a8-484f-91a6-4dbf94a9f76d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:00.377350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92024018-b7a8-484f-91a6-4dbf94a9f76d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:00.377589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92024018-b7a8-484f-91a6-4dbf94a9f76d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:00.392001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92024018-b7a8-484f-91a6-4dbf94a9f76d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:00.395812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1da68-6170-497a-959d-6a77340b82c8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-92024018-b7a8-484f-91a6-4dbf94a9f76d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:00.400467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:00.401567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:00.402462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:00.402462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:00.402462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:00.402462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:00.402462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:00.402462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:00.402462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:00.402462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:00.402462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:00.402462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:00.402462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:13:00.402462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:00.406995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 222/435] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:13:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:00.407997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92024018-b7a8-484f-91a6-4dbf94a9f76d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:00.440454 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad027b-db0c-47c2-bcc2-ec702cbcd16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:00.441310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad027b-db0c-47c2-bcc2-ec702cbcd16b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:00.441514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad027b-db0c-47c2-bcc2-ec702cbcd16b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:00.441791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad027b-db0c-47c2-bcc2-ec702cbcd16b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:00.442749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad027b-db0c-47c2-bcc2-ec702cbcd16b None admin] RBAC: Adding query filter params (group.id=a2daabeac6824d9badc5e6dfa571f6b1, role.id=2363304f42424934b09a0ff0bc62315d, scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:00.443061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad027b-db0c-47c2-bcc2-ec702cbcd16b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:00.444570 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad027b-db0c-47c2-bcc2-ec702cbcd16b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:00.456679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 214/436] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 21 08:13:00 2022] GET /identity/v3/role_assignments?group.id=a2daabeac6824d9badc5e6dfa571f6b1&scope.project.id=e72c20e824a34e33a3d2cec6cea56ca4&role.id=2363304f42424934b09a0ff0bc62315d => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:00.456679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad027b-db0c-47c2-bcc2-ec702cbcd16b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:00.506769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:00.517642 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:00.622250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92024018-b7a8-484f-91a6-4dbf94a9f76d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:00.652155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad027b-db0c-47c2-bcc2-ec702cbcd16b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:00.699851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5eb918-c626-4f36-9473-b554bbd8a708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:00.701554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eb918-c626-4f36-9473-b554bbd8a708 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:00.702210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eb918-c626-4f36-9473-b554bbd8a708 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:00.702595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eb918-c626-4f36-9473-b554bbd8a708 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:00.710928 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cd12a-ca24-43c8-9527-dede4efb9bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:00.711630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cd12a-ca24-43c8-9527-dede4efb9bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:00.711888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cd12a-ca24-43c8-9527-dede4efb9bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:00.712147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cd12a-ca24-43c8-9527-dede4efb9bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:00.712957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cd12a-ca24-43c8-9527-dede4efb9bc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:00.713259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cd12a-ca24-43c8-9527-dede4efb9bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:00.714680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cd12a-ca24-43c8-9527-dede4efb9bc6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:00.725521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 215/437] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:00.731468 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cd12a-ca24-43c8-9527-dede4efb9bc6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:00.731780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5eb918-c626-4f36-9473-b554bbd8a708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ad5eb918-c626-4f36-9473-b554bbd8a708 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:00.746815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:00.748960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:00.750733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 223/438] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:00.756644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5eb918-c626-4f36-9473-b554bbd8a708 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:00.874120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:00.904594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cd12a-ca24-43c8-9527-dede4efb9bc6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:00.938898 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5eb918-c626-4f36-9473-b554bbd8a708 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:00.959010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:00.973106 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e251415-32f6-434d-b721-3bb7fda6da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:00.973740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e251415-32f6-434d-b721-3bb7fda6da0e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:00.973973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e251415-32f6-434d-b721-3bb7fda6da0e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:00.974385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e251415-32f6-434d-b721-3bb7fda6da0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:01.004838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ddcf5-00e8-4042-9be7-ad853b89c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:01.006194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ddcf5-00e8-4042-9be7-ad853b89c54f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:01.006875 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ddcf5-00e8-4042-9be7-ad853b89c54f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:01.007552 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ddcf5-00e8-4042-9be7-ad853b89c54f None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:01.008890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ddcf5-00e8-4042-9be7-ad853b89c54f None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:01.009542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ddcf5-00e8-4042-9be7-ad853b89c54f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:01.011817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ddcf5-00e8-4042-9be7-ad853b89c54f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:01.027242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 224/439] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:13:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:13:01.029243 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4e13-431a-47e5-80d6-6fc8f6e9c3d4 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:01.029660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4e13-431a-47e5-80d6-6fc8f6e9c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:01.030091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4e13-431a-47e5-80d6-6fc8f6e9c3d4 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:01.032883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 225/440] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:01.034228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4e13-431a-47e5-80d6-6fc8f6e9c3d4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:01.110338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e251415-32f6-434d-b721-3bb7fda6da0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:01.114429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e251415-32f6-434d-b721-3bb7fda6da0e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:01.210449 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4e13-431a-47e5-80d6-6fc8f6e9c3d4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:01.252028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:01.268508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acebe4-f902-4f0f-adbe-c96ad419e0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:01.269205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acebe4-f902-4f0f-adbe-c96ad419e0fe None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:01.269488 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acebe4-f902-4f0f-adbe-c96ad419e0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:01.269767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acebe4-f902-4f0f-adbe-c96ad419e0fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:01.286746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 216/441] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:01.286746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bc14c-face-42e0-8653-bc7bbea2e206 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:01.286746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bc14c-face-42e0-8653-bc7bbea2e206 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:01.286746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bc14c-face-42e0-8653-bc7bbea2e206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:01.300266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-659bc14c-face-42e0-8653-bc7bbea2e206 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:01.301893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-659bc14c-face-42e0-8653-bc7bbea2e206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:01.346947 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:01.382841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acebe4-f902-4f0f-adbe-c96ad419e0fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:01.384624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acebe4-f902-4f0f-adbe-c96ad419e0fe None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:01.391440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 217/442] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:01.392966 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bc14c-face-42e0-8653-bc7bbea2e206 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:01.537226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bc14c-face-42e0-8653-bc7bbea2e206 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:01.539326 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 226/443] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:01.539949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acebe4-f902-4f0f-adbe-c96ad419e0fe None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:01.560234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:01.593228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2575d-5151-49c1-8bc4-eaeffa7b72eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:01.594636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2575d-5151-49c1-8bc4-eaeffa7b72eb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:01.595102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2575d-5151-49c1-8bc4-eaeffa7b72eb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:01.595562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2575d-5151-49c1-8bc4-eaeffa7b72eb None admin] PATH_INFO: `/v3/projects/3a9abea4928641f4840c146c33d7e1f5` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:01.597658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2575d-5151-49c1-8bc4-eaeffa7b72eb None admin] RBAC: Authorizing `identity:get_project(project_id=3a9abea4928641f4840c146c33d7e1f5)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:01.599824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2575d-5151-49c1-8bc4-eaeffa7b72eb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:01.603098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 218/444] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:13:01 2022] GET /identity/v3/projects/3a9abea4928641f4840c146c33d7e1f5 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:01.610510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2575d-5151-49c1-8bc4-eaeffa7b72eb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:01.670670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:01.707155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acebe4-f902-4f0f-adbe-c96ad419e0fe None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:01.747876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2575d-5151-49c1-8bc4-eaeffa7b72eb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:01.765300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33b4be-7bf9-471b-8cc1-80da7ba9657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:01.766712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33b4be-7bf9-471b-8cc1-80da7ba9657d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:01.767220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33b4be-7bf9-471b-8cc1-80da7ba9657d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:01.767717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33b4be-7bf9-471b-8cc1-80da7ba9657d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:01.788133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84746023-7907-4ffe-94a6-d489cbdcc48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:01.788954 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84746023-7907-4ffe-94a6-d489cbdcc48d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:01.789233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84746023-7907-4ffe-94a6-d489cbdcc48d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:01.789415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33b4be-7bf9-471b-8cc1-80da7ba9657d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:01.789557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84746023-7907-4ffe-94a6-d489cbdcc48d None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:01.790767 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84746023-7907-4ffe-94a6-d489cbdcc48d None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:01.792264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84746023-7907-4ffe-94a6-d489cbdcc48d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:01.794089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 219/445] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:13:01 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:01.794890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84746023-7907-4ffe-94a6-d489cbdcc48d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ee33b4be-7bf9-471b-8cc1-80da7ba9657d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:01.805211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:01.807029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:01.808601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 227/446] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:13:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:01.809952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33b4be-7bf9-471b-8cc1-80da7ba9657d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:01.864101 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:01.931481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84746023-7907-4ffe-94a6-d489cbdcc48d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:01.964567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33b4be-7bf9-471b-8cc1-80da7ba9657d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:01.986366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421074c-6610-405d-92bc-76118a20ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:01.987245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421074c-6610-405d-92bc-76118a20ba2c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:01.987523 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421074c-6610-405d-92bc-76118a20ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:01.987794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421074c-6610-405d-92bc-76118a20ba2c None admin] PATH_INFO: `/v3/groups/c1ed64767be848c5a794a2881ff2fa9a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:01.989362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421074c-6610-405d-92bc-76118a20ba2c None admin] RBAC: Authorizing `identity:get_group(group_id=c1ed64767be848c5a794a2881ff2fa9a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:01.990884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421074c-6610-405d-92bc-76118a20ba2c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:01.992661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 220/447] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:13:01 2022] GET /identity/v3/groups/c1ed64767be848c5a794a2881ff2fa9a => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:01.993486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421074c-6610-405d-92bc-76118a20ba2c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:02.009037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d465539-c837-425e-9504-8717a66b5b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:02.010091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d465539-c837-425e-9504-8717a66b5b40 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:02.010448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d465539-c837-425e-9504-8717a66b5b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:02.010760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d465539-c837-425e-9504-8717a66b5b40 None admin] PATH_INFO: `/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:02.012320 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d465539-c837-425e-9504-8717a66b5b40 None admin] RBAC: Authorizing `identity:get_group(group_id=a2daabeac6824d9badc5e6dfa571f6b1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:02.014058 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d465539-c837-425e-9504-8717a66b5b40 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:02.016079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 228/448] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:13:01 2022] GET /identity/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:02.017449 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d465539-c837-425e-9504-8717a66b5b40 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:02.023874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:02.138636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d465539-c837-425e-9504-8717a66b5b40 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:02.142668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421074c-6610-405d-92bc-76118a20ba2c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:02.166572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:02.179794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a8ecf-bc10-477e-8dd7-4cb35baa067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:02.180519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a8ecf-bc10-477e-8dd7-4cb35baa067a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:02.180800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a8ecf-bc10-477e-8dd7-4cb35baa067a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:02.181075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a8ecf-bc10-477e-8dd7-4cb35baa067a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:02.181971 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a8ecf-bc10-477e-8dd7-4cb35baa067a None admin] RBAC: Adding query filter params (group.id=c1ed64767be848c5a794a2881ff2fa9a, role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=3a9abea4928641f4840c146c33d7e1f5) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:02.182281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a8ecf-bc10-477e-8dd7-4cb35baa067a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:02.183822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a8ecf-bc10-477e-8dd7-4cb35baa067a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:02.190486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c75fd6-4e92-48b3-8da5-02b6c99749bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:02.190834 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 229/449] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 21 08:13:02 2022] GET /identity/v3/role_assignments?group.id=c1ed64767be848c5a794a2881ff2fa9a&scope.project.id=3a9abea4928641f4840c146c33d7e1f5&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:02.191397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c75fd6-4e92-48b3-8da5-02b6c99749bf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:02.191781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c75fd6-4e92-48b3-8da5-02b6c99749bf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:02.192297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c75fd6-4e92-48b3-8da5-02b6c99749bf None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:02.193258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c75fd6-4e92-48b3-8da5-02b6c99749bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:02.193595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a8ecf-bc10-477e-8dd7-4cb35baa067a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:02.193760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c75fd6-4e92-48b3-8da5-02b6c99749bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:02.195504 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c75fd6-4e92-48b3-8da5-02b6c99749bf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:02.212146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 221/450] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:02.213468 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c75fd6-4e92-48b3-8da5-02b6c99749bf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:02.327870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:02.378723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a8ecf-bc10-477e-8dd7-4cb35baa067a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:02.418857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c75fd6-4e92-48b3-8da5-02b6c99749bf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:02.430551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9c59d-7fcf-4e8b-8191-ffb07af8a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:02.431266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9c59d-7fcf-4e8b-8191-ffb07af8a579 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:02.431551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9c59d-7fcf-4e8b-8191-ffb07af8a579 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:02.431825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9c59d-7fcf-4e8b-8191-ffb07af8a579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:02.432795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9c59d-7fcf-4e8b-8191-ffb07af8a579 None admin] RBAC: Adding query filter params (group.id=a2daabeac6824d9badc5e6dfa571f6b1, role.id=2363304f42424934b09a0ff0bc62315d, scope.project.id=4efc2482ceab4826af36f260dbc35af4) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:02.433114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9c59d-7fcf-4e8b-8191-ffb07af8a579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:02.435074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9c59d-7fcf-4e8b-8191-ffb07af8a579 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:02.444106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 230/451] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 21 08:13:02 2022] GET /identity/v3/role_assignments?group.id=a2daabeac6824d9badc5e6dfa571f6b1&scope.project.id=4efc2482ceab4826af36f260dbc35af4&role.id=2363304f42424934b09a0ff0bc62315d => generated 611 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:02.481488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9119-bbdf-4e0d-b356-8b26abbaa0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:02.482490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9119-bbdf-4e0d-b356-8b26abbaa0ac None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:02.482909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9119-bbdf-4e0d-b356-8b26abbaa0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:02.483320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9119-bbdf-4e0d-b356-8b26abbaa0ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:02.561540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:02.597763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb9119-bbdf-4e0d-b356-8b26abbaa0ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:02.600053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb9119-bbdf-4e0d-b356-8b26abbaa0ac None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:02.752678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 222/452] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:13:02.759951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9c59d-7fcf-4e8b-8191-ffb07af8a579 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:02.945028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9c59d-7fcf-4e8b-8191-ffb07af8a579 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:03.000471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:03.009054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789439f-c2e1-4f41-8fe7-d1e89fa57c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:03.010462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789439f-c2e1-4f41-8fe7-d1e89fa57c53 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:03.010920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789439f-c2e1-4f41-8fe7-d1e89fa57c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:03.011396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789439f-c2e1-4f41-8fe7-d1e89fa57c53 None admin] PATH_INFO: `/v3/projects/4efc2482ceab4826af36f260dbc35af4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:03.013742 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789439f-c2e1-4f41-8fe7-d1e89fa57c53 None admin] RBAC: Authorizing `identity:get_project(project_id=4efc2482ceab4826af36f260dbc35af4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:03.016430 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789439f-c2e1-4f41-8fe7-d1e89fa57c53 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:03.019716 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 231/453] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:13:02 2022] GET /identity/v3/projects/4efc2482ceab4826af36f260dbc35af4 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:03.026373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9119-bbdf-4e0d-b356-8b26abbaa0ac None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:03.116418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:03.141630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9119-bbdf-4e0d-b356-8b26abbaa0ac None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:03.182343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf44842-2f40-4d25-ae75-6993d53cb369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:03.183233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44842-2f40-4d25-ae75-6993d53cb369 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:03.183514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44842-2f40-4d25-ae75-6993d53cb369 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:03.183784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44842-2f40-4d25-ae75-6993d53cb369 None admin] PATH_INFO: `/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:03.185193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf44842-2f40-4d25-ae75-6993d53cb369 None admin] RBAC: Authorizing `identity:get_group(group_id=a2daabeac6824d9badc5e6dfa571f6b1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:03.186683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf44842-2f40-4d25-ae75-6993d53cb369 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:03.188405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 223/454] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 21 08:13:03 2022] GET /identity/v3/groups/a2daabeac6824d9badc5e6dfa571f6b1 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:03.195783 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789439f-c2e1-4f41-8fe7-d1e89fa57c53 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:03.308826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789439f-c2e1-4f41-8fe7-d1e89fa57c53 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:03.364315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a7813-b19f-4443-9b15-53e6ff91b950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:03.365502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a7813-b19f-4443-9b15-53e6ff91b950 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:03.365995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a7813-b19f-4443-9b15-53e6ff91b950 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:03.366435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a7813-b19f-4443-9b15-53e6ff91b950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:03.368089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a7813-b19f-4443-9b15-53e6ff91b950 None admin] RBAC: Adding query filter params (group.id=a2daabeac6824d9badc5e6dfa571f6b1, role.id=cbcda598469c41f19a1d3109e5d4c236, scope.project.id=4efc2482ceab4826af36f260dbc35af4) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:03.368662 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a7813-b19f-4443-9b15-53e6ff91b950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:03.371512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a7813-b19f-4443-9b15-53e6ff91b950 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:03.383391 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 232/455] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 21 08:13:03 2022] GET /identity/v3/role_assignments?group.id=a2daabeac6824d9badc5e6dfa571f6b1&scope.project.id=4efc2482ceab4826af36f260dbc35af4&role.id=cbcda598469c41f19a1d3109e5d4c236 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:06.396137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec70e4-ea31-4ead-80bc-94c0e4d2dd8f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:06.396971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec70e4-ea31-4ead-80bc-94c0e4d2dd8f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:06.396971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec70e4-ea31-4ead-80bc-94c0e4d2dd8f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:06.398510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 224/456] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:06.405875 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e701bfe-7cae-4a0a-a44a-1a107b88b6ba None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:06.407407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e701bfe-7cae-4a0a-a44a-1a107b88b6ba None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:06.408179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e701bfe-7cae-4a0a-a44a-1a107b88b6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:06.449103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2e701bfe-7cae-4a0a-a44a-1a107b88b6ba None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:06.451707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2e701bfe-7cae-4a0a-a44a-1a107b88b6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:06.556818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:06.567772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 233/457] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:06.605179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec70e4-ea31-4ead-80bc-94c0e4d2dd8f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:06.819895 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec70e4-ea31-4ead-80bc-94c0e4d2dd8f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:06.915526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac8663-a31f-40e2-af38-d96fb85a74c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:06.919658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8663-a31f-40e2-af38-d96fb85a74c9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:06.920513 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8663-a31f-40e2-af38-d96fb85a74c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:06.921402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8663-a31f-40e2-af38-d96fb85a74c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:06.943807 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac8663-a31f-40e2-af38-d96fb85a74c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:06.947101 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac8663-a31f-40e2-af38-d96fb85a74c9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:06.974077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-78ac8663-a31f-40e2-af38-d96fb85a74c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:06.992593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:06.993538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:06.994370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:06.994370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:06.994370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:06.994370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:06.998244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 225/458] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:07.005533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e701bfe-7cae-4a0a-a44a-1a107b88b6ba None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:07.095641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08ca4c-38af-48d3-a81d-245574287483 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:07.096570 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08ca4c-38af-48d3-a81d-245574287483 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:07.097299 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08ca4c-38af-48d3-a81d-245574287483 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:07.100871 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 226/459] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:13:07.110913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499cd21-a59d-4c20-adc5-fb2f58b8fd75 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:07.111905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499cd21-a59d-4c20-adc5-fb2f58b8fd75 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:07.112729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499cd21-a59d-4c20-adc5-fb2f58b8fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:07.141963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6499cd21-a59d-4c20-adc5-fb2f58b8fd75 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:07.144361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6499cd21-a59d-4c20-adc5-fb2f58b8fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:07.331719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 227/460] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:13:07.337487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e701bfe-7cae-4a0a-a44a-1a107b88b6ba None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:07.408149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499cd21-a59d-4c20-adc5-fb2f58b8fd75 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:07.416778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73241f4e-e065-4247-96ca-6d348cea5491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:07.417542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73241f4e-e065-4247-96ca-6d348cea5491 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:07.417824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73241f4e-e065-4247-96ca-6d348cea5491 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:07.418044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73241f4e-e065-4247-96ca-6d348cea5491 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:07.418797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73241f4e-e065-4247-96ca-6d348cea5491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:07.419104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73241f4e-e065-4247-96ca-6d348cea5491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:07.420631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73241f4e-e065-4247-96ca-6d348cea5491 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:07.440967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 234/461] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:07.463624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73241f4e-e065-4247-96ca-6d348cea5491 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:07.585076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499cd21-a59d-4c20-adc5-fb2f58b8fd75 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:07.611149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:07.630163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:07.652911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94decf-0627-4fe6-826b-449cd7d45797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:07.654256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94decf-0627-4fe6-826b-449cd7d45797 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:07.654781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94decf-0627-4fe6-826b-449cd7d45797 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:07.655273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94decf-0627-4fe6-826b-449cd7d45797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:07.674935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94decf-0627-4fe6-826b-449cd7d45797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:07.677488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94decf-0627-4fe6-826b-449cd7d45797 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:07.701307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73241f4e-e065-4247-96ca-6d348cea5491 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-fe94decf-0627-4fe6-826b-449cd7d45797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:07.706965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:07.708110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:07.709054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:07.709054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:07.709054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:07.709054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:07.712818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 228/462] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:13:07.715783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b49f0-c032-40e0-9659-44d20a715ac3 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:07.716650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b49f0-c032-40e0-9659-44d20a715ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:07.717599 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b49f0-c032-40e0-9659-44d20a715ac3 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:07.720560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 229/463] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:07.722638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b49f0-c032-40e0-9659-44d20a715ac3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:07.751724 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7189251-9ab0-473f-b50a-0b4d5e0adf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:07.752441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7189251-9ab0-473f-b50a-0b4d5e0adf74 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:07.752765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7189251-9ab0-473f-b50a-0b4d5e0adf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:07.753002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7189251-9ab0-473f-b50a-0b4d5e0adf74 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:07.753727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7189251-9ab0-473f-b50a-0b4d5e0adf74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:07.755902 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7189251-9ab0-473f-b50a-0b4d5e0adf74 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:07.788571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 235/464] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:13:07 2022] POST /identity/v3/users => generated 246 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:13:07.789706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c36150-f3d4-4a38-b36a-7e7368d60bfd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:07.790483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c36150-f3d4-4a38-b36a-7e7368d60bfd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:07.791172 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c36150-f3d4-4a38-b36a-7e7368d60bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:07.827719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-22c36150-f3d4-4a38-b36a-7e7368d60bfd None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:07.829873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-22c36150-f3d4-4a38-b36a-7e7368d60bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:07.964114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b49f0-c032-40e0-9659-44d20a715ac3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:07.986051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 236/465] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:07.989272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807358f-0cc9-45e2-b4fc-ee0d7e9f2822 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:07.990257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807358f-0cc9-45e2-b4fc-ee0d7e9f2822 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:07.991031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807358f-0cc9-45e2-b4fc-ee0d7e9f2822 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:07.994353 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 237/466] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:08.003844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6d185-822c-4b79-836c-c2fda0edb1b2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:08.004399 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6d185-822c-4b79-836c-c2fda0edb1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:08.004929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6d185-822c-4b79-836c-c2fda0edb1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:08.033933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475e63-9daa-4ca3-87e8-194b12c03456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:08.035072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475e63-9daa-4ca3-87e8-194b12c03456 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:08.035604 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475e63-9daa-4ca3-87e8-194b12c03456 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:08.036103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475e63-9daa-4ca3-87e8-194b12c03456 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:08.036527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-aba6d185-822c-4b79-836c-c2fda0edb1b2 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:08.037258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24475e63-9daa-4ca3-87e8-194b12c03456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:08.037707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24475e63-9daa-4ca3-87e8-194b12c03456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:08.038547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aba6d185-822c-4b79-836c-c2fda0edb1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:08.039495 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24475e63-9daa-4ca3-87e8-194b12c03456 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:08.054973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 230/467] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:08.056310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475e63-9daa-4ca3-87e8-194b12c03456 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:08.110389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:08.113945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:08.185059 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 238/468] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:08.186592 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6d185-822c-4b79-836c-c2fda0edb1b2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:08.239984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475e63-9daa-4ca3-87e8-194b12c03456 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:08.310362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92feda0-8d21-45d1-a76a-2b0a5ce5ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:08.311757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92feda0-8d21-45d1-a76a-2b0a5ce5ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:08.312267 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92feda0-8d21-45d1-a76a-2b0a5ce5ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:08.312825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92feda0-8d21-45d1-a76a-2b0a5ce5ffc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:08.332311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92feda0-8d21-45d1-a76a-2b0a5ce5ffc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:08.334189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92feda0-8d21-45d1-a76a-2b0a5ce5ffc6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b92feda0-8d21-45d1-a76a-2b0a5ce5ffc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:08.358654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:08.359657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:08.360538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:08.360538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:08.360538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:08.360538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:08.362534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 231/469] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:08.364902 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbc4d1-fcde-426d-8831-14e10db535ba None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:08.365362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbc4d1-fcde-426d-8831-14e10db535ba None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:08.365843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbc4d1-fcde-426d-8831-14e10db535ba None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:08.368661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 232/470] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:08.373899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbc4d1-fcde-426d-8831-14e10db535ba None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:08.396804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6d185-822c-4b79-836c-c2fda0edb1b2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:08.462932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb831115-2697-4158-9768-157b690e3281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:08.464106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb831115-2697-4158-9768-157b690e3281 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:08.464625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb831115-2697-4158-9768-157b690e3281 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:08.465112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb831115-2697-4158-9768-157b690e3281 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:08.466467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb831115-2697-4158-9768-157b690e3281 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:08.469271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb831115-2697-4158-9768-157b690e3281 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:08.506424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 239/471] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:13:08 2022] POST /identity/v3/users => generated 248 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:13:08.507888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb831115-2697-4158-9768-157b690e3281 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:08.517554 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:08.540078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbc4d1-fcde-426d-8831-14e10db535ba None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:08.583268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:08.596039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f0878-5731-4504-984e-6209ec6a4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:08.597193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f0878-5731-4504-984e-6209ec6a4fac None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:08.597699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f0878-5731-4504-984e-6209ec6a4fac None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:08.598371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f0878-5731-4504-984e-6209ec6a4fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:08.617675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f0878-5731-4504-984e-6209ec6a4fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:08.619696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f0878-5731-4504-984e-6209ec6a4fac None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3c1f0878-5731-4504-984e-6209ec6a4fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:08.642243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:08.643290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:08.644251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:08.644251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:08.644251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:08.644251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:08.651745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 233/472] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:08.653761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059492-1560-49ac-929a-7ce1bf1e0714 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:08.654246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059492-1560-49ac-929a-7ce1bf1e0714 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:08.654697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059492-1560-49ac-929a-7ce1bf1e0714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:08.687163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-43059492-1560-49ac-929a-7ce1bf1e0714 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:08.689191 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-43059492-1560-49ac-929a-7ce1bf1e0714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:08.726183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb831115-2697-4158-9768-157b690e3281 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:08.774464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d8837-f3dd-4289-a0ef-ff3f055f1b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:08.775550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d8837-f3dd-4289-a0ef-ff3f055f1b65 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:08.776620 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d8837-f3dd-4289-a0ef-ff3f055f1b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:08.779722 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d8837-f3dd-4289-a0ef-ff3f055f1b65 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:08.783814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d8837-f3dd-4289-a0ef-ff3f055f1b65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:08.783814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d8837-f3dd-4289-a0ef-ff3f055f1b65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:08.784424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d8837-f3dd-4289-a0ef-ff3f055f1b65 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:08.816256 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 240/473] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:08.818085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d8837-f3dd-4289-a0ef-ff3f055f1b65 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:08.829125 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 234/474] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:08.830642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43059492-1560-49ac-929a-7ce1bf1e0714 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:08.968800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:08.996036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d8837-f3dd-4289-a0ef-ff3f055f1b65 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:09.015602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:09.068391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43059492-1560-49ac-929a-7ce1bf1e0714 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:09.075906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883886e-dd26-4183-81f8-bce811019149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:09.076927 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883886e-dd26-4183-81f8-bce811019149 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:09.077317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883886e-dd26-4183-81f8-bce811019149 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:09.077696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883886e-dd26-4183-81f8-bce811019149 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:09.078781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883886e-dd26-4183-81f8-bce811019149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:09.079226 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883886e-dd26-4183-81f8-bce811019149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:09.082078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883886e-dd26-4183-81f8-bce811019149 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:09.116546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 241/475] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:09.116546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883886e-dd26-4183-81f8-bce811019149 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:09.144754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217e439-706d-4e61-a200-9f93296fb03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:09.146688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217e439-706d-4e61-a200-9f93296fb03e None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:09.147435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217e439-706d-4e61-a200-9f93296fb03e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:09.148237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217e439-706d-4e61-a200-9f93296fb03e None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:09.149963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217e439-706d-4e61-a200-9f93296fb03e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:09.152481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217e439-706d-4e61-a200-9f93296fb03e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:09.192205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 235/476] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:13:08 2022] POST /identity/v3/users => generated 248 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:13:09.194593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217e439-706d-4e61-a200-9f93296fb03e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:09.401293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883886e-dd26-4183-81f8-bce811019149 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:09.445165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd4a74-69e8-46dd-b3a8-40fc16b7b3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:09.446331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd4a74-69e8-46dd-b3a8-40fc16b7b3a6 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:09.446834 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd4a74-69e8-46dd-b3a8-40fc16b7b3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:09.447300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd4a74-69e8-46dd-b3a8-40fc16b7b3a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:09.448306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd4a74-69e8-46dd-b3a8-40fc16b7b3a6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:09.450049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd4a74-69e8-46dd-b3a8-40fc16b7b3a6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:09.461072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.sql.core [None req-7ccd4a74-69e8-46dd-b3a8-40fc16b7b3a6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 08:13:09.461072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 08:13:09.461072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [parameters: {'id': '30af802d2f194a79af0c5e9c4d0b0ce0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 08:13:09.461072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80224) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-7ccd4a74-69e8-46dd-b3a8-40fc16b7b3a6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 21 08:13:09.494736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:13:09.496307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application yield resource Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise self.value Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application session.commit() Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 08:13:09.497273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.flush() Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application compat.raise_( Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 08:13:09.498271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:13:09.499229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:13:09.500161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [parameters: {'id': '30af802d2f194a79af0c5e9c4d0b0ce0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:09.502978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 08:13:09.505183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:09.509101 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 242/477] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 21 08:13:09 2022] POST /identity/v3/roles => generated 144 bytes in 395 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:09.515528 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd4a74-69e8-46dd-b3a8-40fc16b7b3a6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:09.532755 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217e439-706d-4e61-a200-9f93296fb03e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:09.554300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:09.586599 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:09.598260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea3cc0-6639-4785-9bfe-620e043146df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:09.599063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea3cc0-6639-4785-9bfe-620e043146df None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:09.599342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea3cc0-6639-4785-9bfe-620e043146df None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:09.599616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea3cc0-6639-4785-9bfe-620e043146df None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:09.600353 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea3cc0-6639-4785-9bfe-620e043146df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:09.603564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea3cc0-6639-4785-9bfe-620e043146df None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:09.634999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 236/478] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:13:09 2022] POST /identity/v3/users => generated 249 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:13:09.759693 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd4a74-69e8-46dd-b3a8-40fc16b7b3a6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:09.832727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641de2f4-87ff-4923-9104-d9ed8291c959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:09.834582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641de2f4-87ff-4923-9104-d9ed8291c959 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:09.835078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641de2f4-87ff-4923-9104-d9ed8291c959 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:09.835574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641de2f4-87ff-4923-9104-d9ed8291c959 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:09.854092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641de2f4-87ff-4923-9104-d9ed8291c959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-641de2f4-87ff-4923-9104-d9ed8291c959 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:09.862849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:09.863984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:09.864846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:09.864846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:09.864846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:09.864846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:09.864846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:09.864846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:09.864846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:09.864846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:09.864846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:09.864846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:09.864846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:13:09.864846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:09.866530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 243/479] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:13:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:09.871410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea3cc0-6639-4785-9bfe-620e043146df None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:10.110366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea3cc0-6639-4785-9bfe-620e043146df None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:10.180680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003324a-1871-46ae-a80e-ac60e22c6fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:10.181762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003324a-1871-46ae-a80e-ac60e22c6fdd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:10.182224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003324a-1871-46ae-a80e-ac60e22c6fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:10.182705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003324a-1871-46ae-a80e-ac60e22c6fdd None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:10.184160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003324a-1871-46ae-a80e-ac60e22c6fdd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:10.184721 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003324a-1871-46ae-a80e-ac60e22c6fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:10.187568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003324a-1871-46ae-a80e-ac60e22c6fdd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:10.204883 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 237/480] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:13:10.842349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1fffb-f412-456f-a310-3288e2c45ead None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:10.842919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1fffb-f412-456f-a310-3288e2c45ead None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:10.843316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1fffb-f412-456f-a310-3288e2c45ead None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:10.846625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 244/481] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:10.856721 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de842933-8925-40cf-8368-ba9a1208f4f5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:10.857266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de842933-8925-40cf-8368-ba9a1208f4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:10.857713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de842933-8925-40cf-8368-ba9a1208f4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:10.888036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-de842933-8925-40cf-8368-ba9a1208f4f5 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:10.890153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-de842933-8925-40cf-8368-ba9a1208f4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:10.989451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:11.040697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 238/482] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:13:11.072025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1fffb-f412-456f-a310-3288e2c45ead None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:11.244296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:11.306823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1fffb-f412-456f-a310-3288e2c45ead None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:11.374223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0aea1-9faa-47bf-a3fc-63b3abc7e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:11.375654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0aea1-9faa-47bf-a3fc-63b3abc7e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:11.376142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0aea1-9faa-47bf-a3fc-63b3abc7e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:11.376647 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0aea1-9faa-47bf-a3fc-63b3abc7e7d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:11.398259 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0aea1-9faa-47bf-a3fc-63b3abc7e7d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b3e0aea1-9faa-47bf-a3fc-63b3abc7e7d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:11.414068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:11.415028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:11.415798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:11.415798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:11.415798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:11.415798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:11.415798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:11.415798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:11.415798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:11.415798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:11.415798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:11.415798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:11.415798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:11.415798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:11.418155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 245/483] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:11.426485 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de842933-8925-40cf-8368-ba9a1208f4f5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:11.720940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de842933-8925-40cf-8368-ba9a1208f4f5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:11.809992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a25940-277d-4413-8c12-f65aa69c6cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:11.810689 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25940-277d-4413-8c12-f65aa69c6cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:11.810968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25940-277d-4413-8c12-f65aa69c6cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:11.811232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25940-277d-4413-8c12-f65aa69c6cc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:11.812003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a25940-277d-4413-8c12-f65aa69c6cc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:11.812302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a25940-277d-4413-8c12-f65aa69c6cc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:11.813794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a25940-277d-4413-8c12-f65aa69c6cc8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:11.824850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 239/484] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:11.831208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0aea1-9faa-47bf-a3fc-63b3abc7e7d4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:12.099811 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0aea1-9faa-47bf-a3fc-63b3abc7e7d4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:12.158061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:12.184825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28e1f1-ef05-4baf-9915-ffe6759e8a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:12.186633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28e1f1-ef05-4baf-9915-ffe6759e8a08 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:12.186868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc019f72-a9a2-4d43-9cff-8b0e6004433e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:12.187554 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc019f72-a9a2-4d43-9cff-8b0e6004433e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:12.187554 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc019f72-a9a2-4d43-9cff-8b0e6004433e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:12.188357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28e1f1-ef05-4baf-9915-ffe6759e8a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:12.189070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28e1f1-ef05-4baf-9915-ffe6759e8a08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:12.190073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 240/485] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:12.194910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91742c-8dd8-4b55-8794-a123fcff86fb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:12.195197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91742c-8dd8-4b55-8794-a123fcff86fb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:12.195502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91742c-8dd8-4b55-8794-a123fcff86fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:12.206219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28e1f1-ef05-4baf-9915-ffe6759e8a08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:12.207862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28e1f1-ef05-4baf-9915-ffe6759e8a08 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1c28e1f1-ef05-4baf-9915-ffe6759e8a08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:12.227645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:12.229366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:12.230993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:12.230993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:12.230993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:12.230993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:12.230993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 246/486] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:12.237690 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28e1f1-ef05-4baf-9915-ffe6759e8a08 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:12.242822 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9a91742c-8dd8-4b55-8794-a123fcff86fb None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:12.244046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9a91742c-8dd8-4b55-8794-a123fcff86fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:12.368024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:12.417196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28e1f1-ef05-4baf-9915-ffe6759e8a08 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:12.445618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 241/487] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:13:12.448648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de60a5f-bc77-4996-9ecf-2e0b25f1d7e2 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:12.449644 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de60a5f-bc77-4996-9ecf-2e0b25f1d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:12.450390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de60a5f-bc77-4996-9ecf-2e0b25f1d7e2 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:12.460120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 242/488] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:12.463031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b16eb-bd27-431a-ac15-3428d1831b33 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:12.463846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b16eb-bd27-431a-ac15-3428d1831b33 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:12.464658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b16eb-bd27-431a-ac15-3428d1831b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:12.469873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84128071-2597-45c0-bfd9-5fb8daf5a7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:12.472143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84128071-2597-45c0-bfd9-5fb8daf5a7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:12.474054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84128071-2597-45c0-bfd9-5fb8daf5a7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:12.476944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84128071-2597-45c0-bfd9-5fb8daf5a7c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:12.480042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84128071-2597-45c0-bfd9-5fb8daf5a7c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:12.480374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84128071-2597-45c0-bfd9-5fb8daf5a7c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:12.481879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84128071-2597-45c0-bfd9-5fb8daf5a7c3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:12.496286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 247/489] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:12.497243 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84128071-2597-45c0-bfd9-5fb8daf5a7c3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:12.502562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2e3b16eb-bd27-431a-ac15-3428d1831b33 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:12.505554 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2e3b16eb-bd27-431a-ac15-3428d1831b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:12.569170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:12.625117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84128071-2597-45c0-bfd9-5fb8daf5a7c3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:12.661022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 243/490] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:12.662948 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b16eb-bd27-431a-ac15-3428d1831b33 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:12.665369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c4cd3-9f29-467f-af7b-a1d4a7228e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:12.666333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c4cd3-9f29-467f-af7b-a1d4a7228e47 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:12.666623 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c4cd3-9f29-467f-af7b-a1d4a7228e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:12.666902 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c4cd3-9f29-467f-af7b-a1d4a7228e47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:12.681741 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c4cd3-9f29-467f-af7b-a1d4a7228e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-5f9c4cd3-9f29-467f-af7b-a1d4a7228e47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:12.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:12.692964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:12.694308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:12.694308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:12.694308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:12.694308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:12.694308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:12.694308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:12.694308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:12.694308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:12.694308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:12.694308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:12.694308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:12.694308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:12.700524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 248/491] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:12.700524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c4cd3-9f29-467f-af7b-a1d4a7228e47 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:12.823306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c4cd3-9f29-467f-af7b-a1d4a7228e47 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:12.825164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:12.865917 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a1311-3971-475d-aba8-b8aa5ee0390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:12.867276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a1311-3971-475d-aba8-b8aa5ee0390d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:12.867802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a1311-3971-475d-aba8-b8aa5ee0390d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:12.868302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a1311-3971-475d-aba8-b8aa5ee0390d None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:12.871915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a1311-3971-475d-aba8-b8aa5ee0390d None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:12.871915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a1311-3971-475d-aba8-b8aa5ee0390d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:12.872264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a1311-3971-475d-aba8-b8aa5ee0390d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:12.885141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 249/492] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:12.889394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a1311-3971-475d-aba8-b8aa5ee0390d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:12.902768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:12.908588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b16eb-bd27-431a-ac15-3428d1831b33 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:12.998559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e980fa-0462-42ac-a4a0-8c7d5eaa4a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:13.000899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e980fa-0462-42ac-a4a0-8c7d5eaa4a2d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:13.001686 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e980fa-0462-42ac-a4a0-8c7d5eaa4a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:13.002305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e980fa-0462-42ac-a4a0-8c7d5eaa4a2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:13.024851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a1311-3971-475d-aba8-b8aa5ee0390d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:13.026211 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e980fa-0462-42ac-a4a0-8c7d5eaa4a2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:13.029392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e980fa-0462-42ac-a4a0-8c7d5eaa4a2d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-04e980fa-0462-42ac-a4a0-8c7d5eaa4a2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:13.059906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:13.060922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:13.062164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:13.062164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:13.062164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:13.062164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:13.062164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:13.062164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:13.062164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:13.062164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:13.062164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:13:13.062164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:13.066041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 244/493] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 21 08:13:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:13.066041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e980fa-0462-42ac-a4a0-8c7d5eaa4a2d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:13.096755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95172740-72cd-41c7-bebc-7794898ea14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:13.098226 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95172740-72cd-41c7-bebc-7794898ea14a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:13.098708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95172740-72cd-41c7-bebc-7794898ea14a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:13.099327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95172740-72cd-41c7-bebc-7794898ea14a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:13.123039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95172740-72cd-41c7-bebc-7794898ea14a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-95172740-72cd-41c7-bebc-7794898ea14a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:13.142605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:13.144643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:13.146874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:13.146874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:13.146874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:13.146874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:13.146874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:13.146874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:13.146874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:13.146874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:13.146874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:13.146874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:13.146874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:13.146874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:13.152555 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 250/494] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:13.152555 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95172740-72cd-41c7-bebc-7794898ea14a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:13.191324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e980fa-0462-42ac-a4a0-8c7d5eaa4a2d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:13.210085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:13.234411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060cb23-474d-4e0b-993c-fa475478daa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:13.236210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060cb23-474d-4e0b-993c-fa475478daa7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:13.236833 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060cb23-474d-4e0b-993c-fa475478daa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:13.237310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060cb23-474d-4e0b-993c-fa475478daa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:13.250041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060cb23-474d-4e0b-993c-fa475478daa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:13.251952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060cb23-474d-4e0b-993c-fa475478daa7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4060cb23-474d-4e0b-993c-fa475478daa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:13.273804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:13.274702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:13.275531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:13.275531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:13.275531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:13.275531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:13.278814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 245/495] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:13.279989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060cb23-474d-4e0b-993c-fa475478daa7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:13.303031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:13.381771 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95172740-72cd-41c7-bebc-7794898ea14a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:13.418649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060cb23-474d-4e0b-993c-fa475478daa7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:13.425196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a49e9-c059-472a-bf82-8def7c1889be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:13.426077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a49e9-c059-472a-bf82-8def7c1889be None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:13.426368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a49e9-c059-472a-bf82-8def7c1889be None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:13.426828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a49e9-c059-472a-bf82-8def7c1889be None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:13.428227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a49e9-c059-472a-bf82-8def7c1889be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:13.428749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a49e9-c059-472a-bf82-8def7c1889be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:13.430322 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a49e9-c059-472a-bf82-8def7c1889be None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:13.463493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57f2d9-fe04-432c-b7fe-55f57dd77284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:13.464184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57f2d9-fe04-432c-b7fe-55f57dd77284 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:13.464466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57f2d9-fe04-432c-b7fe-55f57dd77284 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:13.464827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57f2d9-fe04-432c-b7fe-55f57dd77284 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:13.465597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57f2d9-fe04-432c-b7fe-55f57dd77284 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:13.465892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57f2d9-fe04-432c-b7fe-55f57dd77284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:13.467346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57f2d9-fe04-432c-b7fe-55f57dd77284 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:13.481111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 251/496] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 21 08:13:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:13.481111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a49e9-c059-472a-bf82-8def7c1889be None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:13.481525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 246/497] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:13.481525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e5a6c-839f-44b5-b5ed-447855c21ade None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:13.481525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e5a6c-839f-44b5-b5ed-447855c21ade None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:13.481525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e5a6c-839f-44b5-b5ed-447855c21ade None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:13.481525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 247/498] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:13.485460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e5a6c-839f-44b5-b5ed-447855c21ade None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:13.582391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:13.604544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:13.617005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e5a6c-839f-44b5-b5ed-447855c21ade None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:13.640326 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a49e9-c059-472a-bf82-8def7c1889be None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:13.658982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c34253-82e4-4ec1-981d-090c0c6bcf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:13.659879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c34253-82e4-4ec1-981d-090c0c6bcf44 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:13.660178 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c34253-82e4-4ec1-981d-090c0c6bcf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:13.660640 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c34253-82e4-4ec1-981d-090c0c6bcf44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:13.673090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c34253-82e4-4ec1-981d-090c0c6bcf44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:13.674505 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c34253-82e4-4ec1-981d-090c0c6bcf44 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:13.693961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d259f-0626-49fd-ad87-65a4ccf27467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:13.694651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d259f-0626-49fd-ad87-65a4ccf27467 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:13.694926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d259f-0626-49fd-ad87-65a4ccf27467 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:13.695194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d259f-0626-49fd-ad87-65a4ccf27467 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:13.695937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d259f-0626-49fd-ad87-65a4ccf27467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:13.696233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d259f-0626-49fd-ad87-65a4ccf27467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:13.697718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d259f-0626-49fd-ad87-65a4ccf27467 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d2c34253-82e4-4ec1-981d-090c0c6bcf44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:13.703095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:13.704297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:13.705188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:13.705188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:13.705188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:13.705188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:13.706786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 248/499] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:13.706973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c34253-82e4-4ec1-981d-090c0c6bcf44 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:13.715803 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 252/500] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:13.717632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d989bd1-b7b0-4f3a-9e06-eb4511ea01fd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:13.718137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d989bd1-b7b0-4f3a-9e06-eb4511ea01fd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:13.718613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d989bd1-b7b0-4f3a-9e06-eb4511ea01fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:13.737829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9d989bd1-b7b0-4f3a-9e06-eb4511ea01fd None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:13.739144 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9d989bd1-b7b0-4f3a-9e06-eb4511ea01fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:13.832623 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 253/501] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:13.834423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d989bd1-b7b0-4f3a-9e06-eb4511ea01fd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:13.868088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c34253-82e4-4ec1-981d-090c0c6bcf44 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:13.901144 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:13.913744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2cab7-c051-45bf-abae-2b5aadbbdacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:13.914414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2cab7-c051-45bf-abae-2b5aadbbdacc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:13.914701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2cab7-c051-45bf-abae-2b5aadbbdacc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:13.914974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2cab7-c051-45bf-abae-2b5aadbbdacc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:13.963077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:14.002899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2cab7-c051-45bf-abae-2b5aadbbdacc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:14.004042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d989bd1-b7b0-4f3a-9e06-eb4511ea01fd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:14.004739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2cab7-c051-45bf-abae-2b5aadbbdacc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:14.057003 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6457ad-6211-477d-85d2-66b9897366a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:14.057892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6457ad-6211-477d-85d2-66b9897366a4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:14.058325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6457ad-6211-477d-85d2-66b9897366a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:14.058738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6457ad-6211-477d-85d2-66b9897366a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:14.059672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6457ad-6211-477d-85d2-66b9897366a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:14.060110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6457ad-6211-477d-85d2-66b9897366a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:14.062517 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6457ad-6211-477d-85d2-66b9897366a4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:14.087934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 254/502] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:14.087934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6457ad-6211-477d-85d2-66b9897366a4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:14.170403 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 249/503] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:14.171337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2cab7-c051-45bf-abae-2b5aadbbdacc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:14.210806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:14.245530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6457ad-6211-477d-85d2-66b9897366a4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:14.282009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:14.289488 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fce02-3c50-42bb-8aeb-930b3b567bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:14.290554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fce02-3c50-42bb-8aeb-930b3b567bfe None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:14.290991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fce02-3c50-42bb-8aeb-930b3b567bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:14.291449 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fce02-3c50-42bb-8aeb-930b3b567bfe None admin] PATH_INFO: `/v3/users/glance` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:14.305034 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fce02-3c50-42bb-8aeb-930b3b567bfe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:14.307446 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fce02-3c50-42bb-8aeb-930b3b567bfe None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:14.322033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2cab7-c051-45bf-abae-2b5aadbbdacc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-199fce02-3c50-42bb-8aeb-930b3b567bfe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:14.330066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:14.331869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:14.333661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:14.333661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:14.333661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:14.333661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:14.333661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:14.333661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:14.333661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:14.333661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:14.333661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:13:14.333661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:14.336530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 255/504] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:14.337647 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fce02-3c50-42bb-8aeb-930b3b567bfe None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:14.374170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad59ea-04b6-4dce-9aef-f9ecbaee404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:14.375480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad59ea-04b6-4dce-9aef-f9ecbaee404a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:14.375932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad59ea-04b6-4dce-9aef-f9ecbaee404a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:14.376438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad59ea-04b6-4dce-9aef-f9ecbaee404a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:14.391772 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad59ea-04b6-4dce-9aef-f9ecbaee404a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c2ad59ea-04b6-4dce-9aef-f9ecbaee404a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:14.402949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:14.404725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:14.406273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 250/505] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:14.410357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad59ea-04b6-4dce-9aef-f9ecbaee404a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:14.494087 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fce02-3c50-42bb-8aeb-930b3b567bfe None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:14.535627 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cc444-aaab-43da-ad62-a346263498d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:14.536385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cc444-aaab-43da-ad62-a346263498d2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:14.536700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cc444-aaab-43da-ad62-a346263498d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:14.536974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cc444-aaab-43da-ad62-a346263498d2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:14.546395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cc444-aaab-43da-ad62-a346263498d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:14.547924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cc444-aaab-43da-ad62-a346263498d2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:14.548706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-874cc444-aaab-43da-ad62-a346263498d2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:14.564411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:14.566276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:14.567730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:14.567730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:14.567730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:14.567730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:14.567730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:14.567730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:14.567730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:14.567730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:14.567730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:13:14.567730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:14.567730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 256/506] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:14.567730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cc444-aaab-43da-ad62-a346263498d2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:14.577442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad59ea-04b6-4dce-9aef-f9ecbaee404a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:14.633141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:14.633942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fedab-1fb5-483e-9831-359946efff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:14.635375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fedab-1fb5-483e-9831-359946efff60 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:14.635856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fedab-1fb5-483e-9831-359946efff60 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:14.636254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fedab-1fb5-483e-9831-359946efff60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:14.654462 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fedab-1fb5-483e-9831-359946efff60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:14.657316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fedab-1fb5-483e-9831-359946efff60 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2d8fedab-1fb5-483e-9831-359946efff60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:14.686781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:14.687888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:14.688890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:14.688890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:14.688890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:14.688890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:14.690785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cc444-aaab-43da-ad62-a346263498d2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:14.692989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 251/507] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:14.694064 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fedab-1fb5-483e-9831-359946efff60 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:14.735911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447966d-e76c-4bcf-a28c-61f02a7c6754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:14.737310 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447966d-e76c-4bcf-a28c-61f02a7c6754 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:14.737817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447966d-e76c-4bcf-a28c-61f02a7c6754 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:14.738160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447966d-e76c-4bcf-a28c-61f02a7c6754 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:14.739812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447966d-e76c-4bcf-a28c-61f02a7c6754 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:14.740359 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447966d-e76c-4bcf-a28c-61f02a7c6754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:14.743163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447966d-e76c-4bcf-a28c-61f02a7c6754 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:14.775746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 257/508] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 21 08:13:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:14.777565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574911-a130-4eb9-a032-783c834b17b6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:14.778290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574911-a130-4eb9-a032-783c834b17b6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:14.778549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574911-a130-4eb9-a032-783c834b17b6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:14.780557 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 258/509] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:14.781866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59574911-a130-4eb9-a032-783c834b17b6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:14.835116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fedab-1fb5-483e-9831-359946efff60 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:14.875793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506ad36-0f0e-416a-a002-65558a69795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:14.876484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506ad36-0f0e-416a-a002-65558a69795b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:14.876790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506ad36-0f0e-416a-a002-65558a69795b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:14.877062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506ad36-0f0e-416a-a002-65558a69795b None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:14.877833 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506ad36-0f0e-416a-a002-65558a69795b None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:14.878141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506ad36-0f0e-416a-a002-65558a69795b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:14.879861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506ad36-0f0e-416a-a002-65558a69795b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:14.885974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:14.889789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 252/510] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:14.890894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506ad36-0f0e-416a-a002-65558a69795b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:14.943975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59574911-a130-4eb9-a032-783c834b17b6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:14.957388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:14.989231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5959c89-76ca-43f4-9da7-c03eda35d256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:14.989932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5959c89-76ca-43f4-9da7-c03eda35d256 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:14.990213 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5959c89-76ca-43f4-9da7-c03eda35d256 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:14.990487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5959c89-76ca-43f4-9da7-c03eda35d256 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:14.991357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5959c89-76ca-43f4-9da7-c03eda35d256 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:14.991666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5959c89-76ca-43f4-9da7-c03eda35d256 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:14.993221 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5959c89-76ca-43f4-9da7-c03eda35d256 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:15.015294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 259/511] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 21 08:13:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:15.016195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5959c89-76ca-43f4-9da7-c03eda35d256 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:15.032968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506ad36-0f0e-416a-a002-65558a69795b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:15.087187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3684c68-6b67-4b63-ba23-605328873db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:15.087880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3684c68-6b67-4b63-ba23-605328873db5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:15.088429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3684c68-6b67-4b63-ba23-605328873db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:15.088635 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3684c68-6b67-4b63-ba23-605328873db5 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:15.089564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3684c68-6b67-4b63-ba23-605328873db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:15.089992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3684c68-6b67-4b63-ba23-605328873db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:15.091584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3684c68-6b67-4b63-ba23-605328873db5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:15.113793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 253/512] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:15.113793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a5606-d5ee-48ba-acb3-c65ac68226e9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:15.113793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a5606-d5ee-48ba-acb3-c65ac68226e9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:15.113793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a5606-d5ee-48ba-acb3-c65ac68226e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:15.137340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-645a5606-d5ee-48ba-acb3-c65ac68226e9 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:15.139306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-645a5606-d5ee-48ba-acb3-c65ac68226e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:15.178874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5959c89-76ca-43f4-9da7-c03eda35d256 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:15.235439 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:15.237219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f9824-009c-44a2-837d-a8834496127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:15.238195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9824-009c-44a2-837d-a8834496127b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:15.238683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9824-009c-44a2-837d-a8834496127b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:15.239146 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9824-009c-44a2-837d-a8834496127b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:15.253672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 254/513] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:15.254969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a5606-d5ee-48ba-acb3-c65ac68226e9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:15.290229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:15.351996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f9824-009c-44a2-837d-a8834496127b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:15.354227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f9824-009c-44a2-837d-a8834496127b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:15.397285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a5606-d5ee-48ba-acb3-c65ac68226e9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:15.438169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4598c1-6131-449f-b59b-f53484fad998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:15.438997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4598c1-6131-449f-b59b-f53484fad998 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:15.439274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4598c1-6131-449f-b59b-f53484fad998 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:15.439546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4598c1-6131-449f-b59b-f53484fad998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:15.451340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4598c1-6131-449f-b59b-f53484fad998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:15.452917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4598c1-6131-449f-b59b-f53484fad998 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4a4598c1-6131-449f-b59b-f53484fad998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:15.472632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:15.473674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:15.475044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:15.475044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:15.475044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:15.475044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:15.475044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 255/514] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:15.475044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4598c1-6131-449f-b59b-f53484fad998 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:15.511095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 260/515] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:15.512932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f9824-009c-44a2-837d-a8834496127b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:15.551035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:15.621483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:15.638076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4598c1-6131-449f-b59b-f53484fad998 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:15.665702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f9824-009c-44a2-837d-a8834496127b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:15.685674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4a5f-db2b-4e37-b517-f61f150993ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:15.686434 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4a5f-db2b-4e37-b517-f61f150993ee None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:15.686780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4a5f-db2b-4e37-b517-f61f150993ee None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:15.687118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4a5f-db2b-4e37-b517-f61f150993ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:15.715038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9d04e-9e32-48b3-98f9-9c256872a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:15.715887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9d04e-9e32-48b3-98f9-9c256872a610 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:15.716184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9d04e-9e32-48b3-98f9-9c256872a610 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:15.716415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9d04e-9e32-48b3-98f9-9c256872a610 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:15.724885 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9d04e-9e32-48b3-98f9-9c256872a610 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:15.726410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9d04e-9e32-48b3-98f9-9c256872a610 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6dc9d04e-9e32-48b3-98f9-9c256872a610 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:15.742155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:15.743932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:15.745573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:15.745573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:15.745573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:15.745573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:15.745573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:15.745573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:15.745573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:15.745573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:15.745573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 261/516] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:15.745573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9d04e-9e32-48b3-98f9-9c256872a610 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:15.804930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f4a5f-db2b-4e37-b517-f61f150993ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:15.807723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f4a5f-db2b-4e37-b517-f61f150993ee None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:15.869882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9d04e-9e32-48b3-98f9-9c256872a610 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:15.889568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:15.903302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:15.915067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626e991-3dcd-44c7-81d3-779606b60e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:15.915965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626e991-3dcd-44c7-81d3-779606b60e65 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:15.916372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626e991-3dcd-44c7-81d3-779606b60e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:15.916882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626e991-3dcd-44c7-81d3-779606b60e65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:15.932799 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626e991-3dcd-44c7-81d3-779606b60e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:15.934565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626e991-3dcd-44c7-81d3-779606b60e65 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e626e991-3dcd-44c7-81d3-779606b60e65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:15.955442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:15.957501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:15.967686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:15.967686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:15.967686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:15.967686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:15.967686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 262/517] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:15.967686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626e991-3dcd-44c7-81d3-779606b60e65 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:15.979134 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 256/518] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:15.980612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4a5f-db2b-4e37-b517-f61f150993ee None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:16.091980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626e991-3dcd-44c7-81d3-779606b60e65 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:16.111902 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4a5f-db2b-4e37-b517-f61f150993ee None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:16.151706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a735a-f485-4890-9bb3-df0f8e224ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:16.152433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a735a-f485-4890-9bb3-df0f8e224ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:16.152745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a735a-f485-4890-9bb3-df0f8e224ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:16.153019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a735a-f485-4890-9bb3-df0f8e224ba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:16.153388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071688bf-8269-4499-9027-9152c20fa50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:16.154537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071688bf-8269-4499-9027-9152c20fa50d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:16.155044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071688bf-8269-4499-9027-9152c20fa50d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:16.155548 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071688bf-8269-4499-9027-9152c20fa50d None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:16.156942 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071688bf-8269-4499-9027-9152c20fa50d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:16.157502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071688bf-8269-4499-9027-9152c20fa50d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:16.160148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071688bf-8269-4499-9027-9152c20fa50d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:16.165264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a735a-f485-4890-9bb3-df0f8e224ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:16.166764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a735a-f485-4890-9bb3-df0f8e224ba4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:16.168841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:16.185399 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 263/519] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:16.186473 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071688bf-8269-4499-9027-9152c20fa50d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-616a735a-f485-4890-9bb3-df0f8e224ba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:16.187510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:16.194771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:16.196804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:16.196804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:16.196804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:16.196804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:16.196804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 257/520] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:16.196804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a735a-f485-4890-9bb3-df0f8e224ba4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:16.245737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:16.319587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071688bf-8269-4499-9027-9152c20fa50d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:16.364730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a735a-f485-4890-9bb3-df0f8e224ba4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:16.365306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6fea6-7d12-429e-8f44-27a0d06a10f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:16.365963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6fea6-7d12-429e-8f44-27a0d06a10f5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:16.366449 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6fea6-7d12-429e-8f44-27a0d06a10f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:16.366937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6fea6-7d12-429e-8f44-27a0d06a10f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:16.368473 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6fea6-7d12-429e-8f44-27a0d06a10f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:16.369041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6fea6-7d12-429e-8f44-27a0d06a10f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:16.371546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6fea6-7d12-429e-8f44-27a0d06a10f5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:16.398199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 264/521] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:16.399092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6fea6-7d12-429e-8f44-27a0d06a10f5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:16.426658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103d071-dafb-46b7-8e99-203f4d78b466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:16.427706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103d071-dafb-46b7-8e99-203f4d78b466 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:16.428183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103d071-dafb-46b7-8e99-203f4d78b466 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:16.428724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103d071-dafb-46b7-8e99-203f4d78b466 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:16.430122 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103d071-dafb-46b7-8e99-203f4d78b466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:16.430674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103d071-dafb-46b7-8e99-203f4d78b466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:16.433356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103d071-dafb-46b7-8e99-203f4d78b466 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:16.455320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 258/522] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:16.456888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103d071-dafb-46b7-8e99-203f4d78b466 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:16.515443 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:16.518534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6fea6-7d12-429e-8f44-27a0d06a10f5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:16.559713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:16.561302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b08d2-a9d9-4009-91e1-7b9a06241b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:16.562207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b08d2-a9d9-4009-91e1-7b9a06241b16 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:16.562502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b08d2-a9d9-4009-91e1-7b9a06241b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:16.562687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b08d2-a9d9-4009-91e1-7b9a06241b16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:16.576195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b08d2-a9d9-4009-91e1-7b9a06241b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:16.577883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b08d2-a9d9-4009-91e1-7b9a06241b16 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-805b08d2-a9d9-4009-91e1-7b9a06241b16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:16.597916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:16.599593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:16.603014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:16.603014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:16.603014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:16.603014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:16.603014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 265/523] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:16.603014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b08d2-a9d9-4009-91e1-7b9a06241b16 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:16.627314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103d071-dafb-46b7-8e99-203f4d78b466 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:16.670303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4d24d-bc16-4327-a721-38ade1057f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:16.671133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4d24d-bc16-4327-a721-38ade1057f18 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:16.671422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4d24d-bc16-4327-a721-38ade1057f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:16.671690 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4d24d-bc16-4327-a721-38ade1057f18 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:16.680959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4d24d-bc16-4327-a721-38ade1057f18 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:16.682368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4d24d-bc16-4327-a721-38ade1057f18 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ded4d24d-bc16-4327-a721-38ade1057f18 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:16.698100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:16.699796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:16.702276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:16.702276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:16.702276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:16.702276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:16.702276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:16.702276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:16.702276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:16.702276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:16.702276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:13:16.702276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:16.702276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 259/524] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:16.702276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4d24d-bc16-4327-a721-38ade1057f18 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:16.768868 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b08d2-a9d9-4009-91e1-7b9a06241b16 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:16.808593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84401912-e2ff-4b37-8722-48d73d1c105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:16.809274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84401912-e2ff-4b37-8722-48d73d1c105e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:16.809549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84401912-e2ff-4b37-8722-48d73d1c105e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:16.809817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84401912-e2ff-4b37-8722-48d73d1c105e None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:16.810565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84401912-e2ff-4b37-8722-48d73d1c105e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:16.810876 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84401912-e2ff-4b37-8722-48d73d1c105e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:16.812354 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84401912-e2ff-4b37-8722-48d73d1c105e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:16.828257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 266/525] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:16.829177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84401912-e2ff-4b37-8722-48d73d1c105e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:16.839777 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4d24d-bc16-4327-a721-38ade1057f18 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:16.856946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:16.857485 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:16.894516 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa9dc5-8c9e-4c13-9ae6-7fff0c4edd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:16.896201 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa9dc5-8c9e-4c13-9ae6-7fff0c4edd99 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:16.896804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa9dc5-8c9e-4c13-9ae6-7fff0c4edd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:16.897338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa9dc5-8c9e-4c13-9ae6-7fff0c4edd99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:16.899053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa9dc5-8c9e-4c13-9ae6-7fff0c4edd99 None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=421f05e3d10e4393b28f77b6179ade8c) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:16.899657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa9dc5-8c9e-4c13-9ae6-7fff0c4edd99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:16.902592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa9dc5-8c9e-4c13-9ae6-7fff0c4edd99 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:16.912302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 260/526] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:16 2022] GET /identity/v3/role_assignments?user.id=421f05e3d10e4393b28f77b6179ade8c&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:16.914179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa9dc5-8c9e-4c13-9ae6-7fff0c4edd99 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:16.977582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84401912-e2ff-4b37-8722-48d73d1c105e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:17.020909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4536409-7c80-4968-bff2-09c12b5813d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:17.021610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4536409-7c80-4968-bff2-09c12b5813d8 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:17.021888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4536409-7c80-4968-bff2-09c12b5813d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:17.022161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4536409-7c80-4968-bff2-09c12b5813d8 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:17.022967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4536409-7c80-4968-bff2-09c12b5813d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:17.024549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4536409-7c80-4968-bff2-09c12b5813d8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:17.060536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 267/527] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:13:16 2022] POST /identity/v3/users => generated 247 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:13:17.060536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4536409-7c80-4968-bff2-09c12b5813d8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:17.093809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa9dc5-8c9e-4c13-9ae6-7fff0c4edd99 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:17.159503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:17.201311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0926b-2ffa-4727-8577-de8062e95d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:17.202015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0926b-2ffa-4727-8577-de8062e95d05 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:17.202295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0926b-2ffa-4727-8577-de8062e95d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:17.202569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0926b-2ffa-4727-8577-de8062e95d05 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:17.203343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0926b-2ffa-4727-8577-de8062e95d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:17.203648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0926b-2ffa-4727-8577-de8062e95d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:17.205209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0926b-2ffa-4727-8577-de8062e95d05 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:17.222565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4536409-7c80-4968-bff2-09c12b5813d8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:17.225869 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 261/528] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:17.226928 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0926b-2ffa-4727-8577-de8062e95d05 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:17.283884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:17.295164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3da2a4-a103-49c3-acd4-6dcb0db1e66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:17.295992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3da2a4-a103-49c3-acd4-6dcb0db1e66b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:17.297174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3da2a4-a103-49c3-acd4-6dcb0db1e66b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:17.297174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3da2a4-a103-49c3-acd4-6dcb0db1e66b None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:17.299352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3da2a4-a103-49c3-acd4-6dcb0db1e66b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:17.299352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3da2a4-a103-49c3-acd4-6dcb0db1e66b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:17.299564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3da2a4-a103-49c3-acd4-6dcb0db1e66b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:17.330279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 268/529] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Jul 21 08:13:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:17.332213 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3da2a4-a103-49c3-acd4-6dcb0db1e66b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:17.426381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0926b-2ffa-4727-8577-de8062e95d05 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:17.488247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a9d0e-d163-46b9-b8a4-4c835804d154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:17.489365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a9d0e-d163-46b9-b8a4-4c835804d154 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:17.489718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a9d0e-d163-46b9-b8a4-4c835804d154 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:17.490056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a9d0e-d163-46b9-b8a4-4c835804d154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:17.498629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a9d0e-d163-46b9-b8a4-4c835804d154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:17.500351 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a9d0e-d163-46b9-b8a4-4c835804d154 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-764a9d0e-d163-46b9-b8a4-4c835804d154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:17.517621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:17.519188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:17.522519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:17.522519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:17.522519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:17.522519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:17.522519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:17.522519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:17.522519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:17.522519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:17.522519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 262/530] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:17.522519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a9d0e-d163-46b9-b8a4-4c835804d154 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:17.540920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3da2a4-a103-49c3-acd4-6dcb0db1e66b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:17.603556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:17.619633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d36f07-1506-483a-a3e1-d4cca487798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:17.621081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d36f07-1506-483a-a3e1-d4cca487798e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:17.621546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d36f07-1506-483a-a3e1-d4cca487798e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:17.622002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d36f07-1506-483a-a3e1-d4cca487798e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:17.635495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d36f07-1506-483a-a3e1-d4cca487798e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:17.638312 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d36f07-1506-483a-a3e1-d4cca487798e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-73d36f07-1506-483a-a3e1-d4cca487798e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:17.665930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:17.667572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:17.669204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:17.669204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:17.669204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:17.669204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:17.669204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:17.669204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:17.669204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:17.669204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:17.674244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 269/531] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:17.675925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d36f07-1506-483a-a3e1-d4cca487798e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:17.714452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:17.723001 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a9d0e-d163-46b9-b8a4-4c835804d154 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:17.789391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9b2e4-c755-40e7-a004-f7a471cb7652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:17.790595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9b2e4-c755-40e7-a004-f7a471cb7652 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:17.791170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9b2e4-c755-40e7-a004-f7a471cb7652 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:17.791614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9b2e4-c755-40e7-a004-f7a471cb7652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:17.904208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d36f07-1506-483a-a3e1-d4cca487798e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:17.935913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9b2e4-c755-40e7-a004-f7a471cb7652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:17.938730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9b2e4-c755-40e7-a004-f7a471cb7652 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:17.983763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a59a2-d661-4fbf-9af2-e9ec4ab3cb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:17.985477 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a59a2-d661-4fbf-9af2-e9ec4ab3cb6a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:17.985954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a59a2-d661-4fbf-9af2-e9ec4ab3cb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:17.986389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a59a2-d661-4fbf-9af2-e9ec4ab3cb6a None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:17.987363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a59a2-d661-4fbf-9af2-e9ec4ab3cb6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:17.988136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a59a2-d661-4fbf-9af2-e9ec4ab3cb6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:17.990001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a59a2-d661-4fbf-9af2-e9ec4ab3cb6a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:18.010927 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 270/532] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:18.012117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a59a2-d661-4fbf-9af2-e9ec4ab3cb6a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:18.079947 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:18.133260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:18.141891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 263/533] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:18.143674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9b2e4-c755-40e7-a004-f7a471cb7652 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:18.176329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a59a2-d661-4fbf-9af2-e9ec4ab3cb6a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:18.224213 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b954390-acc3-4fcc-a1d2-78cb4dc42c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:18.225073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b954390-acc3-4fcc-a1d2-78cb4dc42c89 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:18.225457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b954390-acc3-4fcc-a1d2-78cb4dc42c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:18.225831 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b954390-acc3-4fcc-a1d2-78cb4dc42c89 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:18.227100 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b954390-acc3-4fcc-a1d2-78cb4dc42c89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:18.227529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b954390-acc3-4fcc-a1d2-78cb4dc42c89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:18.229940 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b954390-acc3-4fcc-a1d2-78cb4dc42c89 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:18.259137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 271/534] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:18.261132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b954390-acc3-4fcc-a1d2-78cb4dc42c89 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:18.330231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9b2e4-c755-40e7-a004-f7a471cb7652 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:18.379188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ef38b-253f-4a6e-8ee0-0249ee0e57a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:18.380329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ef38b-253f-4a6e-8ee0-0249ee0e57a5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:18.380756 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ef38b-253f-4a6e-8ee0-0249ee0e57a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:18.381140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ef38b-253f-4a6e-8ee0-0249ee0e57a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:18.382134 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ef38b-253f-4a6e-8ee0-0249ee0e57a5 None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=f4f9a6f6d6d840d6bc29fd0ab26ddb29) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:18.382629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ef38b-253f-4a6e-8ee0-0249ee0e57a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:18.385175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ef38b-253f-4a6e-8ee0-0249ee0e57a5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:18.393565 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 264/535] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:18 2022] GET /identity/v3/role_assignments?user.id=f4f9a6f6d6d840d6bc29fd0ab26ddb29&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:18.394479 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ef38b-253f-4a6e-8ee0-0249ee0e57a5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:18.479787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b954390-acc3-4fcc-a1d2-78cb4dc42c89 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:18.482286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:18.504353 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:18.571187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ef38b-253f-4a6e-8ee0-0249ee0e57a5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:18.577053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12de3f-249e-4611-8451-430546461646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:18.577053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12de3f-249e-4611-8451-430546461646 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:18.577053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12de3f-249e-4611-8451-430546461646 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:18.577053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12de3f-249e-4611-8451-430546461646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:18.590881 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12de3f-249e-4611-8451-430546461646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:18.593396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12de3f-249e-4611-8451-430546461646 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2b12de3f-249e-4611-8451-430546461646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:18.617152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:18.620139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:18.621968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:18.621968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:18.621968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:18.621968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:18.622721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 272/536] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:18.628376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12de3f-249e-4611-8451-430546461646 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:18.669176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c782bad-a2d3-4bf6-bce3-142f7489916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:18.670735 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c782bad-a2d3-4bf6-bce3-142f7489916f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:18.671255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c782bad-a2d3-4bf6-bce3-142f7489916f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:18.671913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c782bad-a2d3-4bf6-bce3-142f7489916f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:18.674753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c782bad-a2d3-4bf6-bce3-142f7489916f None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=8e44cec1e8ee4c82b104cf64ae0de6d6) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:18.675680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c782bad-a2d3-4bf6-bce3-142f7489916f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:18.679145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c782bad-a2d3-4bf6-bce3-142f7489916f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:18.691088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 265/537] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:18 2022] GET /identity/v3/role_assignments?user.id=8e44cec1e8ee4c82b104cf64ae0de6d6&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:18.794683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12de3f-249e-4611-8451-430546461646 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:18.858720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550092f-9013-4606-abea-5854b8beb857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:18.859386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550092f-9013-4606-abea-5854b8beb857 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:18.859669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550092f-9013-4606-abea-5854b8beb857 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:18.859940 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550092f-9013-4606-abea-5854b8beb857 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:18.860734 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550092f-9013-4606-abea-5854b8beb857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:18.861046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550092f-9013-4606-abea-5854b8beb857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:18.862511 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550092f-9013-4606-abea-5854b8beb857 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:18.881474 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 273/538] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:13:18.887343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c782bad-a2d3-4bf6-bce3-142f7489916f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:19.039744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c782bad-a2d3-4bf6-bce3-142f7489916f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:19.073159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:19.081780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a26a4-5303-4e6c-a505-b399b28a8254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:19.082677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a26a4-5303-4e6c-a505-b399b28a8254 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:19.082966 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a26a4-5303-4e6c-a505-b399b28a8254 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:19.083239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a26a4-5303-4e6c-a505-b399b28a8254 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:19.091289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a26a4-5303-4e6c-a505-b399b28a8254 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:19.092836 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a26a4-5303-4e6c-a505-b399b28a8254 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-bb2a26a4-5303-4e6c-a505-b399b28a8254 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:19.109136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:19.110652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:19.112791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:19.112791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:19.112791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:19.112791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:19.112791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:19.112791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:19.112791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:19.112791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:19.112791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 266/539] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:19.121739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550092f-9013-4606-abea-5854b8beb857 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:19.166147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:19.365954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550092f-9013-4606-abea-5854b8beb857 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:19.458894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dc81b-d70a-466a-a43c-729362d426d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:19.460089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dc81b-d70a-466a-a43c-729362d426d4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:19.460616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dc81b-d70a-466a-a43c-729362d426d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:19.461116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dc81b-d70a-466a-a43c-729362d426d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:19.462709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dc81b-d70a-466a-a43c-729362d426d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:19.463273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dc81b-d70a-466a-a43c-729362d426d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:19.466122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dc81b-d70a-466a-a43c-729362d426d4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:19.490187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 274/540] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:19.495832 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a26a4-5303-4e6c-a505-b399b28a8254 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:19.623958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a26a4-5303-4e6c-a505-b399b28a8254 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:19.686792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8c508-3165-4645-92e2-2591f555c691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:19.688304 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8c508-3165-4645-92e2-2591f555c691 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:19.689001 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8c508-3165-4645-92e2-2591f555c691 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:19.689571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8c508-3165-4645-92e2-2591f555c691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:19.691264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8c508-3165-4645-92e2-2591f555c691 None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=06a267cec6fb4dbea619f0a77b5674dc) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:19.692212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8c508-3165-4645-92e2-2591f555c691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:19.702700 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8c508-3165-4645-92e2-2591f555c691 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:19.721992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 267/541] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:19 2022] GET /identity/v3/role_assignments?user.id=06a267cec6fb4dbea619f0a77b5674dc&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:20.026270 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca048bf-9b06-4234-a346-2fbca831dfa0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:20.026551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca048bf-9b06-4234-a346-2fbca831dfa0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:20.027009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca048bf-9b06-4234-a346-2fbca831dfa0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:20.028746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 275/542] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:20.034600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83f99d-d614-4f8d-9bae-f156fb565451 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:20.034867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83f99d-d614-4f8d-9bae-f156fb565451 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:20.035218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83f99d-d614-4f8d-9bae-f156fb565451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:20.065334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-df83f99d-d614-4f8d-9bae-f156fb565451 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:20.066636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-df83f99d-d614-4f8d-9bae-f156fb565451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:20.147050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:20.182928 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 268/543] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:13:20.217713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca048bf-9b06-4234-a346-2fbca831dfa0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:20.280804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4bb78-666a-41c4-b1bf-f996ab0295b0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:20.281372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4bb78-666a-41c4-b1bf-f996ab0295b0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:20.281841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4bb78-666a-41c4-b1bf-f996ab0295b0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:20.284582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 269/544] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:13:20.292112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011398d-72f6-49b6-a6ab-31f2526ffc83 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:20.292671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011398d-72f6-49b6-a6ab-31f2526ffc83 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:20.293104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011398d-72f6-49b6-a6ab-31f2526ffc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:20.335498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b011398d-72f6-49b6-a6ab-31f2526ffc83 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:20.337143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b011398d-72f6-49b6-a6ab-31f2526ffc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:20.338788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:20.400146 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca048bf-9b06-4234-a346-2fbca831dfa0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:20.455320 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde13ec4-6f66-4bd7-86ec-61da031492a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:20.456471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde13ec4-6f66-4bd7-86ec-61da031492a5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:20.456961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde13ec4-6f66-4bd7-86ec-61da031492a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:20.457485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde13ec4-6f66-4bd7-86ec-61da031492a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:20.470717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde13ec4-6f66-4bd7-86ec-61da031492a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-cde13ec4-6f66-4bd7-86ec-61da031492a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:20.479234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:20.480177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:20.480994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:20.480994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:20.480994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:20.480994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:20.480994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:20.480994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:20.480994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:20.480994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:20.480994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:20.480994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:20.480994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:20.480994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:20.492524 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 270/546] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:20.493002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 276/546] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:20.498992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011398d-72f6-49b6-a6ab-31f2526ffc83 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:20.514215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde13ec4-6f66-4bd7-86ec-61da031492a5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:20.667611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011398d-72f6-49b6-a6ab-31f2526ffc83 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:20.679284 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde13ec4-6f66-4bd7-86ec-61da031492a5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:20.697238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:20.709553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22ae27-1f36-4c20-bba1-01fe913c2bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:20.710452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22ae27-1f36-4c20-bba1-01fe913c2bfc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:20.710748 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22ae27-1f36-4c20-bba1-01fe913c2bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:20.711037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22ae27-1f36-4c20-bba1-01fe913c2bfc None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:20.711826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22ae27-1f36-4c20-bba1-01fe913c2bfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:20.712140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22ae27-1f36-4c20-bba1-01fe913c2bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:20.713881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22ae27-1f36-4c20-bba1-01fe913c2bfc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:20.724575 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 271/547] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:20.733182 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22ae27-1f36-4c20-bba1-01fe913c2bfc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:20.754990 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183160-fbc7-4b6b-98dc-2e34141033f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:20.755829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183160-fbc7-4b6b-98dc-2e34141033f2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:20.756154 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183160-fbc7-4b6b-98dc-2e34141033f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:20.756423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183160-fbc7-4b6b-98dc-2e34141033f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:20.771777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:20.784131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7183160-fbc7-4b6b-98dc-2e34141033f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b7183160-fbc7-4b6b-98dc-2e34141033f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:20.799229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:20.801140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:20.802660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:20.802660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:20.802660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:20.802660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:20.802660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:20.802660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:20.802660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:20.802660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:20.802660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:20.802660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:20.802660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:20.802660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:20.808619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 277/548] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:20.810233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183160-fbc7-4b6b-98dc-2e34141033f2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:20.949585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22ae27-1f36-4c20-bba1-01fe913c2bfc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:21.006557 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183160-fbc7-4b6b-98dc-2e34141033f2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:21.049037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559764e-c6fa-4418-89ef-3a67fba1fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:21.050114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559764e-c6fa-4418-89ef-3a67fba1fb7e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:21.050657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559764e-c6fa-4418-89ef-3a67fba1fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:21.051216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559764e-c6fa-4418-89ef-3a67fba1fb7e None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:21.052223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559764e-c6fa-4418-89ef-3a67fba1fb7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:21.052842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559764e-c6fa-4418-89ef-3a67fba1fb7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:21.053556 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b56211-1ac7-47ed-bb0d-8245a6fa039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:21.054752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b56211-1ac7-47ed-bb0d-8245a6fa039a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:21.055067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559764e-c6fa-4418-89ef-3a67fba1fb7e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:21.055262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b56211-1ac7-47ed-bb0d-8245a6fa039a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:21.055525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b56211-1ac7-47ed-bb0d-8245a6fa039a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:21.071018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 278/549] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:21.072983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559764e-c6fa-4418-89ef-3a67fba1fb7e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:21.104443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b56211-1ac7-47ed-bb0d-8245a6fa039a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:21.108051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b56211-1ac7-47ed-bb0d-8245a6fa039a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f3b56211-1ac7-47ed-bb0d-8245a6fa039a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:21.134470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:21.135431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:21.136769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:21.136769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:21.136769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:21.136769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:21.136769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 272/550] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:21.142451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b56211-1ac7-47ed-bb0d-8245a6fa039a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:21.179675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:21.203111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:21.268069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559764e-c6fa-4418-89ef-3a67fba1fb7e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:21.416139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5b4e7-16c6-4460-81db-89ce88dc56c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:21.417610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5b4e7-16c6-4460-81db-89ce88dc56c1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:21.418108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5b4e7-16c6-4460-81db-89ce88dc56c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:21.418596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5b4e7-16c6-4460-81db-89ce88dc56c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:21.479463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b56211-1ac7-47ed-bb0d-8245a6fa039a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:21.483975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5b4e7-16c6-4460-81db-89ce88dc56c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:21.486806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5b4e7-16c6-4460-81db-89ce88dc56c1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-82b5b4e7-16c6-4460-81db-89ce88dc56c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:21.511189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:21.512856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:21.513754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:21.513754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:21.513754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:21.513754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:21.513754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 279/551] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:13:21.525104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5b4e7-16c6-4460-81db-89ce88dc56c1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:21.570914 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc241bc6-94a6-4c66-9dfc-6cc094369716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:21.571608 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc241bc6-94a6-4c66-9dfc-6cc094369716 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:21.571874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc241bc6-94a6-4c66-9dfc-6cc094369716 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:21.572150 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc241bc6-94a6-4c66-9dfc-6cc094369716 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:21.572947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc241bc6-94a6-4c66-9dfc-6cc094369716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:21.573245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc241bc6-94a6-4c66-9dfc-6cc094369716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:21.574680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc241bc6-94a6-4c66-9dfc-6cc094369716 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:21.607742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 273/552] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:21.613442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc241bc6-94a6-4c66-9dfc-6cc094369716 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:21.787062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5b4e7-16c6-4460-81db-89ce88dc56c1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:21.819835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:21.850489 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:21.878930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632dbb2-8f06-46e8-9104-6cb368c43cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:21.880967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632dbb2-8f06-46e8-9104-6cb368c43cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:21.882396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632dbb2-8f06-46e8-9104-6cb368c43cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:21.883659 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632dbb2-8f06-46e8-9104-6cb368c43cd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:21.885304 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632dbb2-8f06-46e8-9104-6cb368c43cd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:21.886048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632dbb2-8f06-46e8-9104-6cb368c43cd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:21.887255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc241bc6-94a6-4c66-9dfc-6cc094369716 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:21.889110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632dbb2-8f06-46e8-9104-6cb368c43cd2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:21.921944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 280/553] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:21.921944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fd325-39c5-492b-bd40-186c36d52880 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:21.921944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fd325-39c5-492b-bd40-186c36d52880 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:21.921944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fd325-39c5-492b-bd40-186c36d52880 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:21.921944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 281/554] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:21.924199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114e339-a999-4946-9e76-479dfbdd1e5f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:21.924819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114e339-a999-4946-9e76-479dfbdd1e5f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:21.925372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114e339-a999-4946-9e76-479dfbdd1e5f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:21.929994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 282/555] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:21.930485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114e339-a999-4946-9e76-479dfbdd1e5f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:21.949244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9340b-b528-4f98-b5f9-6c78d218d006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:21.950082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9340b-b528-4f98-b5f9-6c78d218d006 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:21.950357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9340b-b528-4f98-b5f9-6c78d218d006 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:21.950621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9340b-b528-4f98-b5f9-6c78d218d006 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:21.959945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9340b-b528-4f98-b5f9-6c78d218d006 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:21.961500 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9340b-b528-4f98-b5f9-6c78d218d006 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-38d9340b-b528-4f98-b5f9-6c78d218d006 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:21.977684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:21.979383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:21.981826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:21.981826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:21.981826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:21.981826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:21.981826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:21.981826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:21.981826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:21.981826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:21.981826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:13:21.981826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:21.984206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 274/556] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 21 08:13:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:21.985394 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a3a79-1458-4041-91b6-81d2768c86d3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:21.985678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a3a79-1458-4041-91b6-81d2768c86d3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:21.986020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a3a79-1458-4041-91b6-81d2768c86d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:22.004797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7f3a3a79-1458-4041-91b6-81d2768c86d3 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:22.006018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7f3a3a79-1458-4041-91b6-81d2768c86d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:22.108618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 275/557] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:22.108618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649c18-bb6c-45b2-8fa6-778149ffd40c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:22.108618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649c18-bb6c-45b2-8fa6-778149ffd40c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:22.108618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649c18-bb6c-45b2-8fa6-778149ffd40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:22.136034 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ae649c18-bb6c-45b2-8fa6-778149ffd40c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:22.138513 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ae649c18-bb6c-45b2-8fa6-778149ffd40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:22.147353 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114e339-a999-4946-9e76-479dfbdd1e5f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:22.216006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be5ed8-25fe-4cd3-a4f2-9fd1823849fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:22.217401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be5ed8-25fe-4cd3-a4f2-9fd1823849fb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:22.217881 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be5ed8-25fe-4cd3-a4f2-9fd1823849fb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:22.218307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be5ed8-25fe-4cd3-a4f2-9fd1823849fb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:22.228713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be5ed8-25fe-4cd3-a4f2-9fd1823849fb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:22.230539 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be5ed8-25fe-4cd3-a4f2-9fd1823849fb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:22.252639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 276/558] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:22.252639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae649c18-bb6c-45b2-8fa6-778149ffd40c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-14be5ed8-25fe-4cd3-a4f2-9fd1823849fb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:22.253053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:22.256242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:22.257706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:22.257706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:22.257706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:22.257706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:22.257706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:22.257706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:22.257706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:22.257706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:22.257706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:13:22.257706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:22.260569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 283/559] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:13:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:22.261565 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:22.262910 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be5ed8-25fe-4cd3-a4f2-9fd1823849fb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:22.325667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:22.422915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be5ed8-25fe-4cd3-a4f2-9fd1823849fb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:22.449096 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae649c18-bb6c-45b2-8fa6-778149ffd40c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:22.480776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bfb29-024d-4214-90e6-d6d469d7f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:22.481613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bfb29-024d-4214-90e6-d6d469d7f342 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:22.481893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bfb29-024d-4214-90e6-d6d469d7f342 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:22.482165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bfb29-024d-4214-90e6-d6d469d7f342 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:22.497078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bfb29-024d-4214-90e6-d6d469d7f342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:22.503243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297982f-24ae-4d21-902f-5a6ab6ef5db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:22.504345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297982f-24ae-4d21-902f-5a6ab6ef5db6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:22.504825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297982f-24ae-4d21-902f-5a6ab6ef5db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:22.505271 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297982f-24ae-4d21-902f-5a6ab6ef5db6 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a50bfb29-024d-4214-90e6-d6d469d7f342 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:22.505404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:22.512708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:22.513536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 284/560] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:22.514228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297982f-24ae-4d21-902f-5a6ab6ef5db6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:22.514228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297982f-24ae-4d21-902f-5a6ab6ef5db6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:22.514373 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bfb29-024d-4214-90e6-d6d469d7f342 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:22.514461 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297982f-24ae-4d21-902f-5a6ab6ef5db6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:22.581294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 277/561] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 21 08:13:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:22.582792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297982f-24ae-4d21-902f-5a6ab6ef5db6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:22.629820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:22.642933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bfb29-024d-4214-90e6-d6d469d7f342 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:22.674954 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:22.691846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed645047-d4ef-435a-9c74-d1f886440456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:22.693008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed645047-d4ef-435a-9c74-d1f886440456 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:22.693452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed645047-d4ef-435a-9c74-d1f886440456 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:22.693907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed645047-d4ef-435a-9c74-d1f886440456 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:22.695450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed645047-d4ef-435a-9c74-d1f886440456 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:22.695942 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed645047-d4ef-435a-9c74-d1f886440456 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:22.698585 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed645047-d4ef-435a-9c74-d1f886440456 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:22.727620 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 285/562] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jul 21 08:13:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:22.729424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191135da-0f54-41cc-8bb4-92a499c386bf None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:22.729860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191135da-0f54-41cc-8bb4-92a499c386bf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:22.730311 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191135da-0f54-41cc-8bb4-92a499c386bf None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:22.732818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 286/563] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:22.733844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191135da-0f54-41cc-8bb4-92a499c386bf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:22.747740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297982f-24ae-4d21-902f-5a6ab6ef5db6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:22.797573 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6de4d0-e94b-4720-9284-70f8f7fad3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:22.798413 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6de4d0-e94b-4720-9284-70f8f7fad3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:22.798712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6de4d0-e94b-4720-9284-70f8f7fad3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:22.798985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6de4d0-e94b-4720-9284-70f8f7fad3f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:22.813487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6de4d0-e94b-4720-9284-70f8f7fad3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ab6de4d0-e94b-4720-9284-70f8f7fad3f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:22.821564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:22.823760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 278/564] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:22.825348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6de4d0-e94b-4720-9284-70f8f7fad3f0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:22.888101 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191135da-0f54-41cc-8bb4-92a499c386bf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:22.931451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11303d3-4f1d-48d1-b705-23b4a6910d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:22.932063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11303d3-4f1d-48d1-b705-23b4a6910d5b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:22.932343 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11303d3-4f1d-48d1-b705-23b4a6910d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:22.932652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11303d3-4f1d-48d1-b705-23b4a6910d5b None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:22.933442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11303d3-4f1d-48d1-b705-23b4a6910d5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:22.933747 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11303d3-4f1d-48d1-b705-23b4a6910d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:22.935207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11303d3-4f1d-48d1-b705-23b4a6910d5b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:22.945388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 287/565] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:22.946289 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11303d3-4f1d-48d1-b705-23b4a6910d5b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:22.973089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:22.984953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6de4d0-e94b-4720-9284-70f8f7fad3f0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:23.018194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:23.040031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a5c02-60b3-4e01-835a-c57ebec8b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:23.041059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a5c02-60b3-4e01-835a-c57ebec8b47e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:23.041416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a5c02-60b3-4e01-835a-c57ebec8b47e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:23.041726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a5c02-60b3-4e01-835a-c57ebec8b47e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:23.055815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a5c02-60b3-4e01-835a-c57ebec8b47e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:23.057609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a5c02-60b3-4e01-835a-c57ebec8b47e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8c9a5c02-60b3-4e01-835a-c57ebec8b47e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:23.080687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:23.082706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:23.085085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:23.085085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:23.085085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:23.085085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:23.085085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 279/566] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:23.085699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f331bb-3939-4f90-b72c-ad80f02fc97c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:23.085847 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f331bb-3939-4f90-b72c-ad80f02fc97c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:23.086235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f331bb-3939-4f90-b72c-ad80f02fc97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:23.101806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11303d3-4f1d-48d1-b705-23b4a6910d5b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:23.106761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-22f331bb-3939-4f90-b72c-ad80f02fc97c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:23.108037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-22f331bb-3939-4f90-b72c-ad80f02fc97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:23.154894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305849e-59bb-4470-8cfb-8eab5204ef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:23.155570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305849e-59bb-4470-8cfb-8eab5204ef65 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:23.155848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305849e-59bb-4470-8cfb-8eab5204ef65 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:23.156124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305849e-59bb-4470-8cfb-8eab5204ef65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:23.192188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 280/567] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:23.193444 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f331bb-3939-4f90-b72c-ad80f02fc97c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:23.261490 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305849e-59bb-4470-8cfb-8eab5204ef65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:23.263308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305849e-59bb-4470-8cfb-8eab5204ef65 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:23.284043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:23.338930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f331bb-3939-4f90-b72c-ad80f02fc97c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:23.343628 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:23.388086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 288/568] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:23.388911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305849e-59bb-4470-8cfb-8eab5204ef65 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:23.406326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebcfe7-9789-435f-b566-573564fb3611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:23.407520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebcfe7-9789-435f-b566-573564fb3611 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:23.408012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebcfe7-9789-435f-b566-573564fb3611 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:23.408486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebcfe7-9789-435f-b566-573564fb3611 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:23.409965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebcfe7-9789-435f-b566-573564fb3611 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:23.410669 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebcfe7-9789-435f-b566-573564fb3611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:23.413302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebcfe7-9789-435f-b566-573564fb3611 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:23.429352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 281/569] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:23.430749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebcfe7-9789-435f-b566-573564fb3611 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:23.531754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305849e-59bb-4470-8cfb-8eab5204ef65 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:23.548934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:23.577887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebcfe7-9789-435f-b566-573564fb3611 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:23.586252 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052017d9-4955-4106-8190-535ee6e8e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:23.588055 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052017d9-4955-4106-8190-535ee6e8e6df None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:23.588578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052017d9-4955-4106-8190-535ee6e8e6df None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:23.589069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052017d9-4955-4106-8190-535ee6e8e6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:23.610134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052017d9-4955-4106-8190-535ee6e8e6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:23.613060 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052017d9-4955-4106-8190-535ee6e8e6df None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:23.619358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11539bb7-9175-4bc5-805f-d7b3f242dd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:23.620040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539bb7-9175-4bc5-805f-d7b3f242dd0d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:23.620319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539bb7-9175-4bc5-805f-d7b3f242dd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:23.620626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539bb7-9175-4bc5-805f-d7b3f242dd0d None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:23.621373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11539bb7-9175-4bc5-805f-d7b3f242dd0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:23.621681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11539bb7-9175-4bc5-805f-d7b3f242dd0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:23.623126 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11539bb7-9175-4bc5-805f-d7b3f242dd0d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:23.638337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 282/570] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:23.639226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11539bb7-9175-4bc5-805f-d7b3f242dd0d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-052017d9-4955-4106-8190-535ee6e8e6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:23.647626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:23.649495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:23.651348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:23.651348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:23.651348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:23.651348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:23.651348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 289/571] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:23.651902 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052017d9-4955-4106-8190-535ee6e8e6df None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:23.681938 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:23.786104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052017d9-4955-4106-8190-535ee6e8e6df None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:23.794473 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11539bb7-9175-4bc5-805f-d7b3f242dd0d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:23.826680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1a4e6-8f61-4aeb-a868-f75660d3f0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:23.827524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1a4e6-8f61-4aeb-a868-f75660d3f0ab None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:23.827807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1a4e6-8f61-4aeb-a868-f75660d3f0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:23.828041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1a4e6-8f61-4aeb-a868-f75660d3f0ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:23.839602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1a4e6-8f61-4aeb-a868-f75660d3f0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:23.841190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1a4e6-8f61-4aeb-a868-f75660d3f0ab None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-11d1a4e6-8f61-4aeb-a868-f75660d3f0ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:23.860632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:23.870757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:23.872901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:23.872901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:23.872901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:23.872901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:23.872901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 290/572] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:23.872901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1a4e6-8f61-4aeb-a868-f75660d3f0ab None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:23.873737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa47e89-b43c-4ee0-bf38-399bd05d9bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:23.873737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa47e89-b43c-4ee0-bf38-399bd05d9bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:23.873737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa47e89-b43c-4ee0-bf38-399bd05d9bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:23.873737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa47e89-b43c-4ee0-bf38-399bd05d9bf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:23.885906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:23.890565 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa47e89-b43c-4ee0-bf38-399bd05d9bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3fa47e89-b43c-4ee0-bf38-399bd05d9bf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:23.905253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:23.906374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:23.907245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:23.907245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:23.907245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:23.907245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:23.907245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:23.907245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:23.907245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:23.907245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:23.907245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:23.907245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:23.907245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:23.907245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:23.908122 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 283/573] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:23.909515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa47e89-b43c-4ee0-bf38-399bd05d9bf9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:23.989233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1a4e6-8f61-4aeb-a868-f75660d3f0ab None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:24.036273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc2d04-3745-4021-bca8-4b1ce1e591eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:24.037044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc2d04-3745-4021-bca8-4b1ce1e591eb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:24.037323 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc2d04-3745-4021-bca8-4b1ce1e591eb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:24.037593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc2d04-3745-4021-bca8-4b1ce1e591eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:24.049754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc2d04-3745-4021-bca8-4b1ce1e591eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:24.051362 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc2d04-3745-4021-bca8-4b1ce1e591eb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:24.058145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e9bc2d04-3745-4021-bca8-4b1ce1e591eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:24.071275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:24.072460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:24.073381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:24.073381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:24.073381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:24.073381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:24.073381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 291/574] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:24.073651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc2d04-3745-4021-bca8-4b1ce1e591eb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:24.089796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa47e89-b43c-4ee0-bf38-399bd05d9bf9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:24.142550 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd5527-3662-4e9d-a539-52ad00c5dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:24.143851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd5527-3662-4e9d-a539-52ad00c5dc82 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:24.144308 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd5527-3662-4e9d-a539-52ad00c5dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:24.145208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd5527-3662-4e9d-a539-52ad00c5dc82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:24.158050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd5527-3662-4e9d-a539-52ad00c5dc82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:24.160710 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd5527-3662-4e9d-a539-52ad00c5dc82 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:24.167598 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-bfcd5527-3662-4e9d-a539-52ad00c5dc82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:24.179256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:24.181247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:24.182591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:24.182591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:24.182591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:24.182591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:24.182591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:24.182591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:24.182591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:24.182591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:24.182591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 284/575] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:24.183116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd5527-3662-4e9d-a539-52ad00c5dc82 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:24.218767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc2d04-3745-4021-bca8-4b1ce1e591eb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:24.267508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32265f4-783f-47b8-9b4a-f7d668ba41ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:24.268702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32265f4-783f-47b8-9b4a-f7d668ba41ae None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:24.269240 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32265f4-783f-47b8-9b4a-f7d668ba41ae None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:24.269812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32265f4-783f-47b8-9b4a-f7d668ba41ae None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:24.271456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32265f4-783f-47b8-9b4a-f7d668ba41ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:24.271952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32265f4-783f-47b8-9b4a-f7d668ba41ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:24.274338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32265f4-783f-47b8-9b4a-f7d668ba41ae None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:24.290601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 292/576] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:24.292049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32265f4-783f-47b8-9b4a-f7d668ba41ae None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:24.338636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd5527-3662-4e9d-a539-52ad00c5dc82 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:24.377011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efa58e-ba49-4431-a719-646325f8dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:24.377702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efa58e-ba49-4431-a719-646325f8dcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:24.377983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efa58e-ba49-4431-a719-646325f8dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:24.378270 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efa58e-ba49-4431-a719-646325f8dcc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:24.379200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efa58e-ba49-4431-a719-646325f8dcc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:24.379591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efa58e-ba49-4431-a719-646325f8dcc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:24.381001 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efa58e-ba49-4431-a719-646325f8dcc9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:24.395230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 285/577] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:24.396138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efa58e-ba49-4431-a719-646325f8dcc9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:24.408977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:24.421074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32265f4-783f-47b8-9b4a-f7d668ba41ae None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:24.451244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:24.464243 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5ac2b-d77a-4b22-b7a0-a0411fc65e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:24.465288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5ac2b-d77a-4b22-b7a0-a0411fc65e05 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:24.465734 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5ac2b-d77a-4b22-b7a0-a0411fc65e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:24.466167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5ac2b-d77a-4b22-b7a0-a0411fc65e05 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:24.467459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5ac2b-d77a-4b22-b7a0-a0411fc65e05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:24.467949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5ac2b-d77a-4b22-b7a0-a0411fc65e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:24.470147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5ac2b-d77a-4b22-b7a0-a0411fc65e05 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:24.484199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 293/578] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:24.485651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5ac2b-d77a-4b22-b7a0-a0411fc65e05 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:24.545500 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efa58e-ba49-4431-a719-646325f8dcc9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:24.604604 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97cd4b-8d80-4eef-90ea-5b3fddb9de52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:24.605383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97cd4b-8d80-4eef-90ea-5b3fddb9de52 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:24.605743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97cd4b-8d80-4eef-90ea-5b3fddb9de52 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:24.606080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97cd4b-8d80-4eef-90ea-5b3fddb9de52 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:24.606915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97cd4b-8d80-4eef-90ea-5b3fddb9de52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:24.607290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97cd4b-8d80-4eef-90ea-5b3fddb9de52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:24.608851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97cd4b-8d80-4eef-90ea-5b3fddb9de52 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:24.623733 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 286/579] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:24.625180 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97cd4b-8d80-4eef-90ea-5b3fddb9de52 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:24.649525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5ac2b-d77a-4b22-b7a0-a0411fc65e05 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:24.703121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a6e56-e0de-4ac1-9681-282fea18137f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:24.704165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a6e56-e0de-4ac1-9681-282fea18137f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:24.704638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a6e56-e0de-4ac1-9681-282fea18137f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:24.705052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a6e56-e0de-4ac1-9681-282fea18137f None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:24.706221 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a6e56-e0de-4ac1-9681-282fea18137f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:24.706715 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a6e56-e0de-4ac1-9681-282fea18137f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:24.709210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a6e56-e0de-4ac1-9681-282fea18137f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:24.726522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:24.729291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 294/580] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:24.730512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a6e56-e0de-4ac1-9681-282fea18137f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:24.773546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97cd4b-8d80-4eef-90ea-5b3fddb9de52 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:24.792392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:24.814870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f1c97-0e17-4d31-ab05-6c71cfb9a9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:24.815600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f1c97-0e17-4d31-ab05-6c71cfb9a9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:24.815872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f1c97-0e17-4d31-ab05-6c71cfb9a9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:24.816142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f1c97-0e17-4d31-ab05-6c71cfb9a9e1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:24.824955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f1c97-0e17-4d31-ab05-6c71cfb9a9e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:24.826487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f1c97-0e17-4d31-ab05-6c71cfb9a9e1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5f9f1c97-0e17-4d31-ab05-6c71cfb9a9e1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:24.843440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:24.845547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:24.847585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:24.847585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:24.847585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:24.847585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:24.847585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:24.847585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:24.847585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:24.847585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:24.847585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:13:24.847585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:24.847585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 287/581] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:24.847585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f1c97-0e17-4d31-ab05-6c71cfb9a9e1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:24.862823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a6e56-e0de-4ac1-9681-282fea18137f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:24.908722 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eff224-836b-4878-970c-0e51fad9b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:24.909915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eff224-836b-4878-970c-0e51fad9b728 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:24.910341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eff224-836b-4878-970c-0e51fad9b728 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:24.910724 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eff224-836b-4878-970c-0e51fad9b728 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:24.919367 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eff224-836b-4878-970c-0e51fad9b728 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:24.921149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eff224-836b-4878-970c-0e51fad9b728 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-10eff224-836b-4878-970c-0e51fad9b728 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:24.938763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:24.940785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:24.942730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:24.942730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:24.942730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:24.942730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:24.942730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:24.942730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:24.942730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:24.942730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:24.942730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 295/582] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:24.942730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eff224-836b-4878-970c-0e51fad9b728 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:24.992608 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f1c97-0e17-4d31-ab05-6c71cfb9a9e1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:25.025410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:25.036248 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1227b8-153b-41c9-8ac1-e92bcfc5c520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:25.037191 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1227b8-153b-41c9-8ac1-e92bcfc5c520 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:25.037560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1227b8-153b-41c9-8ac1-e92bcfc5c520 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:25.037918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1227b8-153b-41c9-8ac1-e92bcfc5c520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:25.050429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1227b8-153b-41c9-8ac1-e92bcfc5c520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:25.052060 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1227b8-153b-41c9-8ac1-e92bcfc5c520 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3d1227b8-153b-41c9-8ac1-e92bcfc5c520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:25.071498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:25.073274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:25.075408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:25.075408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:25.075408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:25.075408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:25.075408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 288/583] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:25.075408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1227b8-153b-41c9-8ac1-e92bcfc5c520 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:25.092751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eff224-836b-4878-970c-0e51fad9b728 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:25.113065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:25.140525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c267c-3c4e-4991-9272-eaa36759dcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:25.141363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c267c-3c4e-4991-9272-eaa36759dcfc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:25.141637 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c267c-3c4e-4991-9272-eaa36759dcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:25.141894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c267c-3c4e-4991-9272-eaa36759dcfc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:25.151174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c267c-3c4e-4991-9272-eaa36759dcfc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:25.152724 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c267c-3c4e-4991-9272-eaa36759dcfc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-cb4c267c-3c4e-4991-9272-eaa36759dcfc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:25.168315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:25.170244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:25.172001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:25.172001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:25.172001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:25.172001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:25.172001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:25.172001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:25.172001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:25.172001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:25.172001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:13:25.172001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:25.173089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 296/584] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:25.174007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c267c-3c4e-4991-9272-eaa36759dcfc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:25.226984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1227b8-153b-41c9-8ac1-e92bcfc5c520 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:25.275334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1f2d8-497b-43ea-a2ae-6fb1b6a10ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:25.276246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1f2d8-497b-43ea-a2ae-6fb1b6a10ead None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:25.276666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1f2d8-497b-43ea-a2ae-6fb1b6a10ead None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:25.277014 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1f2d8-497b-43ea-a2ae-6fb1b6a10ead None admin] PATH_INFO: `/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/421f05e3d10e4393b28f77b6179ade8c/roles/9e4aabf99fc8417596f726f0229d19a6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:25.297516 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1f2d8-497b-43ea-a2ae-6fb1b6a10ead None admin] RBAC: Authorizing `identity:create_grant(project_id=c487ed72a15c45faa40f743ae752e48b, user_id=421f05e3d10e4393b28f77b6179ade8c, role_id=9e4aabf99fc8417596f726f0229d19a6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:25.300226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1f2d8-497b-43ea-a2ae-6fb1b6a10ead None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:25.304900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c267c-3c4e-4991-9272-eaa36759dcfc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:25.320020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 289/585] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:13:25 2022] PUT /identity/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/421f05e3d10e4393b28f77b6179ade8c/roles/9e4aabf99fc8417596f726f0229d19a6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:13:25.321234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1f2d8-497b-43ea-a2ae-6fb1b6a10ead None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:25.374142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebce3be-66b3-42a7-a0f4-da56ebc11611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:25.375138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebce3be-66b3-42a7-a0f4-da56ebc11611 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:25.375559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebce3be-66b3-42a7-a0f4-da56ebc11611 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:25.375964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebce3be-66b3-42a7-a0f4-da56ebc11611 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:25.377486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebce3be-66b3-42a7-a0f4-da56ebc11611 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:25.378001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebce3be-66b3-42a7-a0f4-da56ebc11611 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:25.378848 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:25.380745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebce3be-66b3-42a7-a0f4-da56ebc11611 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:25.414698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 297/586] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 21 08:13:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:25.416008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebce3be-66b3-42a7-a0f4-da56ebc11611 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:25.460975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:25.509608 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1f2d8-497b-43ea-a2ae-6fb1b6a10ead None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:25.571419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebce3be-66b3-42a7-a0f4-da56ebc11611 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:25.572118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22d0cb-1b47-419d-824a-d501aa2628db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:25.573344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22d0cb-1b47-419d-824a-d501aa2628db None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:25.573825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22d0cb-1b47-419d-824a-d501aa2628db None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:25.574292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22d0cb-1b47-419d-824a-d501aa2628db None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:25.575851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22d0cb-1b47-419d-824a-d501aa2628db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:25.576373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22d0cb-1b47-419d-824a-d501aa2628db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:25.579123 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22d0cb-1b47-419d-824a-d501aa2628db None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:25.611283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 290/587] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:25.612821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22d0cb-1b47-419d-824a-d501aa2628db None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:25.641064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588f5ff-3dde-483e-85a5-44397ca14ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:25.642784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588f5ff-3dde-483e-85a5-44397ca14ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:25.643610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588f5ff-3dde-483e-85a5-44397ca14ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:25.644459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588f5ff-3dde-483e-85a5-44397ca14ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:25.646539 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588f5ff-3dde-483e-85a5-44397ca14ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:25.647334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588f5ff-3dde-483e-85a5-44397ca14ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:25.650342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588f5ff-3dde-483e-85a5-44397ca14ba3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:25.680819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 298/588] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:25.680819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588f5ff-3dde-483e-85a5-44397ca14ba3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:25.746496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:25.769251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22d0cb-1b47-419d-824a-d501aa2628db None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:25.831839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea7a18-fdda-46ff-8300-9941878639de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:25.833138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea7a18-fdda-46ff-8300-9941878639de None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:25.833618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea7a18-fdda-46ff-8300-9941878639de None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:25.834085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea7a18-fdda-46ff-8300-9941878639de None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:25.835673 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea7a18-fdda-46ff-8300-9941878639de None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:25.836184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea7a18-fdda-46ff-8300-9941878639de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:25.836439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:25.839508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea7a18-fdda-46ff-8300-9941878639de None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:25.863036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588f5ff-3dde-483e-85a5-44397ca14ba3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:25.879964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 291/589] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 21 08:13:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:25.879964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea7a18-fdda-46ff-8300-9941878639de None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:25.917591 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182e48e-2dce-4dbb-b963-92be02644aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:25.918822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182e48e-2dce-4dbb-b963-92be02644aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:25.919288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182e48e-2dce-4dbb-b963-92be02644aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:25.919725 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182e48e-2dce-4dbb-b963-92be02644aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:25.937962 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182e48e-2dce-4dbb-b963-92be02644aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:25.940589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182e48e-2dce-4dbb-b963-92be02644aa7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6182e48e-2dce-4dbb-b963-92be02644aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:25.971657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:25.972994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:25.973912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:25.973912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:25.973912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:25.973912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:25.974141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 299/590] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:25.975676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182e48e-2dce-4dbb-b963-92be02644aa7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:26.049625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea7a18-fdda-46ff-8300-9941878639de None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:26.108715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09577e3c-c852-4f9c-9f64-98ec7ab2183a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:26.110298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09577e3c-c852-4f9c-9f64-98ec7ab2183a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:26.110507 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09577e3c-c852-4f9c-9f64-98ec7ab2183a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:26.110722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09577e3c-c852-4f9c-9f64-98ec7ab2183a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:26.112102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09577e3c-c852-4f9c-9f64-98ec7ab2183a None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=300b1990926c4968b75a84a1f5794df1) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:26.112872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09577e3c-c852-4f9c-9f64-98ec7ab2183a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:26.114958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09577e3c-c852-4f9c-9f64-98ec7ab2183a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:26.124470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 292/591] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:25 2022] GET /identity/v3/role_assignments?user.id=300b1990926c4968b75a84a1f5794df1&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:26.125991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09577e3c-c852-4f9c-9f64-98ec7ab2183a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:26.145887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:26.153158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182e48e-2dce-4dbb-b963-92be02644aa7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:26.211286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b7705-cb31-4d83-8735-5c87bd3650a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:26.213007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b7705-cb31-4d83-8735-5c87bd3650a2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:26.213577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b7705-cb31-4d83-8735-5c87bd3650a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:26.214023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b7705-cb31-4d83-8735-5c87bd3650a2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:26.226154 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b7705-cb31-4d83-8735-5c87bd3650a2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:26.228548 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b7705-cb31-4d83-8735-5c87bd3650a2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:26.233269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-364b7705-cb31-4d83-8735-5c87bd3650a2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:26.250516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:26.251544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:26.252465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:26.252465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:26.252465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:26.252465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:26.252465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:26.252465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:26.252465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:26.252465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:26.252465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:13:26.252465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:26.255163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 300/592] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:26.259481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b7705-cb31-4d83-8735-5c87bd3650a2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:26.328598 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09577e3c-c852-4f9c-9f64-98ec7ab2183a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:26.395522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426aabbe-3968-4262-8263-6bce82adcfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:26.397345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426aabbe-3968-4262-8263-6bce82adcfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:26.398005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426aabbe-3968-4262-8263-6bce82adcfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:26.398667 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426aabbe-3968-4262-8263-6bce82adcfc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:26.419200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426aabbe-3968-4262-8263-6bce82adcfc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:26.422373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426aabbe-3968-4262-8263-6bce82adcfc1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:26.451244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b7705-cb31-4d83-8735-5c87bd3650a2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-426aabbe-3968-4262-8263-6bce82adcfc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:26.457612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:26.459551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:26.461684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:26.461684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:26.461684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:26.461684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:26.464940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 293/593] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:26.466729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426aabbe-3968-4262-8263-6bce82adcfc1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:26.517042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a93af-1aaa-4b4b-8546-03974fae6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:26.518130 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a93af-1aaa-4b4b-8546-03974fae6b55 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:26.518592 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a93af-1aaa-4b4b-8546-03974fae6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:26.519204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a93af-1aaa-4b4b-8546-03974fae6b55 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:26.520950 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a93af-1aaa-4b4b-8546-03974fae6b55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:26.521886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a93af-1aaa-4b4b-8546-03974fae6b55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:26.524108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a93af-1aaa-4b4b-8546-03974fae6b55 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:26.556572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 301/594] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:26.556572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a93af-1aaa-4b4b-8546-03974fae6b55 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:26.601333 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:26.674342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:26.686942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426aabbe-3968-4262-8263-6bce82adcfc1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:26.753769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8b573-1943-4aeb-bdc9-fb166b9ae949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:26.756059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8b573-1943-4aeb-bdc9-fb166b9ae949 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:26.756770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8b573-1943-4aeb-bdc9-fb166b9ae949 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:26.756934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a93af-1aaa-4b4b-8546-03974fae6b55 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:26.757570 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8b573-1943-4aeb-bdc9-fb166b9ae949 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:26.759319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8b573-1943-4aeb-bdc9-fb166b9ae949 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:26.760107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8b573-1943-4aeb-bdc9-fb166b9ae949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:26.763286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8b573-1943-4aeb-bdc9-fb166b9ae949 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:26.800971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 294/595] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Jul 21 08:13:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:26.803056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8b573-1943-4aeb-bdc9-fb166b9ae949 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:26.824333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de2d46-8b0c-47b3-a8a2-45d862f8c597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:26.825454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de2d46-8b0c-47b3-a8a2-45d862f8c597 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:26.825916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de2d46-8b0c-47b3-a8a2-45d862f8c597 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:26.826372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de2d46-8b0c-47b3-a8a2-45d862f8c597 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:26.827896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de2d46-8b0c-47b3-a8a2-45d862f8c597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:26.828313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de2d46-8b0c-47b3-a8a2-45d862f8c597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:26.830841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de2d46-8b0c-47b3-a8a2-45d862f8c597 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:26.854404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 302/596] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:26.855999 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de2d46-8b0c-47b3-a8a2-45d862f8c597 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:26.997752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8b573-1943-4aeb-bdc9-fb166b9ae949 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:27.038854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:27.057612 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de2d46-8b0c-47b3-a8a2-45d862f8c597 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:27.065983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5de93-1494-44cb-b2f5-a2bc2e490645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:27.067469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5de93-1494-44cb-b2f5-a2bc2e490645 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:27.068034 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5de93-1494-44cb-b2f5-a2bc2e490645 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:27.068650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5de93-1494-44cb-b2f5-a2bc2e490645 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:27.081994 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5de93-1494-44cb-b2f5-a2bc2e490645 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:27.084864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5de93-1494-44cb-b2f5-a2bc2e490645 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:27.100655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-56e5de93-1494-44cb-b2f5-a2bc2e490645 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:27.115526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:27.117286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:27.118972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:27.118972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:27.118972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:27.118972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:27.118972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:27.118972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:27.118972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:27.118972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:27.128527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 295/597] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:27.128825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97a812-d4e4-4b4a-b3f9-6e5b23e78628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:27.128825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97a812-d4e4-4b4a-b3f9-6e5b23e78628 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:27.129365 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97a812-d4e4-4b4a-b3f9-6e5b23e78628 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:27.129638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97a812-d4e4-4b4a-b3f9-6e5b23e78628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:27.129789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5de93-1494-44cb-b2f5-a2bc2e490645 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:27.147549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97a812-d4e4-4b4a-b3f9-6e5b23e78628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:27.150123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97a812-d4e4-4b4a-b3f9-6e5b23e78628 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0b97a812-d4e4-4b4a-b3f9-6e5b23e78628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:27.184191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:27.186001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:27.187707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:27.187707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:27.187707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:27.187707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:27.187707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 303/598] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:27.188984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97a812-d4e4-4b4a-b3f9-6e5b23e78628 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:27.291590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5de93-1494-44cb-b2f5-a2bc2e490645 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:27.333353 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fe50f-9ff1-42a2-a37b-18691f03f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:27.334237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fe50f-9ff1-42a2-a37b-18691f03f943 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:27.334531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fe50f-9ff1-42a2-a37b-18691f03f943 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:27.334810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fe50f-9ff1-42a2-a37b-18691f03f943 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:27.343061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fe50f-9ff1-42a2-a37b-18691f03f943 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:27.344910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fe50f-9ff1-42a2-a37b-18691f03f943 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5a2fe50f-9ff1-42a2-a37b-18691f03f943 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:27.360930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:27.362845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:27.364668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:27.364668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:27.364668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:27.364668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:27.364668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:27.364668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:27.364668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:27.364668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:27.364668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 296/599] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:27.364668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fe50f-9ff1-42a2-a37b-18691f03f943 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:27.366884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97a812-d4e4-4b4a-b3f9-6e5b23e78628 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:27.415526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:27.437460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ee794-d207-4375-86d0-2a58a16b5939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:27.439145 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ee794-d207-4375-86d0-2a58a16b5939 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:27.439869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ee794-d207-4375-86d0-2a58a16b5939 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:27.440662 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ee794-d207-4375-86d0-2a58a16b5939 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:27.442981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ee794-d207-4375-86d0-2a58a16b5939 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:27.443756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ee794-d207-4375-86d0-2a58a16b5939 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:27.447255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ee794-d207-4375-86d0-2a58a16b5939 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:27.481331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 304/600] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:27.483399 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ee794-d207-4375-86d0-2a58a16b5939 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:27.485343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fe50f-9ff1-42a2-a37b-18691f03f943 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:27.528375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0928a50-56c6-4c3d-8400-ef4c70dc0363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:27.529112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0928a50-56c6-4c3d-8400-ef4c70dc0363 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:27.529396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0928a50-56c6-4c3d-8400-ef4c70dc0363 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:27.529673 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0928a50-56c6-4c3d-8400-ef4c70dc0363 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:27.530628 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0928a50-56c6-4c3d-8400-ef4c70dc0363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:27.530939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0928a50-56c6-4c3d-8400-ef4c70dc0363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:27.532405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0928a50-56c6-4c3d-8400-ef4c70dc0363 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:27.546693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 297/601] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:27.547451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0928a50-56c6-4c3d-8400-ef4c70dc0363 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:27.557413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:27.672146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:27.675879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0928a50-56c6-4c3d-8400-ef4c70dc0363 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:27.720717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714116e5-cd98-4004-899c-06cecfe80ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:27.721852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714116e5-cd98-4004-899c-06cecfe80ef5 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:27.722133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714116e5-cd98-4004-899c-06cecfe80ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:27.722437 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714116e5-cd98-4004-899c-06cecfe80ef5 None admin] PATH_INFO: `/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/f4f9a6f6d6d840d6bc29fd0ab26ddb29/roles/9e4aabf99fc8417596f726f0229d19a6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:27.729577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ee794-d207-4375-86d0-2a58a16b5939 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:27.739794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714116e5-cd98-4004-899c-06cecfe80ef5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c487ed72a15c45faa40f743ae752e48b, user_id=f4f9a6f6d6d840d6bc29fd0ab26ddb29, role_id=9e4aabf99fc8417596f726f0229d19a6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:27.741348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714116e5-cd98-4004-899c-06cecfe80ef5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:27.764765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 298/602] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:13:27 2022] PUT /identity/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/f4f9a6f6d6d840d6bc29fd0ab26ddb29/roles/9e4aabf99fc8417596f726f0229d19a6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:13:27.764765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714116e5-cd98-4004-899c-06cecfe80ef5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:27.839519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747c624-7695-48b8-bbde-36052645ae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:27.842676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747c624-7695-48b8-bbde-36052645ae3d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:27.843518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747c624-7695-48b8-bbde-36052645ae3d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:27.846877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747c624-7695-48b8-bbde-36052645ae3d None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:27.849810 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747c624-7695-48b8-bbde-36052645ae3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:27.851843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747c624-7695-48b8-bbde-36052645ae3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:27.858725 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747c624-7695-48b8-bbde-36052645ae3d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:27.917478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 305/603] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:27.924125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747c624-7695-48b8-bbde-36052645ae3d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:28.005117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714116e5-cd98-4004-899c-06cecfe80ef5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:28.071652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fa3fa-8338-41e0-9394-02e84c2eb30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:28.073631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fa3fa-8338-41e0-9394-02e84c2eb30e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:28.074342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fa3fa-8338-41e0-9394-02e84c2eb30e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:28.075063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fa3fa-8338-41e0-9394-02e84c2eb30e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:28.089043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fa3fa-8338-41e0-9394-02e84c2eb30e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:28.093625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fa3fa-8338-41e0-9394-02e84c2eb30e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:28.097861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:28.116559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747c624-7695-48b8-bbde-36052645ae3d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-133fa3fa-8338-41e0-9394-02e84c2eb30e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:28.131801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:28.133611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:28.135305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:28.135305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:28.135305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:28.135305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:28.135305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:28.135305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:28.135305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:28.135305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:28.135305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 299/604] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:28.135305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d3a42-de62-49c5-b316-381edac18229 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:28.135305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d3a42-de62-49c5-b316-381edac18229 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:28.136386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d3a42-de62-49c5-b316-381edac18229 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:28.142649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 300/605] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:28.143411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d3a42-de62-49c5-b316-381edac18229 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:28.159504 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:28.205294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e4479-d348-43bf-836a-7bb85fbb85e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:28.206236 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e4479-d348-43bf-836a-7bb85fbb85e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:28.206566 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e4479-d348-43bf-836a-7bb85fbb85e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:28.207007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e4479-d348-43bf-836a-7bb85fbb85e7 None admin] PATH_INFO: `/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/8e44cec1e8ee4c82b104cf64ae0de6d6/roles/9e4aabf99fc8417596f726f0229d19a6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:28.252563 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e4479-d348-43bf-836a-7bb85fbb85e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c487ed72a15c45faa40f743ae752e48b, user_id=8e44cec1e8ee4c82b104cf64ae0de6d6, role_id=9e4aabf99fc8417596f726f0229d19a6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:28.257791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e4479-d348-43bf-836a-7bb85fbb85e7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:28.287461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 306/606] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:13:27 2022] PUT /identity/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/8e44cec1e8ee4c82b104cf64ae0de6d6/roles/9e4aabf99fc8417596f726f0229d19a6 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:13:28.291626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433b537-7489-418b-afb0-4f9ab42c17dc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:28.293119 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433b537-7489-418b-afb0-4f9ab42c17dc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:28.293983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433b537-7489-418b-afb0-4f9ab42c17dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:28.322012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d3a42-de62-49c5-b316-381edac18229 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:28.353039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f433b537-7489-418b-afb0-4f9ab42c17dc None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:28.355257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f433b537-7489-418b-afb0-4f9ab42c17dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:28.465409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e8771-c282-490e-8329-3fd3a9e4456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:28.469522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e8771-c282-490e-8329-3fd3a9e4456b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:28.470995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e8771-c282-490e-8329-3fd3a9e4456b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:28.473552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e8771-c282-490e-8329-3fd3a9e4456b None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:28.475971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e8771-c282-490e-8329-3fd3a9e4456b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:28.477319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e8771-c282-490e-8329-3fd3a9e4456b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:28.481770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e8771-c282-490e-8329-3fd3a9e4456b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:28.528039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 301/607] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:28.529593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6ee6-5130-4dad-a421-8a2f5700e811 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:28.529913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6ee6-5130-4dad-a421-8a2f5700e811 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:28.530159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6ee6-5130-4dad-a421-8a2f5700e811 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:28.531894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 302/608] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:28.537833 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228c487-1a0b-485e-a2da-dbea7322e7f1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:28.538152 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228c487-1a0b-485e-a2da-dbea7322e7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:28.538480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228c487-1a0b-485e-a2da-dbea7322e7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:28.562896 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d228c487-1a0b-485e-a2da-dbea7322e7f1 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:28.565281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d228c487-1a0b-485e-a2da-dbea7322e7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:28.576565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 307/609] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:28.577506 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433b537-7489-418b-afb0-4f9ab42c17dc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:28.683993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:28.702643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:28.709340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 303/610] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:13:28.710674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228c487-1a0b-485e-a2da-dbea7322e7f1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:28.764562 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433b537-7489-418b-afb0-4f9ab42c17dc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:28.829446 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99082ffc-a7e5-4fbd-9a9a-3dceaec42241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:28.831477 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99082ffc-a7e5-4fbd-9a9a-3dceaec42241 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:28.832393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99082ffc-a7e5-4fbd-9a9a-3dceaec42241 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:28.833822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99082ffc-a7e5-4fbd-9a9a-3dceaec42241 None admin] PATH_INFO: `/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/06a267cec6fb4dbea619f0a77b5674dc/roles/9e4aabf99fc8417596f726f0229d19a6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:28.871643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99082ffc-a7e5-4fbd-9a9a-3dceaec42241 None admin] RBAC: Authorizing `identity:create_grant(project_id=c487ed72a15c45faa40f743ae752e48b, user_id=06a267cec6fb4dbea619f0a77b5674dc, role_id=9e4aabf99fc8417596f726f0229d19a6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:28.874079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99082ffc-a7e5-4fbd-9a9a-3dceaec42241 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:28.880743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228c487-1a0b-485e-a2da-dbea7322e7f1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:28.891096 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 308/611] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:13:28 2022] PUT /identity/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/06a267cec6fb4dbea619f0a77b5674dc/roles/9e4aabf99fc8417596f726f0229d19a6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:13:28.892417 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99082ffc-a7e5-4fbd-9a9a-3dceaec42241 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:29.033625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a5d29-7fef-431b-b5c7-9c3635a5d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:29.034772 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a5d29-7fef-431b-b5c7-9c3635a5d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:29.035286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a5d29-7fef-431b-b5c7-9c3635a5d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:29.035650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a5d29-7fef-431b-b5c7-9c3635a5d2b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:29.070884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a5d29-7fef-431b-b5c7-9c3635a5d2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2f6a5d29-7fef-431b-b5c7-9c3635a5d2b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:29.087984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:29.089890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:29.091542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 304/612] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:29.098190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a5d29-7fef-431b-b5c7-9c3635a5d2b9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:29.276437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99082ffc-a7e5-4fbd-9a9a-3dceaec42241 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:29.288088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:29.387706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:29.389842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a5d29-7fef-431b-b5c7-9c3635a5d2b9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:29.432629 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d9a7b-cd0b-497e-b13c-8c046e99ac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:29.433494 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d9a7b-cd0b-497e-b13c-8c046e99ac75 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:29.433779 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d9a7b-cd0b-497e-b13c-8c046e99ac75 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:29.434069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d9a7b-cd0b-497e-b13c-8c046e99ac75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:29.464319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d9a7b-cd0b-497e-b13c-8c046e99ac75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:29.471718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb84fa6-6f43-47b2-bd5c-2954be7167ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:29.473517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb84fa6-6f43-47b2-bd5c-2954be7167ce None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:29.474302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb84fa6-6f43-47b2-bd5c-2954be7167ce None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:29.475086 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb84fa6-6f43-47b2-bd5c-2954be7167ce None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:29.476611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb84fa6-6f43-47b2-bd5c-2954be7167ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:29.477177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb84fa6-6f43-47b2-bd5c-2954be7167ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:29.480044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb84fa6-6f43-47b2-bd5c-2954be7167ce None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-439d9a7b-cd0b-497e-b13c-8c046e99ac75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:29.491854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:29.493644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:29.494608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:29.494608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:29.494608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:29.494608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:29.494608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:29.494608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:29.494608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:29.494608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:29.494608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:29.494608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:29.494608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:29.494608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:29.502548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 305/613] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:29.504962 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 309/614] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 613 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:29.510477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb84fa6-6f43-47b2-bd5c-2954be7167ce None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:29.528666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d9a7b-cd0b-497e-b13c-8c046e99ac75 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:29.747442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb84fa6-6f43-47b2-bd5c-2954be7167ce None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:29.839128 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:29.889750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d9a7b-cd0b-497e-b13c-8c046e99ac75 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:29.890477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae706eea-fafe-4141-b365-5bfae9c2137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:29.892735 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae706eea-fafe-4141-b365-5bfae9c2137b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:29.893593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae706eea-fafe-4141-b365-5bfae9c2137b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:29.894397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae706eea-fafe-4141-b365-5bfae9c2137b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:29.938558 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae706eea-fafe-4141-b365-5bfae9c2137b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:29.941491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae706eea-fafe-4141-b365-5bfae9c2137b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ae706eea-fafe-4141-b365-5bfae9c2137b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:30.008073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:30.009392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:30.010623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:30.010623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:30.010623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:30.010623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:30.010925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1772d31-90d1-4097-9235-925206853512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:30.010925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1772d31-90d1-4097-9235-925206853512 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:30.011105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1772d31-90d1-4097-9235-925206853512 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:30.011771 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1772d31-90d1-4097-9235-925206853512 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:30.016534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1772d31-90d1-4097-9235-925206853512 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:30.016534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1772d31-90d1-4097-9235-925206853512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:30.016534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1772d31-90d1-4097-9235-925206853512 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:30.027989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 306/615] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 518 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:30.029436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae706eea-fafe-4141-b365-5bfae9c2137b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:30.043235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 310/616] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:30.069198 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1772d31-90d1-4097-9235-925206853512 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:30.174358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:30.374499 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1772d31-90d1-4097-9235-925206853512 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:30.386929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae706eea-fafe-4141-b365-5bfae9c2137b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:30.436484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bcd64-3316-4eb8-9d6b-47fa3fb8b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:30.437213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bcd64-3316-4eb8-9d6b-47fa3fb8b060 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:30.437646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bcd64-3316-4eb8-9d6b-47fa3fb8b060 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:30.437837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bcd64-3316-4eb8-9d6b-47fa3fb8b060 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:30.438581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bcd64-3316-4eb8-9d6b-47fa3fb8b060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:30.438929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bcd64-3316-4eb8-9d6b-47fa3fb8b060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:30.440659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bcd64-3316-4eb8-9d6b-47fa3fb8b060 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:30.441737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b94ab-c0db-49e7-9920-c51e9c374b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:30.443213 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b94ab-c0db-49e7-9920-c51e9c374b99 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:30.444432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b94ab-c0db-49e7-9920-c51e9c374b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:30.444961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b94ab-c0db-49e7-9920-c51e9c374b99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:30.455625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 307/617] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:30.457164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212ce16-ae14-42da-87d3-e83b7013bbfb None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:30.457456 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212ce16-ae14-42da-87d3-e83b7013bbfb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:30.457732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212ce16-ae14-42da-87d3-e83b7013bbfb None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:30.459620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 308/618] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:30.462028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b94ab-c0db-49e7-9920-c51e9c374b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:30.463811 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b94ab-c0db-49e7-9920-c51e9c374b99 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:30.470339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db9414-6181-4f9f-9e6b-cff5f7370052 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:30.470810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db9414-6181-4f9f-9e6b-cff5f7370052 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:30.471263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db9414-6181-4f9f-9e6b-cff5f7370052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3a7b94ab-c0db-49e7-9920-c51e9c374b99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:30.488285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:30.490139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:30.492125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:30.492125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:30.492125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:30.492125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:30.492125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 311/619] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:13:30.492125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b94ab-c0db-49e7-9920-c51e9c374b99 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:30.492942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-68db9414-6181-4f9f-9e6b-cff5f7370052 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:30.492942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-68db9414-6181-4f9f-9e6b-cff5f7370052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:30.527438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:30.576206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 309/620] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:30.577302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db9414-6181-4f9f-9e6b-cff5f7370052 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:30.624120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:30.643085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b94ab-c0db-49e7-9920-c51e9c374b99 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:30.696531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db9414-6181-4f9f-9e6b-cff5f7370052 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:30.704784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06288fa-785c-491e-8b77-a9b9c0455dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:30.706521 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06288fa-785c-491e-8b77-a9b9c0455dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:30.706846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06288fa-785c-491e-8b77-a9b9c0455dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:30.707086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06288fa-785c-491e-8b77-a9b9c0455dc3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:30.723515 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06288fa-785c-491e-8b77-a9b9c0455dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:30.726768 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06288fa-785c-491e-8b77-a9b9c0455dc3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f06288fa-785c-491e-8b77-a9b9c0455dc3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:30.755166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:30.757314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:30.759472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:30.759472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:30.759472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:30.759472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:30.759472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:30.759472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:30.759472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:30.759472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:30.759472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:13:30.759472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:30.764549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 312/621] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 21 08:13:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:30.766028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06288fa-785c-491e-8b77-a9b9c0455dc3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:30.775116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41981739-723f-4944-b713-8bdeaf8fbbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:30.776670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41981739-723f-4944-b713-8bdeaf8fbbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:30.777377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41981739-723f-4944-b713-8bdeaf8fbbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:30.778075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41981739-723f-4944-b713-8bdeaf8fbbd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:30.779723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41981739-723f-4944-b713-8bdeaf8fbbd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:30.780525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41981739-723f-4944-b713-8bdeaf8fbbd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:30.783603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41981739-723f-4944-b713-8bdeaf8fbbd2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:30.807115 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 310/622] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:30.809035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41981739-723f-4944-b713-8bdeaf8fbbd2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:30.857308 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:30.978438 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06288fa-785c-491e-8b77-a9b9c0455dc3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:31.006202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41981739-723f-4944-b713-8bdeaf8fbbd2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:31.050945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a837c-bfc3-43a7-a2b0-e492a3d28ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:31.052935 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a837c-bfc3-43a7-a2b0-e492a3d28ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:31.053119 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a837c-bfc3-43a7-a2b0-e492a3d28ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:31.053584 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a837c-bfc3-43a7-a2b0-e492a3d28ac3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:31.071692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e89ddd-1308-4364-8818-2da60ef52b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:31.073193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e89ddd-1308-4364-8818-2da60ef52b9c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:31.073793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e89ddd-1308-4364-8818-2da60ef52b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:31.074249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a837c-bfc3-43a7-a2b0-e492a3d28ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:31.074600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e89ddd-1308-4364-8818-2da60ef52b9c None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:31.076132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e89ddd-1308-4364-8818-2da60ef52b9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:31.076812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e89ddd-1308-4364-8818-2da60ef52b9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:31.079245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e89ddd-1308-4364-8818-2da60ef52b9c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-790a837c-bfc3-43a7-a2b0-e492a3d28ac3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:31.090573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:31.092234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:31.093682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:31.093682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:31.093682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:31.093682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:31.093682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:31.093682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:31.093682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:31.093682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:31.093682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:31.093682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:31.093682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:31.093682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:31.099553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 313/623] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:31.101938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a837c-bfc3-43a7-a2b0-e492a3d28ac3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:31.117962 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 311/624] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 21 08:13:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:31.119692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e89ddd-1308-4364-8818-2da60ef52b9c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:31.149267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:31.283536 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:31.320800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a837c-bfc3-43a7-a2b0-e492a3d28ac3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:31.323780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e89ddd-1308-4364-8818-2da60ef52b9c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:31.361690 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c453c-c3e9-44f3-8467-0bb795cd3240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:31.362679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c453c-c3e9-44f3-8467-0bb795cd3240 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:31.363026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c453c-c3e9-44f3-8467-0bb795cd3240 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:31.363349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c453c-c3e9-44f3-8467-0bb795cd3240 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:31.372355 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c453c-c3e9-44f3-8467-0bb795cd3240 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:31.373994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c453c-c3e9-44f3-8467-0bb795cd3240 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-537c453c-c3e9-44f3-8467-0bb795cd3240 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:31.389937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:31.392089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:31.394160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:31.394160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:31.394160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:31.394160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:31.394160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:31.394160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:31.394160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:31.394160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:31.394160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:13:31.394160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:31.394160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 314/625] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:13:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:31.394160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c453c-c3e9-44f3-8467-0bb795cd3240 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:31.399693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46030aa-b930-4f78-b950-518a8a48627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:31.401254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46030aa-b930-4f78-b950-518a8a48627b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:31.401919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46030aa-b930-4f78-b950-518a8a48627b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:31.402634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46030aa-b930-4f78-b950-518a8a48627b None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:31.404387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46030aa-b930-4f78-b950-518a8a48627b None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:31.405186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46030aa-b930-4f78-b950-518a8a48627b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:31.408389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46030aa-b930-4f78-b950-518a8a48627b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:31.432915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 312/626] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:31.435026 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46030aa-b930-4f78-b950-518a8a48627b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:31.484827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:31.513107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c453c-c3e9-44f3-8467-0bb795cd3240 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:31.558797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12469575-8a46-4fbb-9ba2-20081fb36fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:31.559924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12469575-8a46-4fbb-9ba2-20081fb36fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:31.560638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12469575-8a46-4fbb-9ba2-20081fb36fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:31.561044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12469575-8a46-4fbb-9ba2-20081fb36fe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:31.603612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46030aa-b930-4f78-b950-518a8a48627b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:31.641562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a098e31-1e2d-4720-b471-21a79f4c878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:31.642174 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098e31-1e2d-4720-b471-21a79f4c878a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:31.642474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098e31-1e2d-4720-b471-21a79f4c878a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:31.642723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098e31-1e2d-4720-b471-21a79f4c878a None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:31.643701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a098e31-1e2d-4720-b471-21a79f4c878a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:31.644070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a098e31-1e2d-4720-b471-21a79f4c878a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:31.646334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a098e31-1e2d-4720-b471-21a79f4c878a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:31.666753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 313/627] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jul 21 08:13:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:31.667665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a098e31-1e2d-4720-b471-21a79f4c878a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:31.670745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:31.682420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12469575-8a46-4fbb-9ba2-20081fb36fe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:31.683961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12469575-8a46-4fbb-9ba2-20081fb36fe2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:31.776964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:31.807201 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 315/628] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:31.808729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed4723-cccd-4505-8775-5ea6a4eee70a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:31.809014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed4723-cccd-4505-8775-5ea6a4eee70a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:31.809383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed4723-cccd-4505-8775-5ea6a4eee70a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:31.811113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 316/629] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:31.812056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44bba3-01ee-4a96-9db9-23298a7e6b58 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:31.812428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44bba3-01ee-4a96-9db9-23298a7e6b58 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:31.812762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44bba3-01ee-4a96-9db9-23298a7e6b58 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:31.814274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 317/630] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:31.815120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44bba3-01ee-4a96-9db9-23298a7e6b58 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:31.824211 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a098e31-1e2d-4720-b471-21a79f4c878a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:31.867766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9373c-46a3-44e8-96dc-bb561f1aa6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:31.868625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9373c-46a3-44e8-96dc-bb561f1aa6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:31.868907 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9373c-46a3-44e8-96dc-bb561f1aa6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:31.869179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9373c-46a3-44e8-96dc-bb561f1aa6e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:31.881215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9373c-46a3-44e8-96dc-bb561f1aa6e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:31.882744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9373c-46a3-44e8-96dc-bb561f1aa6e1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-41d9373c-46a3-44e8-96dc-bb561f1aa6e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:31.914044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:31.915067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:31.916019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:31.916019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:31.916019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:31.916019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:31.916259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 314/631] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:31.917518 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9373c-46a3-44e8-96dc-bb561f1aa6e1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:31.978049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44bba3-01ee-4a96-9db9-23298a7e6b58 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:32.002553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:32.028983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc709d-66de-451b-8990-aaeb4fe23708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:32.029917 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc709d-66de-451b-8990-aaeb4fe23708 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:32.030264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc709d-66de-451b-8990-aaeb4fe23708 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:32.030613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc709d-66de-451b-8990-aaeb4fe23708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:32.047339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc709d-66de-451b-8990-aaeb4fe23708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:32.050090 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc709d-66de-451b-8990-aaeb4fe23708 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:32.073979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9373c-46a3-44e8-96dc-bb561f1aa6e1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-27dc709d-66de-451b-8990-aaeb4fe23708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:32.076188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:32.077840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:32.078750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:32.078750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:32.078750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:32.078750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:32.078750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 318/632] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:32.079874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43909a07-3284-4a1b-9f10-19f7f41769d5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:32.080355 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43909a07-3284-4a1b-9f10-19f7f41769d5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:32.080861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43909a07-3284-4a1b-9f10-19f7f41769d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:32.102359 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-43909a07-3284-4a1b-9f10-19f7f41769d5 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:32.103837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-43909a07-3284-4a1b-9f10-19f7f41769d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:32.128084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae448c8c-4cdd-4ec8-a057-711d510045fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:32.129247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae448c8c-4cdd-4ec8-a057-711d510045fd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:32.129816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae448c8c-4cdd-4ec8-a057-711d510045fd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:32.130239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae448c8c-4cdd-4ec8-a057-711d510045fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:32.134488 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:32.146333 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae448c8c-4cdd-4ec8-a057-711d510045fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:32.148140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae448c8c-4cdd-4ec8-a057-711d510045fd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ae448c8c-4cdd-4ec8-a057-711d510045fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:32.170309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:32.172279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:32.174319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:32.174319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:32.174319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:32.174319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:32.174319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 315/633] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:32.174319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c1119-fb1f-40b2-b944-a99594958aca None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:32.175043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c1119-fb1f-40b2-b944-a99594958aca None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:32.175043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c1119-fb1f-40b2-b944-a99594958aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:32.202022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-181c1119-fb1f-40b2-b944-a99594958aca None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:32.204024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-181c1119-fb1f-40b2-b944-a99594958aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:32.205431 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 319/634] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:32.206838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43909a07-3284-4a1b-9f10-19f7f41769d5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:32.304771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 316/635] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:32.304771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c1119-fb1f-40b2-b944-a99594958aca None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:32.357304 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:32.370986 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43909a07-3284-4a1b-9f10-19f7f41769d5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:32.412523 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ecb4b-c5f8-4b66-90ee-81711605559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:32.413341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ecb4b-c5f8-4b66-90ee-81711605559a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:32.413719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ecb4b-c5f8-4b66-90ee-81711605559a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:32.414077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ecb4b-c5f8-4b66-90ee-81711605559a None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:32.414921 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ecb4b-c5f8-4b66-90ee-81711605559a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:32.415319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ecb4b-c5f8-4b66-90ee-81711605559a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:32.416933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ecb4b-c5f8-4b66-90ee-81711605559a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:32.430182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 320/636] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:32.431008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ecb4b-c5f8-4b66-90ee-81711605559a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:32.453656 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:32.460555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c1119-fb1f-40b2-b944-a99594958aca None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:32.503385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e16cd9-8574-473a-a516-23774ce91c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:32.504074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e16cd9-8574-473a-a516-23774ce91c67 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:32.504353 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e16cd9-8574-473a-a516-23774ce91c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:32.504659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e16cd9-8574-473a-a516-23774ce91c67 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:32.505421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e16cd9-8574-473a-a516-23774ce91c67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:32.505728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e16cd9-8574-473a-a516-23774ce91c67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:32.507223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e16cd9-8574-473a-a516-23774ce91c67 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:32.526251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 317/637] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:32.527469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e16cd9-8574-473a-a516-23774ce91c67 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:32.594056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ecb4b-c5f8-4b66-90ee-81711605559a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:32.653437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343c4cd-870a-408b-ad64-c28b2367a47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:32.654442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343c4cd-870a-408b-ad64-c28b2367a47e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:32.654842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343c4cd-870a-408b-ad64-c28b2367a47e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:32.655236 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343c4cd-870a-408b-ad64-c28b2367a47e None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:32.656131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343c4cd-870a-408b-ad64-c28b2367a47e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:32.656609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343c4cd-870a-408b-ad64-c28b2367a47e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:32.658403 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343c4cd-870a-408b-ad64-c28b2367a47e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:32.674751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:32.675021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 321/638] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:32.676310 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343c4cd-870a-408b-ad64-c28b2367a47e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:32.687177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e16cd9-8574-473a-a516-23774ce91c67 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:32.734567 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942c537-6930-47e9-98fa-40282b924240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:32.735559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942c537-6930-47e9-98fa-40282b924240 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:32.735960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942c537-6930-47e9-98fa-40282b924240 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:32.736357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942c537-6930-47e9-98fa-40282b924240 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:32.752003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942c537-6930-47e9-98fa-40282b924240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f942c537-6930-47e9-98fa-40282b924240 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:32.761734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:32.763904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 318/639] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:32.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942c537-6930-47e9-98fa-40282b924240 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:32.797173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:32.827571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343c4cd-870a-408b-ad64-c28b2367a47e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:32.879844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5dcb1-bcbd-4c47-a40e-ca57ae978d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:32.880861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5dcb1-bcbd-4c47-a40e-ca57ae978d96 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:32.881301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5dcb1-bcbd-4c47-a40e-ca57ae978d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:32.881746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5dcb1-bcbd-4c47-a40e-ca57ae978d96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:32.899654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5dcb1-bcbd-4c47-a40e-ca57ae978d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:32.906232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942c537-6930-47e9-98fa-40282b924240 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f8a5dcb1-bcbd-4c47-a40e-ca57ae978d96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:32.913559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:32.914628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:32.915460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:32.915460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:32.915460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:32.915460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:32.915460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:32.915460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:32.915460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:32.915460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:32.915460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:32.915460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:32.915460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:32.915460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:32.916454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 322/640] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:32.917493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5dcb1-bcbd-4c47-a40e-ca57ae978d96 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:32.962457 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93496680-ad35-4c31-9b36-dc97fcfb67bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:32.963698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93496680-ad35-4c31-9b36-dc97fcfb67bd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:32.964076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93496680-ad35-4c31-9b36-dc97fcfb67bd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:32.964482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93496680-ad35-4c31-9b36-dc97fcfb67bd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:32.980107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93496680-ad35-4c31-9b36-dc97fcfb67bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:32.982914 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93496680-ad35-4c31-9b36-dc97fcfb67bd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-93496680-ad35-4c31-9b36-dc97fcfb67bd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:33.011291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:33.012390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:33.013597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:33.013597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:33.013597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:33.013597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:33.013597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:33.013597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:33.013597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:33.013597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:33.013597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:13:33.013597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:33.015431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 319/641] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:33.019018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93496680-ad35-4c31-9b36-dc97fcfb67bd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:33.053842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:33.070257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5dcb1-bcbd-4c47-a40e-ca57ae978d96 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:33.126933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a6966-207c-4d65-8c4e-bd87a4981c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:33.127924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6966-207c-4d65-8c4e-bd87a4981c45 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:33.128329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6966-207c-4d65-8c4e-bd87a4981c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:33.128772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6966-207c-4d65-8c4e-bd87a4981c45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:33.140030 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a6966-207c-4d65-8c4e-bd87a4981c45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:33.142674 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a6966-207c-4d65-8c4e-bd87a4981c45 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:33.150766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-986a6966-207c-4d65-8c4e-bd87a4981c45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:33.167330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:33.169266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:33.171128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:33.171128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:33.171128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:33.171128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:33.171128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:33.171128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:33.171128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:33.171128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:33.171128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 323/642] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:33.171128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a6966-207c-4d65-8c4e-bd87a4981c45 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:33.185767 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93496680-ad35-4c31-9b36-dc97fcfb67bd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:33.234217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e680de0-37f6-4048-b59b-e2d3fac25be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:33.235495 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e680de0-37f6-4048-b59b-e2d3fac25be8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:33.235964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e680de0-37f6-4048-b59b-e2d3fac25be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:33.236405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e680de0-37f6-4048-b59b-e2d3fac25be8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:33.249634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e680de0-37f6-4048-b59b-e2d3fac25be8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:33.252670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e680de0-37f6-4048-b59b-e2d3fac25be8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3e680de0-37f6-4048-b59b-e2d3fac25be8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:33.282109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:33.283325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:33.284705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:33.284705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:33.284705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:33.284705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:33.284705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:33.284705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:33.284705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:33.284705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:33.284705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 320/643] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:33.285729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e680de0-37f6-4048-b59b-e2d3fac25be8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:33.293345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a6966-207c-4d65-8c4e-bd87a4981c45 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:33.338258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fb527-c05a-4352-9185-0a0d149f830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:33.339319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fb527-c05a-4352-9185-0a0d149f830a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:33.339789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fb527-c05a-4352-9185-0a0d149f830a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:33.340219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fb527-c05a-4352-9185-0a0d149f830a None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:33.341698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fb527-c05a-4352-9185-0a0d149f830a None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:33.342253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fb527-c05a-4352-9185-0a0d149f830a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:33.344786 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fb527-c05a-4352-9185-0a0d149f830a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:33.356634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 324/644] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:33.357934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fb527-c05a-4352-9185-0a0d149f830a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:33.408464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:33.434026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:33.446246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e680de0-37f6-4048-b59b-e2d3fac25be8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:33.488321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fb527-c05a-4352-9185-0a0d149f830a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:33.494678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed8469-83fb-4ff2-b113-b750609905a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:33.495532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed8469-83fb-4ff2-b113-b750609905a6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:33.495925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed8469-83fb-4ff2-b113-b750609905a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:33.496308 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed8469-83fb-4ff2-b113-b750609905a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:33.497266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed8469-83fb-4ff2-b113-b750609905a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:33.497658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed8469-83fb-4ff2-b113-b750609905a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:33.499238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed8469-83fb-4ff2-b113-b750609905a6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:33.509820 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 321/645] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:33.511535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed8469-83fb-4ff2-b113-b750609905a6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:33.542155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28eab01-8caf-4994-b6d9-d3935168b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:33.543082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28eab01-8caf-4994-b6d9-d3935168b065 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:33.543464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28eab01-8caf-4994-b6d9-d3935168b065 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:33.543794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28eab01-8caf-4994-b6d9-d3935168b065 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:33.544774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28eab01-8caf-4994-b6d9-d3935168b065 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:33.545150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28eab01-8caf-4994-b6d9-d3935168b065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:33.547087 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28eab01-8caf-4994-b6d9-d3935168b065 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:33.574656 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 325/646] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 21 08:13:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:33.576125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28eab01-8caf-4994-b6d9-d3935168b065 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:33.664837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed8469-83fb-4ff2-b113-b750609905a6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:33.706994 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69cc97-acf1-46b5-acb6-905ae82a441d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:33.707685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69cc97-acf1-46b5-acb6-905ae82a441d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:33.707961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69cc97-acf1-46b5-acb6-905ae82a441d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:33.708230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69cc97-acf1-46b5-acb6-905ae82a441d None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:33.709090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69cc97-acf1-46b5-acb6-905ae82a441d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:33.709416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69cc97-acf1-46b5-acb6-905ae82a441d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:33.710913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69cc97-acf1-46b5-acb6-905ae82a441d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:33.719427 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:33.726837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 322/647] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:33.727767 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69cc97-acf1-46b5-acb6-905ae82a441d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:33.730251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28eab01-8caf-4994-b6d9-d3935168b065 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:33.754124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:33.775486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2151d-4825-4b87-9452-e189044c15d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:33.776614 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2151d-4825-4b87-9452-e189044c15d9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:33.777065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2151d-4825-4b87-9452-e189044c15d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:33.777502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2151d-4825-4b87-9452-e189044c15d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:33.778908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2151d-4825-4b87-9452-e189044c15d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:33.779422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2151d-4825-4b87-9452-e189044c15d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:33.781533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2151d-4825-4b87-9452-e189044c15d9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:33.800803 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 326/648] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:33.802251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2151d-4825-4b87-9452-e189044c15d9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:33.875324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69cc97-acf1-46b5-acb6-905ae82a441d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:33.922367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd8fab-c1dc-4cd1-8b38-6f40185f656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:33.923624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8fab-c1dc-4cd1-8b38-6f40185f656e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:33.924070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8fab-c1dc-4cd1-8b38-6f40185f656e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:33.924545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8fab-c1dc-4cd1-8b38-6f40185f656e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:33.939770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2151d-4825-4b87-9452-e189044c15d9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:33.942230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd8fab-c1dc-4cd1-8b38-6f40185f656e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:33.944470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd8fab-c1dc-4cd1-8b38-6f40185f656e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-edcd8fab-c1dc-4cd1-8b38-6f40185f656e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:33.969398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:33.971496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:33.973367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:33.973367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:33.973367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:33.973367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:33.973367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 323/649] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:33.974087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd8fab-c1dc-4cd1-8b38-6f40185f656e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:33.990411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216da6d1-98c0-41b0-bd8f-2118a411f47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:33.990790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216da6d1-98c0-41b0-bd8f-2118a411f47f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:33.991078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216da6d1-98c0-41b0-bd8f-2118a411f47f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:33.991352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216da6d1-98c0-41b0-bd8f-2118a411f47f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:34.005489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216da6d1-98c0-41b0-bd8f-2118a411f47f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:34.007162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216da6d1-98c0-41b0-bd8f-2118a411f47f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-216da6d1-98c0-41b0-bd8f-2118a411f47f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:34.029631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:34.031593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:34.033893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:34.033893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:34.033893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:34.033893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:34.033893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 327/650] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:34.033893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216da6d1-98c0-41b0-bd8f-2118a411f47f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:34.050387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:34.082806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:34.131392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd8fab-c1dc-4cd1-8b38-6f40185f656e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:34.184518 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71161d9e-b83a-4043-93d0-ff6c38641f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:34.185172 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71161d9e-b83a-4043-93d0-ff6c38641f1e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:34.185690 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71161d9e-b83a-4043-93d0-ff6c38641f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:34.186076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71161d9e-b83a-4043-93d0-ff6c38641f1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:34.196639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216da6d1-98c0-41b0-bd8f-2118a411f47f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:34.240839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa32a0-0e0d-4917-9d7e-9e781a854e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:34.242050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa32a0-0e0d-4917-9d7e-9e781a854e15 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:34.242392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa32a0-0e0d-4917-9d7e-9e781a854e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:34.242727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa32a0-0e0d-4917-9d7e-9e781a854e15 None admin] PATH_INFO: `/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/300b1990926c4968b75a84a1f5794df1/roles/9e4aabf99fc8417596f726f0229d19a6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:34.263213 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa32a0-0e0d-4917-9d7e-9e781a854e15 None admin] RBAC: Authorizing `identity:create_grant(project_id=c487ed72a15c45faa40f743ae752e48b, user_id=300b1990926c4968b75a84a1f5794df1, role_id=9e4aabf99fc8417596f726f0229d19a6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:34.265721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa32a0-0e0d-4917-9d7e-9e781a854e15 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:34.280098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71161d9e-b83a-4043-93d0-ff6c38641f1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:34.282113 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71161d9e-b83a-4043-93d0-ff6c38641f1e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:34.296532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 328/651] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:13:34 2022] PUT /identity/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/300b1990926c4968b75a84a1f5794df1/roles/9e4aabf99fc8417596f726f0229d19a6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:13:34.296532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa32a0-0e0d-4917-9d7e-9e781a854e15 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:34.376485 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:34.425335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:34.463887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa32a0-0e0d-4917-9d7e-9e781a854e15 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:34.487442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 324/652] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:34.487442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71161d9e-b83a-4043-93d0-ff6c38641f1e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:34.515652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9aeb4-f0c1-4ce7-9551-52ec94ad3b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:34.516092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9aeb4-f0c1-4ce7-9551-52ec94ad3b66 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:34.516380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9aeb4-f0c1-4ce7-9551-52ec94ad3b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:34.516684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9aeb4-f0c1-4ce7-9551-52ec94ad3b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:34.517554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9aeb4-f0c1-4ce7-9551-52ec94ad3b66 None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=421f05e3d10e4393b28f77b6179ade8c) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:34.517871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9aeb4-f0c1-4ce7-9551-52ec94ad3b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:34.519424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9aeb4-f0c1-4ce7-9551-52ec94ad3b66 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:34.527159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 329/653] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:34 2022] GET /identity/v3/role_assignments?user.id=421f05e3d10e4393b28f77b6179ade8c&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:34.527773 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9aeb4-f0c1-4ce7-9551-52ec94ad3b66 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:34.692754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9aeb4-f0c1-4ce7-9551-52ec94ad3b66 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:34.699428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71161d9e-b83a-4043-93d0-ff6c38641f1e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:34.749621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b60d59-7bf1-4c95-aa5e-9e603edc7e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:34.750805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b60d59-7bf1-4c95-aa5e-9e603edc7e5f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:34.751274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b60d59-7bf1-4c95-aa5e-9e603edc7e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:34.751733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b60d59-7bf1-4c95-aa5e-9e603edc7e5f None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:34.753096 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b60d59-7bf1-4c95-aa5e-9e603edc7e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:34.753692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b60d59-7bf1-4c95-aa5e-9e603edc7e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:34.756577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b60d59-7bf1-4c95-aa5e-9e603edc7e5f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:34.778803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8337a2-0e9a-417c-a942-38fe129b56da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:34.780266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8337a2-0e9a-417c-a942-38fe129b56da None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:34.780999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8337a2-0e9a-417c-a942-38fe129b56da None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:34.781671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8337a2-0e9a-417c-a942-38fe129b56da None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:34.783434 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8337a2-0e9a-417c-a942-38fe129b56da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:34.784272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8337a2-0e9a-417c-a942-38fe129b56da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:34.785124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 330/654] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:34.786799 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b60d59-7bf1-4c95-aa5e-9e603edc7e5f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:34.787992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8337a2-0e9a-417c-a942-38fe129b56da None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:34.797535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:34.819616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 325/655] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:34.819616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8337a2-0e9a-417c-a942-38fe129b56da None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:34.843288 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:35.018835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b60d59-7bf1-4c95-aa5e-9e603edc7e5f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:35.025552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8337a2-0e9a-417c-a942-38fe129b56da None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:35.092700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcd274-fbee-4400-9c98-4f3bf31a02a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:35.095949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcd274-fbee-4400-9c98-4f3bf31a02a5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:35.096587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcd274-fbee-4400-9c98-4f3bf31a02a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:35.097041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcd274-fbee-4400-9c98-4f3bf31a02a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:35.100274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7e096-a61c-4162-bfe9-58f8f2232e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:35.102151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7e096-a61c-4162-bfe9-58f8f2232e53 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:35.103292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7e096-a61c-4162-bfe9-58f8f2232e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:35.103877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7e096-a61c-4162-bfe9-58f8f2232e53 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:35.119902 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcd274-fbee-4400-9c98-4f3bf31a02a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:35.120896 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7e096-a61c-4162-bfe9-58f8f2232e53 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:35.122572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcd274-fbee-4400-9c98-4f3bf31a02a5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:35.123741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7e096-a61c-4162-bfe9-58f8f2232e53 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-89d7e096-a61c-4162-bfe9-58f8f2232e53 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:35.155965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:35.157195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:35.158361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:35.158361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:35.158361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:35.158361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:35.158361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:35.158361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:35.158361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:35.158361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:35.158361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:13:35.158361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f3dcd274-fbee-4400-9c98-4f3bf31a02a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:35.160385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:35.161483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:35.162577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:35.162577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:35.162577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:35.162577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:35.168896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 331/657] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:35.169102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 326/657] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:35.171175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7e096-a61c-4162-bfe9-58f8f2232e53 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:35.171821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcd274-fbee-4400-9c98-4f3bf31a02a5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:35.327338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:35.360726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:35.431597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcd274-fbee-4400-9c98-4f3bf31a02a5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:35.438320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7e096-a61c-4162-bfe9-58f8f2232e53 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:35.507289 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cd843-ba62-4783-a82d-213384a36830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:35.508812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cd843-ba62-4783-a82d-213384a36830 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:35.509459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cd843-ba62-4783-a82d-213384a36830 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:35.510072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cd843-ba62-4783-a82d-213384a36830 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:35.511806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cd843-ba62-4783-a82d-213384a36830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:35.512613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cd843-ba62-4783-a82d-213384a36830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:35.513298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057504b-cfdd-4d0f-872b-34864e6da464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:35.514821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057504b-cfdd-4d0f-872b-34864e6da464 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:35.515435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057504b-cfdd-4d0f-872b-34864e6da464 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:35.515936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cd843-ba62-4783-a82d-213384a36830 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:35.516129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057504b-cfdd-4d0f-872b-34864e6da464 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:35.535072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057504b-cfdd-4d0f-872b-34864e6da464 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:35.538505 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057504b-cfdd-4d0f-872b-34864e6da464 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:35.545867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 332/658] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:13:35.548664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cd843-ba62-4783-a82d-213384a36830 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2057504b-cfdd-4d0f-872b-34864e6da464 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:35.575646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:35.577762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:35.579809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:35.579809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:35.579809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:35.579809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:35.579809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:35.579809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:35.579809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:35.579809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:35.579809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:13:35.579809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:35.589478 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 327/659] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:35.589800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057504b-cfdd-4d0f-872b-34864e6da464 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:35.744988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cd843-ba62-4783-a82d-213384a36830 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:35.773764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:35.809121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8e660-6f75-45de-884d-2934d00cc815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:35.810589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8e660-6f75-45de-884d-2934d00cc815 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:35.811048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8e660-6f75-45de-884d-2934d00cc815 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:35.811429 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8e660-6f75-45de-884d-2934d00cc815 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:35.812734 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8e660-6f75-45de-884d-2934d00cc815 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:35.813237 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8e660-6f75-45de-884d-2934d00cc815 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:35.814848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8e660-6f75-45de-884d-2934d00cc815 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:35.824627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057504b-cfdd-4d0f-872b-34864e6da464 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:35.849042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 333/660] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 21 08:13:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:35.851142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8e660-6f75-45de-884d-2934d00cc815 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:35.869163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:35.875416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff4636-9f63-4cca-9a1a-bad41d7a02e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:35.876409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff4636-9f63-4cca-9a1a-bad41d7a02e2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:35.876826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff4636-9f63-4cca-9a1a-bad41d7a02e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:35.877200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff4636-9f63-4cca-9a1a-bad41d7a02e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:35.885658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff4636-9f63-4cca-9a1a-bad41d7a02e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:35.887396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff4636-9f63-4cca-9a1a-bad41d7a02e2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-66ff4636-9f63-4cca-9a1a-bad41d7a02e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:35.903987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:35.905975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:35.908003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:35.908003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:35.908003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:35.908003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:35.908003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:35.908003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:35.908003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:35.908003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:35.909326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 328/661] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:35.914223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff4636-9f63-4cca-9a1a-bad41d7a02e2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:36.052229 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff4636-9f63-4cca-9a1a-bad41d7a02e2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:36.052707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8e660-6f75-45de-884d-2934d00cc815 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:36.100907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98b6ea-c1f4-41d8-bc09-0f21aa7d582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:36.102170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98b6ea-c1f4-41d8-bc09-0f21aa7d582b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:36.102625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98b6ea-c1f4-41d8-bc09-0f21aa7d582b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:36.103205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98b6ea-c1f4-41d8-bc09-0f21aa7d582b None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:36.104813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98b6ea-c1f4-41d8-bc09-0f21aa7d582b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:36.105356 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98b6ea-c1f4-41d8-bc09-0f21aa7d582b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:36.108129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98b6ea-c1f4-41d8-bc09-0f21aa7d582b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:36.116917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104ab64-24f9-4031-9464-b253da08bb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:36.117993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104ab64-24f9-4031-9464-b253da08bb6c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:36.118440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104ab64-24f9-4031-9464-b253da08bb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:36.118889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104ab64-24f9-4031-9464-b253da08bb6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:36.149153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 334/662] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Jul 21 08:13:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:36.150876 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98b6ea-c1f4-41d8-bc09-0f21aa7d582b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:36.204891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:36.244114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:36.266639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104ab64-24f9-4031-9464-b253da08bb6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:36.270212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104ab64-24f9-4031-9464-b253da08bb6c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:36.291962 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98b6ea-c1f4-41d8-bc09-0f21aa7d582b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:36.355111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dcbac-55eb-4f29-ba8b-80a9184425e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:36.356191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dcbac-55eb-4f29-ba8b-80a9184425e0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:36.356678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dcbac-55eb-4f29-ba8b-80a9184425e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:36.357135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dcbac-55eb-4f29-ba8b-80a9184425e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:36.358578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dcbac-55eb-4f29-ba8b-80a9184425e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:36.359093 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dcbac-55eb-4f29-ba8b-80a9184425e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:36.361883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dcbac-55eb-4f29-ba8b-80a9184425e0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:36.396393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 335/663] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:36.398184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dcbac-55eb-4f29-ba8b-80a9184425e0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:36.496753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 329/664] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:36.499574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104ab64-24f9-4031-9464-b253da08bb6c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:36.593584 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:36.617585 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dcbac-55eb-4f29-ba8b-80a9184425e0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:36.696554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e58fe-8337-4125-8318-e9da8d0767b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:36.697689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e58fe-8337-4125-8318-e9da8d0767b7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:36.698127 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e58fe-8337-4125-8318-e9da8d0767b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:36.698597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e58fe-8337-4125-8318-e9da8d0767b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:36.709339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:36.731157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104ab64-24f9-4031-9464-b253da08bb6c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:36.809106 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9472-6fef-4557-872b-6d3acc5a7934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:36.810969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9472-6fef-4557-872b-6d3acc5a7934 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:36.811900 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9472-6fef-4557-872b-6d3acc5a7934 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:36.812747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9472-6fef-4557-872b-6d3acc5a7934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:36.814648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b9472-6fef-4557-872b-6d3acc5a7934 None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=f4f9a6f6d6d840d6bc29fd0ab26ddb29) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:36.815548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b9472-6fef-4557-872b-6d3acc5a7934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:36.818668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b9472-6fef-4557-872b-6d3acc5a7934 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:36.832514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 330/665] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:36 2022] GET /identity/v3/role_assignments?user.id=f4f9a6f6d6d840d6bc29fd0ab26ddb29&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:36.834656 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9472-6fef-4557-872b-6d3acc5a7934 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:36.850160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e58fe-8337-4125-8318-e9da8d0767b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:36.852914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e58fe-8337-4125-8318-e9da8d0767b7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:37.103207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:37.128837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 336/666] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:37.131344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e58fe-8337-4125-8318-e9da8d0767b7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:37.144457 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9472-6fef-4557-872b-6d3acc5a7934 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:37.233638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7db53-5e64-4aa2-af6c-518453bea144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:37.234905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7db53-5e64-4aa2-af6c-518453bea144 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:37.235349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7db53-5e64-4aa2-af6c-518453bea144 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:37.235800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7db53-5e64-4aa2-af6c-518453bea144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:37.254780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7db53-5e64-4aa2-af6c-518453bea144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:37.257552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7db53-5e64-4aa2-af6c-518453bea144 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3fa7db53-5e64-4aa2-af6c-518453bea144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:37.296470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:37.298246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:37.300002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:37.300002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:37.300002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:37.300002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:37.300002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 331/667] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:37.306236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55bf0d-7d59-4a94-8a8a-0afb3e009f29 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:37.306721 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55bf0d-7d59-4a94-8a8a-0afb3e009f29 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:37.307175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55bf0d-7d59-4a94-8a8a-0afb3e009f29 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:37.310284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 332/668] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:37.311946 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55bf0d-7d59-4a94-8a8a-0afb3e009f29 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:37.337172 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:37.367839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e58fe-8337-4125-8318-e9da8d0767b7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:37.432063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebb885-fbb3-4bbb-855b-fac5f06766f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:37.432937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebb885-fbb3-4bbb-855b-fac5f06766f6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:37.433220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebb885-fbb3-4bbb-855b-fac5f06766f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:37.433488 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebb885-fbb3-4bbb-855b-fac5f06766f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:37.447261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebb885-fbb3-4bbb-855b-fac5f06766f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:37.448808 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebb885-fbb3-4bbb-855b-fac5f06766f6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-edebb885-fbb3-4bbb-855b-fac5f06766f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:37.498390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:37.500173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:37.501938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:37.501938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:37.501938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:37.501938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:37.505134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 337/669] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:37.510073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968771d1-72b6-4b9a-82cd-96df38fad57e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:37.510335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968771d1-72b6-4b9a-82cd-96df38fad57e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:37.510671 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968771d1-72b6-4b9a-82cd-96df38fad57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:37.529410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55bf0d-7d59-4a94-8a8a-0afb3e009f29 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:37.537809 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-968771d1-72b6-4b9a-82cd-96df38fad57e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:37.541732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-968771d1-72b6-4b9a-82cd-96df38fad57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:37.577417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33aaf0-ecfb-4757-85fb-66922c485cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:37.578216 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33aaf0-ecfb-4757-85fb-66922c485cea None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:37.578574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33aaf0-ecfb-4757-85fb-66922c485cea None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:37.579032 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33aaf0-ecfb-4757-85fb-66922c485cea None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:37.579776 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33aaf0-ecfb-4757-85fb-66922c485cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:37.580202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33aaf0-ecfb-4757-85fb-66922c485cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:37.582148 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33aaf0-ecfb-4757-85fb-66922c485cea None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:37.597111 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 333/670] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:37.598548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33aaf0-ecfb-4757-85fb-66922c485cea None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:37.653373 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:37.693958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:37.728720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 338/671] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:37.730537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968771d1-72b6-4b9a-82cd-96df38fad57e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:37.764838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33aaf0-ecfb-4757-85fb-66922c485cea None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:37.813746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3237165-0430-450a-919d-57d3f0361efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:37.814446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3237165-0430-450a-919d-57d3f0361efc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:37.814728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3237165-0430-450a-919d-57d3f0361efc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:37.815001 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3237165-0430-450a-919d-57d3f0361efc None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:37.815744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3237165-0430-450a-919d-57d3f0361efc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:37.816121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3237165-0430-450a-919d-57d3f0361efc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:37.817597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3237165-0430-450a-919d-57d3f0361efc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:37.831770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 334/672] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:37.833248 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ccb99-2114-494f-abb5-c7d64c4d73d2 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:37.833531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ccb99-2114-494f-abb5-c7d64c4d73d2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:37.833803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ccb99-2114-494f-abb5-c7d64c4d73d2 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:37.836692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 335/673] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:37.838409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ccb99-2114-494f-abb5-c7d64c4d73d2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:37.944090 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968771d1-72b6-4b9a-82cd-96df38fad57e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:37.989898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ccb99-2114-494f-abb5-c7d64c4d73d2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:37.991622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e73bb-5e65-4718-bf25-9f10a5101f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:37.992670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e73bb-5e65-4718-bf25-9f10a5101f44 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:37.993223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e73bb-5e65-4718-bf25-9f10a5101f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:37.993567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e73bb-5e65-4718-bf25-9f10a5101f44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:38.002668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e73bb-5e65-4718-bf25-9f10a5101f44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:38.004686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e73bb-5e65-4718-bf25-9f10a5101f44 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-810e73bb-5e65-4718-bf25-9f10a5101f44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:38.022680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:38.024602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:38.026339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:38.026339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:38.026339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:38.026339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:38.026339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:38.026339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:38.026339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:38.026339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:38.026339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 339/674] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:38.026339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e73bb-5e65-4718-bf25-9f10a5101f44 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:38.051883 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:38.070370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68049524-2842-469a-947f-de6c3c5021d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:38.071970 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68049524-2842-469a-947f-de6c3c5021d8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:38.072458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68049524-2842-469a-947f-de6c3c5021d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:38.072996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68049524-2842-469a-947f-de6c3c5021d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:38.075690 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:38.095812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68049524-2842-469a-947f-de6c3c5021d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-68049524-2842-469a-947f-de6c3c5021d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:38.111725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:38.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:38.113754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:38.113754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:38.113754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:38.113754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:38.113754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:38.113754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:38.113754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:38.113754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:38.113754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:38.113754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:38.113754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:38.113754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:38.114721 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 336/675] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:38.116873 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47e338-1146-4da6-958e-afee4a610b35 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:38.117333 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47e338-1146-4da6-958e-afee4a610b35 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:38.117786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47e338-1146-4da6-958e-afee4a610b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:38.146968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ec47e338-1146-4da6-958e-afee4a610b35 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:38.149078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ec47e338-1146-4da6-958e-afee4a610b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:38.175993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e73bb-5e65-4718-bf25-9f10a5101f44 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:38.225433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110f008-851b-4316-8fb4-d601693579ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:38.226829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110f008-851b-4316-8fb4-d601693579ce None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:38.227316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110f008-851b-4316-8fb4-d601693579ce None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:38.227792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110f008-851b-4316-8fb4-d601693579ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:38.241215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110f008-851b-4316-8fb4-d601693579ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:38.243941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110f008-851b-4316-8fb4-d601693579ce None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:38.264589 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 337/676] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:38.264589 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47e338-1146-4da6-958e-afee4a610b35 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c110f008-851b-4316-8fb4-d601693579ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:38.276217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:38.277324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:38.278215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:38.278215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:38.278215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:38.278215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:38.278215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:38.278215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:38.278215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:38.278215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:38.279217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 340/677] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:38.281199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110f008-851b-4316-8fb4-d601693579ce None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:38.425301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:38.434570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110f008-851b-4316-8fb4-d601693579ce None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:38.468729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47e338-1146-4da6-958e-afee4a610b35 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:38.486276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d81830-6691-4d8f-b744-f53525176b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:38.487244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d81830-6691-4d8f-b744-f53525176b82 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:38.487720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d81830-6691-4d8f-b744-f53525176b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:38.488188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d81830-6691-4d8f-b744-f53525176b82 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:38.489383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d81830-6691-4d8f-b744-f53525176b82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:38.489884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d81830-6691-4d8f-b744-f53525176b82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:38.492321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d81830-6691-4d8f-b744-f53525176b82 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:38.503476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:38.506558 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 341/678] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:38.508071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d81830-6691-4d8f-b744-f53525176b82 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:38.540541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835362f3-68bc-41b9-8cc7-7709f30e9be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:38.541491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835362f3-68bc-41b9-8cc7-7709f30e9be5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:38.542022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835362f3-68bc-41b9-8cc7-7709f30e9be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:38.542510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835362f3-68bc-41b9-8cc7-7709f30e9be5 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:38.543742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835362f3-68bc-41b9-8cc7-7709f30e9be5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:38.544268 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835362f3-68bc-41b9-8cc7-7709f30e9be5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:38.546538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835362f3-68bc-41b9-8cc7-7709f30e9be5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:38.563458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 338/679] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:38.564994 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835362f3-68bc-41b9-8cc7-7709f30e9be5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:38.705252 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835362f3-68bc-41b9-8cc7-7709f30e9be5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:38.707389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d81830-6691-4d8f-b744-f53525176b82 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:38.751109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1637f46-dd25-4a8e-b8be-8e66745ce229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:38.751811 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1637f46-dd25-4a8e-b8be-8e66745ce229 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:38.752088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1637f46-dd25-4a8e-b8be-8e66745ce229 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:38.752358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1637f46-dd25-4a8e-b8be-8e66745ce229 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:38.767449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1637f46-dd25-4a8e-b8be-8e66745ce229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:38.774736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400e43-64ee-487f-a439-45e9ee86665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:38.775714 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400e43-64ee-487f-a439-45e9ee86665a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:38.776085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400e43-64ee-487f-a439-45e9ee86665a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:38.776421 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400e43-64ee-487f-a439-45e9ee86665a None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:38.779174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400e43-64ee-487f-a439-45e9ee86665a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:38.779174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400e43-64ee-487f-a439-45e9ee86665a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:38.779174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400e43-64ee-487f-a439-45e9ee86665a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f1637f46-dd25-4a8e-b8be-8e66745ce229 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:38.788010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:38.797698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 339/680] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:38.799490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1637f46-dd25-4a8e-b8be-8e66745ce229 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:38.809145 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 342/681] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:38.811334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400e43-64ee-487f-a439-45e9ee86665a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:38.845933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:38.852537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:38.965874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400e43-64ee-487f-a439-45e9ee86665a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:38.985574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1637f46-dd25-4a8e-b8be-8e66745ce229 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:39.013485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3846a-c6db-4ff6-a843-59c57bd67716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:39.014072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3846a-c6db-4ff6-a843-59c57bd67716 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:39.014348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3846a-c6db-4ff6-a843-59c57bd67716 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:39.014630 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3846a-c6db-4ff6-a843-59c57bd67716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:39.015518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3846a-c6db-4ff6-a843-59c57bd67716 None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=8e44cec1e8ee4c82b104cf64ae0de6d6) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:39.015830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3846a-c6db-4ff6-a843-59c57bd67716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:39.017399 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3846a-c6db-4ff6-a843-59c57bd67716 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:39.036533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 343/682] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:38 2022] GET /identity/v3/role_assignments?user.id=8e44cec1e8ee4c82b104cf64ae0de6d6&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:39.036533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3846a-c6db-4ff6-a843-59c57bd67716 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:39.065200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431f2cb-b72d-4fe6-b0fe-30ac997e954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:39.066709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431f2cb-b72d-4fe6-b0fe-30ac997e954d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:39.067304 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431f2cb-b72d-4fe6-b0fe-30ac997e954d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:39.067825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431f2cb-b72d-4fe6-b0fe-30ac997e954d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:39.088960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431f2cb-b72d-4fe6-b0fe-30ac997e954d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:39.092087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431f2cb-b72d-4fe6-b0fe-30ac997e954d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9431f2cb-b72d-4fe6-b0fe-30ac997e954d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:39.126387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:39.128175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:39.130755 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:39.130755 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:39.130755 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:39.130755 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:39.135346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 340/683] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:39.135346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431f2cb-b72d-4fe6-b0fe-30ac997e954d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:39.195774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:39.231993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3846a-c6db-4ff6-a843-59c57bd67716 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:39.304658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f03fb-a731-4083-bcbc-e76895bf5f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:39.304658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f03fb-a731-4083-bcbc-e76895bf5f0f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:39.304983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f03fb-a731-4083-bcbc-e76895bf5f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:39.305327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f03fb-a731-4083-bcbc-e76895bf5f0f None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:39.306835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f03fb-a731-4083-bcbc-e76895bf5f0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:39.307342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f03fb-a731-4083-bcbc-e76895bf5f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:39.309819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f03fb-a731-4083-bcbc-e76895bf5f0f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:39.327524 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:39.336009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 344/684] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:39.336009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f03fb-a731-4083-bcbc-e76895bf5f0f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:39.356196 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431f2cb-b72d-4fe6-b0fe-30ac997e954d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:39.416563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0515df4-f127-43be-8037-6a8e170e3e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:39.416563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0515df4-f127-43be-8037-6a8e170e3e43 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:39.416563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0515df4-f127-43be-8037-6a8e170e3e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:39.416563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0515df4-f127-43be-8037-6a8e170e3e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:39.417647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0515df4-f127-43be-8037-6a8e170e3e43 None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=06a267cec6fb4dbea619f0a77b5674dc) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:39.418194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0515df4-f127-43be-8037-6a8e170e3e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:39.420460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0515df4-f127-43be-8037-6a8e170e3e43 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:39.432371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 341/685] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:39 2022] GET /identity/v3/role_assignments?user.id=06a267cec6fb4dbea619f0a77b5674dc&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:39.433812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0515df4-f127-43be-8037-6a8e170e3e43 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:39.537861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f03fb-a731-4083-bcbc-e76895bf5f0f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:39.602621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5021d4-3fbb-4b69-8414-d6c62a733709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:39.603762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5021d4-3fbb-4b69-8414-d6c62a733709 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:39.604263 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5021d4-3fbb-4b69-8414-d6c62a733709 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:39.604787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5021d4-3fbb-4b69-8414-d6c62a733709 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:39.606240 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5021d4-3fbb-4b69-8414-d6c62a733709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:39.606780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5021d4-3fbb-4b69-8414-d6c62a733709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:39.609612 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5021d4-3fbb-4b69-8414-d6c62a733709 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:39.635033 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 345/686] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:39.637803 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855f87f-8299-41bc-ab52-2049f222ebd0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:39.638305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855f87f-8299-41bc-ab52-2049f222ebd0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:39.638788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855f87f-8299-41bc-ab52-2049f222ebd0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:39.641998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 346/687] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:39.647879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190b032-310e-426e-a469-0faca5002f69 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:39.648213 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190b032-310e-426e-a469-0faca5002f69 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:39.648434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190b032-310e-426e-a469-0faca5002f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:39.653983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:39.681909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3190b032-310e-426e-a469-0faca5002f69 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:39.684265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3190b032-310e-426e-a469-0faca5002f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:39.715301 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0515df4-f127-43be-8037-6a8e170e3e43 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:39.788187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691d463-4f84-4ae6-b62c-22d0bddcec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:39.789644 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691d463-4f84-4ae6-b62c-22d0bddcec97 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:39.790160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691d463-4f84-4ae6-b62c-22d0bddcec97 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:39.790662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691d463-4f84-4ae6-b62c-22d0bddcec97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:39.803336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 347/688] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:13:39.805056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190b032-310e-426e-a469-0faca5002f69 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:39.812007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691d463-4f84-4ae6-b62c-22d0bddcec97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:39.814883 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691d463-4f84-4ae6-b62c-22d0bddcec97 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7691d463-4f84-4ae6-b62c-22d0bddcec97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:39.843061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:39.844028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:39.844950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:39.844950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:39.844950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:39.844950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:39.844950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 342/689] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:39.845584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691d463-4f84-4ae6-b62c-22d0bddcec97 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:39.850529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:39.957268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190b032-310e-426e-a469-0faca5002f69 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:39.973403 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691d463-4f84-4ae6-b62c-22d0bddcec97 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:40.005383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:40.013408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caff2a-cc80-4a88-97ae-066d318877ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:40.013947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897f939-bdcd-4387-9efe-044275cfe5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:40.014780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897f939-bdcd-4387-9efe-044275cfe5ec None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:40.015000 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caff2a-cc80-4a88-97ae-066d318877ea None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:40.015101 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897f939-bdcd-4387-9efe-044275cfe5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:40.015323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897f939-bdcd-4387-9efe-044275cfe5ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:40.015728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caff2a-cc80-4a88-97ae-066d318877ea None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:40.016334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caff2a-cc80-4a88-97ae-066d318877ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:40.027324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caff2a-cc80-4a88-97ae-066d318877ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:40.028583 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897f939-bdcd-4387-9efe-044275cfe5ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:40.029550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caff2a-cc80-4a88-97ae-066d318877ea None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:40.030234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897f939-bdcd-4387-9efe-044275cfe5ec None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d3caff2a-cc80-4a88-97ae-066d318877ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:40.048410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:40.049500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:40.050458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:40.050458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:40.050458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:40.050458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:40.050458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:40.050458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:40.050458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:40.050458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:40.050458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:13:40.050458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3897f939-bdcd-4387-9efe-044275cfe5ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:40.051025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:40.051808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:40.052712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:40.052712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:40.052712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:40.052712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:40.055435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 348/691] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:13:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:40.056569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caff2a-cc80-4a88-97ae-066d318877ea None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:40.057043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 343/691] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:40.061957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897f939-bdcd-4387-9efe-044275cfe5ec None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:40.152853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:40.208083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caff2a-cc80-4a88-97ae-066d318877ea None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:40.215803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897f939-bdcd-4387-9efe-044275cfe5ec None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:40.261514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c45307-7788-420f-97d8-ae75da2be513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:40.262305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c45307-7788-420f-97d8-ae75da2be513 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:40.262649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c45307-7788-420f-97d8-ae75da2be513 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:40.263013 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c45307-7788-420f-97d8-ae75da2be513 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:40.263256 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64727b7c-9764-4f27-9c51-6262d2f015e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:40.263979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c45307-7788-420f-97d8-ae75da2be513 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:40.264298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c45307-7788-420f-97d8-ae75da2be513 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:40.264639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64727b7c-9764-4f27-9c51-6262d2f015e0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:40.265134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64727b7c-9764-4f27-9c51-6262d2f015e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:40.265599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64727b7c-9764-4f27-9c51-6262d2f015e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:40.265934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c45307-7788-420f-97d8-ae75da2be513 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:40.266808 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64727b7c-9764-4f27-9c51-6262d2f015e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:40.267332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64727b7c-9764-4f27-9c51-6262d2f015e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:40.270859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64727b7c-9764-4f27-9c51-6262d2f015e0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:40.288199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 349/692] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:40.289459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64727b7c-9764-4f27-9c51-6262d2f015e0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:40.293114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 344/693] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jul 21 08:13:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:13:40.294863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c45307-7788-420f-97d8-ae75da2be513 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:40.382021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:40.431717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c45307-7788-420f-97d8-ae75da2be513 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:40.449708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:40.473176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64727b7c-9764-4f27-9c51-6262d2f015e0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:40.488416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5c845-ca8e-4e12-8b48-c622eba43375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:40.489334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5c845-ca8e-4e12-8b48-c622eba43375 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:40.489620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5c845-ca8e-4e12-8b48-c622eba43375 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:40.489895 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5c845-ca8e-4e12-8b48-c622eba43375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:40.537855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cfcbe-ce60-49d7-a365-cb1d477ac26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:40.539182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cfcbe-ce60-49d7-a365-cb1d477ac26d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:40.539843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cfcbe-ce60-49d7-a365-cb1d477ac26d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:40.540291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cfcbe-ce60-49d7-a365-cb1d477ac26d None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:40.541544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cfcbe-ce60-49d7-a365-cb1d477ac26d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:40.542109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cfcbe-ce60-49d7-a365-cb1d477ac26d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:40.544422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cfcbe-ce60-49d7-a365-cb1d477ac26d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:40.568081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 350/694] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:40.569772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cfcbe-ce60-49d7-a365-cb1d477ac26d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:40.577266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5c845-ca8e-4e12-8b48-c622eba43375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:40.578844 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5c845-ca8e-4e12-8b48-c622eba43375 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:40.696914 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 345/695] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:40.697963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5c845-ca8e-4e12-8b48-c622eba43375 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:40.716351 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:40.771754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cfcbe-ce60-49d7-a365-cb1d477ac26d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:40.801443 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:40.820228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5c845-ca8e-4e12-8b48-c622eba43375 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:40.847822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c564e-5662-4dd3-8a5a-32a6876ea32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:40.849785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c564e-5662-4dd3-8a5a-32a6876ea32f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:40.850690 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c564e-5662-4dd3-8a5a-32a6876ea32f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:40.851448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c564e-5662-4dd3-8a5a-32a6876ea32f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:40.859916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec020493-585c-43f8-aaa0-b90c50d9fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:40.860653 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec020493-585c-43f8-aaa0-b90c50d9fd8d None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:40.861120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec020493-585c-43f8-aaa0-b90c50d9fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:40.861425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec020493-585c-43f8-aaa0-b90c50d9fd8d None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:40.862159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec020493-585c-43f8-aaa0-b90c50d9fd8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:40.863789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec020493-585c-43f8-aaa0-b90c50d9fd8d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:40.869254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c564e-5662-4dd3-8a5a-32a6876ea32f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:40.872993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c564e-5662-4dd3-8a5a-32a6876ea32f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:40.887996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 346/696] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:13:40 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:13:40.893244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec020493-585c-43f8-aaa0-b90c50d9fd8d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b05c564e-5662-4dd3-8a5a-32a6876ea32f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:40.913348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:40.915255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:40.917260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:40.917260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:40.917260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:40.917260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:40.917260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:40.917260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:40.917260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:40.917260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:40.917260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:13:40.917260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:40.928839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 351/697] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 21 08:13:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:40.932809 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c564e-5662-4dd3-8a5a-32a6876ea32f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:41.083083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:41.139696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c564e-5662-4dd3-8a5a-32a6876ea32f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:41.163410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec020493-585c-43f8-aaa0-b90c50d9fd8d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:41.217724 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bc59c-02d6-4c9a-93fc-f4d3b7c8b655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:41.220038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bc59c-02d6-4c9a-93fc-f4d3b7c8b655 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:41.220976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bc59c-02d6-4c9a-93fc-f4d3b7c8b655 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:41.221788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bc59c-02d6-4c9a-93fc-f4d3b7c8b655 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:41.224204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bc59c-02d6-4c9a-93fc-f4d3b7c8b655 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:41.225039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d39d9-eeed-412a-9b13-61ca9489206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:41.225440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bc59c-02d6-4c9a-93fc-f4d3b7c8b655 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:41.225913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d39d9-eeed-412a-9b13-61ca9489206f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:41.226204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d39d9-eeed-412a-9b13-61ca9489206f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:41.226483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d39d9-eeed-412a-9b13-61ca9489206f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:41.229459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bc59c-02d6-4c9a-93fc-f4d3b7c8b655 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:41.241890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d39d9-eeed-412a-9b13-61ca9489206f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:41.243721 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d39d9-eeed-412a-9b13-61ca9489206f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e70d39d9-eeed-412a-9b13-61ca9489206f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:41.267056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:41.268957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:41.271348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:41.271348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:41.271348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:41.271348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:41.274167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 347/698] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:41.275265 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d39d9-eeed-412a-9b13-61ca9489206f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:41.283843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 352/699] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 21 08:13:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:41.286456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bc59c-02d6-4c9a-93fc-f4d3b7c8b655 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:41.363067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:41.467514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bc59c-02d6-4c9a-93fc-f4d3b7c8b655 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:41.479760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d39d9-eeed-412a-9b13-61ca9489206f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:41.535036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:41.554501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8f7ad-1bac-4311-bfe3-faedf2c54a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:41.557033 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8f7ad-1bac-4311-bfe3-faedf2c54a38 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:41.557924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8f7ad-1bac-4311-bfe3-faedf2c54a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:41.558214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8f7ad-1bac-4311-bfe3-faedf2c54a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:41.576973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75ab4-77be-426e-81ec-dc1e724195c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:41.580526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75ab4-77be-426e-81ec-dc1e724195c8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:41.580526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75ab4-77be-426e-81ec-dc1e724195c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:41.580526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75ab4-77be-426e-81ec-dc1e724195c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:41.580526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff75ab4-77be-426e-81ec-dc1e724195c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:41.580526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff75ab4-77be-426e-81ec-dc1e724195c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:41.581232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff75ab4-77be-426e-81ec-dc1e724195c8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:41.615495 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 348/700] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:41.620696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75ab4-77be-426e-81ec-dc1e724195c8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:41.701135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8f7ad-1bac-4311-bfe3-faedf2c54a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:41.702653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8f7ad-1bac-4311-bfe3-faedf2c54a38 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:41.735446 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:41.784411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75ab4-77be-426e-81ec-dc1e724195c8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:41.826968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620023e-0cf4-42b0-8e07-90fd1b9262dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:41.827918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620023e-0cf4-42b0-8e07-90fd1b9262dd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:41.828204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620023e-0cf4-42b0-8e07-90fd1b9262dd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:41.828518 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620023e-0cf4-42b0-8e07-90fd1b9262dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:41.836717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620023e-0cf4-42b0-8e07-90fd1b9262dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:41.838375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620023e-0cf4-42b0-8e07-90fd1b9262dd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1620023e-0cf4-42b0-8e07-90fd1b9262dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:41.853806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:41.856274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:41.860719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:41.860719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:41.860719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:41.860719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:41.860719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:41.860719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:41.860719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:41.860719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:41.860719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 349/701] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:13:41.860719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755487e-37d2-4cb5-8f98-1d3b5ec4fd3a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:41.860719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755487e-37d2-4cb5-8f98-1d3b5ec4fd3a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:41.869004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755487e-37d2-4cb5-8f98-1d3b5ec4fd3a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:41.869004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 350/702] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:41.869004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966470c-4319-49b8-bbb0-11663e3a11e9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:41.869004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966470c-4319-49b8-bbb0-11663e3a11e9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:41.869004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966470c-4319-49b8-bbb0-11663e3a11e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:41.876159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 353/703] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:13:41.877532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8f7ad-1bac-4311-bfe3-faedf2c54a38 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:41.892853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e966470c-4319-49b8-bbb0-11663e3a11e9 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:41.895516 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e966470c-4319-49b8-bbb0-11663e3a11e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:41.969083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:42.036278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 351/704] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:42.037925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966470c-4319-49b8-bbb0-11663e3a11e9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:42.081756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8f7ad-1bac-4311-bfe3-faedf2c54a38 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:42.140300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:42.152555 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7bf1a-41c4-41c4-a5bc-f8f333f49970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:42.153726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7bf1a-41c4-41c4-a5bc-f8f333f49970 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:42.154189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7bf1a-41c4-41c4-a5bc-f8f333f49970 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:42.154681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7bf1a-41c4-41c4-a5bc-f8f333f49970 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:42.156255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7bf1a-41c4-41c4-a5bc-f8f333f49970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:42.156864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7bf1a-41c4-41c4-a5bc-f8f333f49970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:42.159632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7bf1a-41c4-41c4-a5bc-f8f333f49970 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:42.184778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 354/705] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:42.186321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7bf1a-41c4-41c4-a5bc-f8f333f49970 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:42.261110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966470c-4319-49b8-bbb0-11663e3a11e9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:42.347531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7bf1a-41c4-41c4-a5bc-f8f333f49970 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:42.353081 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848529e9-cbab-4f48-8b9f-0d2be7c9a1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:42.354080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848529e9-cbab-4f48-8b9f-0d2be7c9a1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:42.354470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848529e9-cbab-4f48-8b9f-0d2be7c9a1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:42.354843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848529e9-cbab-4f48-8b9f-0d2be7c9a1d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:42.371803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848529e9-cbab-4f48-8b9f-0d2be7c9a1d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:42.373421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848529e9-cbab-4f48-8b9f-0d2be7c9a1d2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:42.394021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc3fa0-7746-4588-b413-954e7c7f85d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-848529e9-cbab-4f48-8b9f-0d2be7c9a1d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:42.395227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:42.397046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:42.399036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:42.399036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:42.399036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:42.399036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:42.399520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc3fa0-7746-4588-b413-954e7c7f85d1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:42.399520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc3fa0-7746-4588-b413-954e7c7f85d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:42.399520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc3fa0-7746-4588-b413-954e7c7f85d1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:42.399520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc3fa0-7746-4588-b413-954e7c7f85d1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:42.408546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc3fa0-7746-4588-b413-954e7c7f85d1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:42.408823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 352/706] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:42.408823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848529e9-cbab-4f48-8b9f-0d2be7c9a1d2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f9dc3fa0-7746-4588-b413-954e7c7f85d1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:42.418279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:42.420993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:13:42.423242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:42.431815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 355/707] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Jul 21 08:13:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:42.431815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc3fa0-7746-4588-b413-954e7c7f85d1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:42.447618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:42.497728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:42.556078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc3fa0-7746-4588-b413-954e7c7f85d1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:42.589741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848529e9-cbab-4f48-8b9f-0d2be7c9a1d2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:42.598466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01953f36-c7bb-4cbe-9540-9fed31e27550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:42.599261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01953f36-c7bb-4cbe-9540-9fed31e27550 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:42.599613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01953f36-c7bb-4cbe-9540-9fed31e27550 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:42.599999 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01953f36-c7bb-4cbe-9540-9fed31e27550 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:42.600891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01953f36-c7bb-4cbe-9540-9fed31e27550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:42.601276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01953f36-c7bb-4cbe-9540-9fed31e27550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:42.602860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01953f36-c7bb-4cbe-9540-9fed31e27550 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:42.618402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 356/708] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:42.619321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01953f36-c7bb-4cbe-9540-9fed31e27550 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:42.665303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108e4f1-145e-42f3-a98f-40e8b10ecb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:42.666457 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108e4f1-145e-42f3-a98f-40e8b10ecb2f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:42.667021 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108e4f1-145e-42f3-a98f-40e8b10ecb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:42.667587 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108e4f1-145e-42f3-a98f-40e8b10ecb2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:42.669456 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108e4f1-145e-42f3-a98f-40e8b10ecb2f None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=300b1990926c4968b75a84a1f5794df1) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:42.670080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108e4f1-145e-42f3-a98f-40e8b10ecb2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:42.672926 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108e4f1-145e-42f3-a98f-40e8b10ecb2f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:42.685180 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 353/709] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:42 2022] GET /identity/v3/role_assignments?user.id=300b1990926c4968b75a84a1f5794df1&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:42.686967 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108e4f1-145e-42f3-a98f-40e8b10ecb2f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:42.806792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01953f36-c7bb-4cbe-9540-9fed31e27550 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:42.836993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:42.876934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:42.901543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108e4f1-145e-42f3-a98f-40e8b10ecb2f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:42.961309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2013f7a-fb48-4a18-bdf8-3171bdf94a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:42.962897 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2013f7a-fb48-4a18-bdf8-3171bdf94a16 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:42.963638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2013f7a-fb48-4a18-bdf8-3171bdf94a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:42.964363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2013f7a-fb48-4a18-bdf8-3171bdf94a16 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:42.966075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2013f7a-fb48-4a18-bdf8-3171bdf94a16 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:42.966886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2013f7a-fb48-4a18-bdf8-3171bdf94a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:42.969940 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2013f7a-fb48-4a18-bdf8-3171bdf94a16 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:42.975325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672068-e35b-4294-93b9-9fc46071004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:42.977242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672068-e35b-4294-93b9-9fc46071004c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:42.977983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672068-e35b-4294-93b9-9fc46071004c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:42.978662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672068-e35b-4294-93b9-9fc46071004c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:42.990619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 357/710] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 21 08:13:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:42.993432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44672068-e35b-4294-93b9-9fc46071004c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:42.996736 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44672068-e35b-4294-93b9-9fc46071004c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:42.997636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2013f7a-fb48-4a18-bdf8-3171bdf94a16 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-44672068-e35b-4294-93b9-9fc46071004c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:43.027448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:43.029452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:43.031438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:43.031438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:43.031438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:43.031438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:43.031438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:43.031438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:43.031438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:43.031438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:43.044435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 354/711] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:43.054514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672068-e35b-4294-93b9-9fc46071004c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:43.142242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2013f7a-fb48-4a18-bdf8-3171bdf94a16 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:43.203311 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d229e-387b-4ed8-8537-55ebd0eb4b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:43.206565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d229e-387b-4ed8-8537-55ebd0eb4b2c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:43.207437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d229e-387b-4ed8-8537-55ebd0eb4b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:43.207929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d229e-387b-4ed8-8537-55ebd0eb4b2c None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:43.209612 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d229e-387b-4ed8-8537-55ebd0eb4b2c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:43.210411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d229e-387b-4ed8-8537-55ebd0eb4b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:43.217425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d229e-387b-4ed8-8537-55ebd0eb4b2c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:43.225549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 358/712] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 21 08:13:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:43.232530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0a281-7dc1-4cda-a548-d752b641a140 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:43.233563 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0a281-7dc1-4cda-a548-d752b641a140 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:43.234052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0a281-7dc1-4cda-a548-d752b641a140 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:43.236120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 359/713] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:43.246149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29de448-d03e-42bd-bed2-1587ce655c92 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:43.246808 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29de448-d03e-42bd-bed2-1587ce655c92 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:43.247289 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29de448-d03e-42bd-bed2-1587ce655c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:43.264531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672068-e35b-4294-93b9-9fc46071004c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:43.306916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d29de448-d03e-42bd-bed2-1587ce655c92 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:43.308394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d29de448-d03e-42bd-bed2-1587ce655c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:43.367923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256936d9-fe3c-458d-a4c9-7d29c473539e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:43.369202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256936d9-fe3c-458d-a4c9-7d29c473539e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:43.369714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256936d9-fe3c-458d-a4c9-7d29c473539e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:43.371125 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256936d9-fe3c-458d-a4c9-7d29c473539e None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:43.372870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256936d9-fe3c-458d-a4c9-7d29c473539e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:43.373441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256936d9-fe3c-458d-a4c9-7d29c473539e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:43.376687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256936d9-fe3c-458d-a4c9-7d29c473539e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:43.407390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 355/714] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:43.420794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256936d9-fe3c-458d-a4c9-7d29c473539e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:43.446753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:43.454416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:43.503516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 360/715] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:43.542524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29de448-d03e-42bd-bed2-1587ce655c92 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:43.685200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256936d9-fe3c-458d-a4c9-7d29c473539e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:43.762035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29de448-d03e-42bd-bed2-1587ce655c92 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:43.832160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43a74-cba4-4493-b350-7282bc6d6bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:43.833644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43a74-cba4-4493-b350-7282bc6d6bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:43.834133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43a74-cba4-4493-b350-7282bc6d6bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:43.834614 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43a74-cba4-4493-b350-7282bc6d6bf2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:43.835355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e715d-65ee-4f61-b013-9cb25c935c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:43.835967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43a74-cba4-4493-b350-7282bc6d6bf2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:43.836993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e715d-65ee-4f61-b013-9cb25c935c3d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:43.837664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e715d-65ee-4f61-b013-9cb25c935c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:43.838351 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e715d-65ee-4f61-b013-9cb25c935c3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:43.838513 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43a74-cba4-4493-b350-7282bc6d6bf2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:43.840274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e715d-65ee-4f61-b013-9cb25c935c3d None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=421f05e3d10e4393b28f77b6179ade8c) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:43.841063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e715d-65ee-4f61-b013-9cb25c935c3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:43.852539 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e715d-65ee-4f61-b013-9cb25c935c3d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-53b43a74-cba4-4493-b350-7282bc6d6bf2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:43.862124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:43.864314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:13:43.866328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:43.868676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 361/716] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:43 2022] GET /identity/v3/services/network => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:43.876120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43a74-cba4-4493-b350-7282bc6d6bf2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:43.880325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 356/717] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:43 2022] GET /identity/v3/role_assignments?user.id=421f05e3d10e4393b28f77b6179ade8c&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 259 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:43.973140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:44.061493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2924f94-d48e-48c0-8be7-45bf9a849175 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:44.061754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2924f94-d48e-48c0-8be7-45bf9a849175 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:44.061915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2924f94-d48e-48c0-8be7-45bf9a849175 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:44.064378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 357/718] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:44.071590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd3754-162e-449c-be9e-77c8d0a28a48 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:44.072018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd3754-162e-449c-be9e-77c8d0a28a48 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:44.072642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd3754-162e-449c-be9e-77c8d0a28a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:44.095258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43a74-cba4-4493-b350-7282bc6d6bf2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:44.134750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-88cd3754-162e-449c-be9e-77c8d0a28a48 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:44.136930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-88cd3754-162e-449c-be9e-77c8d0a28a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:44.137324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5fcfe-bebd-4170-bddb-264d80b2bb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:44.138022 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5fcfe-bebd-4170-bddb-264d80b2bb25 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:44.138298 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5fcfe-bebd-4170-bddb-264d80b2bb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:44.138556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5fcfe-bebd-4170-bddb-264d80b2bb25 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:44.139301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5fcfe-bebd-4170-bddb-264d80b2bb25 None admin] RBAC: Adding query filter params (name=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:44.139603 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5fcfe-bebd-4170-bddb-264d80b2bb25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:44.141147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5fcfe-bebd-4170-bddb-264d80b2bb25 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:44.147210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 362/719] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:13:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:44.178136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5fcfe-bebd-4170-bddb-264d80b2bb25 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:44.318411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5fcfe-bebd-4170-bddb-264d80b2bb25 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:44.333159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:44.366400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 358/720] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:44.375352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c82d50-da2e-4b49-a7fc-f57b5e5bf194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:44.376567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c82d50-da2e-4b49-a7fc-f57b5e5bf194 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:44.377082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c82d50-da2e-4b49-a7fc-f57b5e5bf194 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:44.377562 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c82d50-da2e-4b49-a7fc-f57b5e5bf194 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:44.379035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c82d50-da2e-4b49-a7fc-f57b5e5bf194 None admin] RBAC: Adding query filter params (type=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:44.379601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c82d50-da2e-4b49-a7fc-f57b5e5bf194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:44.382320 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c82d50-da2e-4b49-a7fc-f57b5e5bf194 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:44.405146 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 363/721] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:13:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:44.428614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd3754-162e-449c-be9e-77c8d0a28a48 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:44.433068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:44.731259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd3754-162e-449c-be9e-77c8d0a28a48 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:44.775743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef3e4-e081-4a9e-a129-94c1d1c8a8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:44.776636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef3e4-e081-4a9e-a129-94c1d1c8a8bf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:44.776910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef3e4-e081-4a9e-a129-94c1d1c8a8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:44.777186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef3e4-e081-4a9e-a129-94c1d1c8a8bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:44.790190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ef3e4-e081-4a9e-a129-94c1d1c8a8bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3b5ef3e4-e081-4a9e-a129-94c1d1c8a8bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:44.804572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:44.806476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:44.808262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 359/722] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:44.814700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c82d50-da2e-4b49-a7fc-f57b5e5bf194 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:45.095142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c82d50-da2e-4b49-a7fc-f57b5e5bf194 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:45.177228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257db999-9fd4-4a73-9309-0224842871ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:45.177982 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257db999-9fd4-4a73-9309-0224842871ec None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:45.178272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257db999-9fd4-4a73-9309-0224842871ec None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:45.178550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257db999-9fd4-4a73-9309-0224842871ec None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:45.179399 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257db999-9fd4-4a73-9309-0224842871ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:45.179737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257db999-9fd4-4a73-9309-0224842871ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:45.181252 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257db999-9fd4-4a73-9309-0224842871ec None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:45.200778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 364/723] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:45.209250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef3e4-e081-4a9e-a129-94c1d1c8a8bf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:45.504083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:45.606059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef3e4-e081-4a9e-a129-94c1d1c8a8bf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:45.665888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af57a1-3e14-4ead-825c-3c2ee6be50f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:45.667229 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af57a1-3e14-4ead-825c-3c2ee6be50f6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:45.667751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af57a1-3e14-4ead-825c-3c2ee6be50f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:45.668248 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af57a1-3e14-4ead-825c-3c2ee6be50f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:45.687289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af57a1-3e14-4ead-825c-3c2ee6be50f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:45.689341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af57a1-3e14-4ead-825c-3c2ee6be50f6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e1af57a1-3e14-4ead-825c-3c2ee6be50f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:45.727377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:45.729342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:45.730789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:45.730789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:45.730789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:45.730789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:45.735275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 360/724] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 527 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:45.745041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257db999-9fd4-4a73-9309-0224842871ec None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:45.832654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:46.019405 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257db999-9fd4-4a73-9309-0224842871ec None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:46.119104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee915e15-1c0d-4b45-9255-61eedece2dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:46.120910 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee915e15-1c0d-4b45-9255-61eedece2dfe None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:46.121771 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee915e15-1c0d-4b45-9255-61eedece2dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:46.122467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee915e15-1c0d-4b45-9255-61eedece2dfe None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:46.124522 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee915e15-1c0d-4b45-9255-61eedece2dfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:46.125500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee915e15-1c0d-4b45-9255-61eedece2dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:46.132853 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee915e15-1c0d-4b45-9255-61eedece2dfe None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:46.167479 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 365/725] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:46.176527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af57a1-3e14-4ead-825c-3c2ee6be50f6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:46.481219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af57a1-3e14-4ead-825c-3c2ee6be50f6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:46.517445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:46.572199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f478-b23a-4805-9072-d4f05f0b1ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:46.573648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f478-b23a-4805-9072-d4f05f0b1ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:46.574128 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f478-b23a-4805-9072-d4f05f0b1ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:46.574612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f478-b23a-4805-9072-d4f05f0b1ba5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:46.595352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f478-b23a-4805-9072-d4f05f0b1ba5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:46.602378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f478-b23a-4805-9072-d4f05f0b1ba5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:46.623133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbbd02-aa12-4b4e-9ee9-b8cefeea499b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:46.623400 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbbd02-aa12-4b4e-9ee9-b8cefeea499b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:46.623784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbbd02-aa12-4b4e-9ee9-b8cefeea499b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:46.625495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 366/726] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d7d2f478-b23a-4805-9072-d4f05f0b1ba5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:46.632542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:46.634420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:46.638991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:46.638991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:46.638991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:46.638991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:46.638991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:46.638991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:46.638991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:46.638991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:46.638991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:13:46.638991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:46.641209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7543d4-1abb-4c65-bf7c-4cf658bb8ee2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:46.641209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7543d4-1abb-4c65-bf7c-4cf658bb8ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:46.641209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7543d4-1abb-4c65-bf7c-4cf658bb8ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:46.642014 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 361/727] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 21 08:13:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:46.650841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f478-b23a-4805-9072-d4f05f0b1ba5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:46.658487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ff7543d4-1abb-4c65-bf7c-4cf658bb8ee2 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:46.659788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ff7543d4-1abb-4c65-bf7c-4cf658bb8ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:46.911576 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 367/728] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:46.925648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f478-b23a-4805-9072-d4f05f0b1ba5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:46.957813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da3d2e-f8eb-4aac-b1d7-5af3bdb9a323 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:46.958762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da3d2e-f8eb-4aac-b1d7-5af3bdb9a323 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:46.959478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da3d2e-f8eb-4aac-b1d7-5af3bdb9a323 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:46.962645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 368/729] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:46.972089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ab07d-056c-4e59-943f-f806347c39d0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:46.973034 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ab07d-056c-4e59-943f-f806347c39d0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:46.973770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ab07d-056c-4e59-943f-f806347c39d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:46.992019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4d350-5019-467e-8bdd-4e0d72d0931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:46.993115 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4d350-5019-467e-8bdd-4e0d72d0931f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:46.993590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4d350-5019-467e-8bdd-4e0d72d0931f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:46.994058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4d350-5019-467e-8bdd-4e0d72d0931f None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:46.995606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4d350-5019-467e-8bdd-4e0d72d0931f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:46.996136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4d350-5019-467e-8bdd-4e0d72d0931f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:46.998805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4d350-5019-467e-8bdd-4e0d72d0931f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:47.002642 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5b7ab07d-056c-4e59-943f-f806347c39d0 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:47.004259 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5b7ab07d-056c-4e59-943f-f806347c39d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:47.021112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:47.034603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 362/730] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jul 21 08:13:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:47.036167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4d350-5019-467e-8bdd-4e0d72d0931f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:47.096042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 369/731] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:47.098386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ab07d-056c-4e59-943f-f806347c39d0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:47.111048 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:47.242775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4d350-5019-467e-8bdd-4e0d72d0931f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:47.280397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ab07d-056c-4e59-943f-f806347c39d0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:47.318773 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638caeda-71b1-4414-83f7-39540fe11417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:47.320409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638caeda-71b1-4414-83f7-39540fe11417 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:47.321090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638caeda-71b1-4414-83f7-39540fe11417 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:47.321549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1038ca-3175-4a3c-8828-96f0c1ad9fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:47.322004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638caeda-71b1-4414-83f7-39540fe11417 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:47.322233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1038ca-3175-4a3c-8828-96f0c1ad9fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:47.322512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1038ca-3175-4a3c-8828-96f0c1ad9fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:47.322787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1038ca-3175-4a3c-8828-96f0c1ad9fd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:47.341915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:47.342350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638caeda-71b1-4414-83f7-39540fe11417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-638caeda-71b1-4414-83f7-39540fe11417 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:47.352067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:47.353986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:47.355613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 363/732] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:13:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:47.357902 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638caeda-71b1-4414-83f7-39540fe11417 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:47.406963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1038ca-3175-4a3c-8828-96f0c1ad9fd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:47.408448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1038ca-3175-4a3c-8828-96f0c1ad9fd5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:47.520709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:47.539854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638caeda-71b1-4414-83f7-39540fe11417 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:47.552471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 370/733] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:13:47.554327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afde7ce-a00a-4551-b444-551fb2e9fe9f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:47.554612 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afde7ce-a00a-4551-b444-551fb2e9fe9f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:47.554882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afde7ce-a00a-4551-b444-551fb2e9fe9f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:47.556592 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 371/734] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:47.561441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afde7ce-a00a-4551-b444-551fb2e9fe9f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:47.601633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9d7c2-52ba-40fc-8aa7-02d0cb9069f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:47.602330 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9d7c2-52ba-40fc-8aa7-02d0cb9069f5 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:47.602607 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9d7c2-52ba-40fc-8aa7-02d0cb9069f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:47.602877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9d7c2-52ba-40fc-8aa7-02d0cb9069f5 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:47.603630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9d7c2-52ba-40fc-8aa7-02d0cb9069f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:47.605167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9d7c2-52ba-40fc-8aa7-02d0cb9069f5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:47.624346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 364/735] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:13:47 2022] POST /identity/v3/services => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:13:47.625805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b458d0-c298-453e-9a42-3643b176d617 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:47.626112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b458d0-c298-453e-9a42-3643b176d617 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:47.626303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b458d0-c298-453e-9a42-3643b176d617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:47.651107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-17b458d0-c298-453e-9a42-3643b176d617 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:47.652670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-17b458d0-c298-453e-9a42-3643b176d617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:47.661303 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:47.768104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 365/736] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:47.769376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b458d0-c298-453e-9a42-3643b176d617 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:47.786998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afde7ce-a00a-4551-b444-551fb2e9fe9f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:47.863810 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2a32-f16d-4953-adb3-3d1940c65f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:47.865607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2a32-f16d-4953-adb3-3d1940c65f60 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:47.866414 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2a32-f16d-4953-adb3-3d1940c65f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:47.867218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2a32-f16d-4953-adb3-3d1940c65f60 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:47.869011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e2a32-f16d-4953-adb3-3d1940c65f60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:47.870071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e2a32-f16d-4953-adb3-3d1940c65f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:47.873336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e2a32-f16d-4953-adb3-3d1940c65f60 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:47.875448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:47.902319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 372/737] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:47.902319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2a32-f16d-4953-adb3-3d1940c65f60 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:47.912214 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b458d0-c298-453e-9a42-3643b176d617 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:47.980947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5ad94-f9b5-41a3-96db-f7b767d2716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:47.982750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ad94-f9b5-41a3-96db-f7b767d2716c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:47.983519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ad94-f9b5-41a3-96db-f7b767d2716c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:47.984199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ad94-f9b5-41a3-96db-f7b767d2716c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:48.011324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5ad94-f9b5-41a3-96db-f7b767d2716c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:48.014975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5ad94-f9b5-41a3-96db-f7b767d2716c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-40c5ad94-f9b5-41a3-96db-f7b767d2716c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:48.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:48.059469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:48.060354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:48.060354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:48.060354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:48.060354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:48.063876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 366/738] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:48.065247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5ad94-f9b5-41a3-96db-f7b767d2716c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:48.077220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2a32-f16d-4953-adb3-3d1940c65f60 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:48.090870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:48.133209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5ccec-03cb-441d-9d31-4a2d5b39100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:48.134525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5ccec-03cb-441d-9d31-4a2d5b39100f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:48.134994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5ccec-03cb-441d-9d31-4a2d5b39100f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:48.135500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5ccec-03cb-441d-9d31-4a2d5b39100f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:48.156324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5ccec-03cb-441d-9d31-4a2d5b39100f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-cae5ccec-03cb-441d-9d31-4a2d5b39100f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:48.170056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:48.172004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:48.173667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 373/739] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:13:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:48.175038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d7ede-b6de-4f29-90af-4e15872aa817 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:48.176264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d7ede-b6de-4f29-90af-4e15872aa817 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:48.176264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d7ede-b6de-4f29-90af-4e15872aa817 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:48.179215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 374/740] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:48.180023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d7ede-b6de-4f29-90af-4e15872aa817 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:48.204819 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5ad94-f9b5-41a3-96db-f7b767d2716c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:48.241437 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:48.247316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fb5da-5c1a-4702-8d5a-46ab8f2d3c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:48.248746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fb5da-5c1a-4702-8d5a-46ab8f2d3c27 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:48.250267 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fb5da-5c1a-4702-8d5a-46ab8f2d3c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:48.250555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fb5da-5c1a-4702-8d5a-46ab8f2d3c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:48.264382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fb5da-5c1a-4702-8d5a-46ab8f2d3c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:48.265929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fb5da-5c1a-4702-8d5a-46ab8f2d3c27 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ce4fb5da-5c1a-4702-8d5a-46ab8f2d3c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:48.285925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:48.286961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:48.287826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:48.287826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:48.287826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:48.287826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:48.287826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 367/741] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:48.288108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fb5da-5c1a-4702-8d5a-46ab8f2d3c27 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:48.355957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d7ede-b6de-4f29-90af-4e15872aa817 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:48.398010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde25e7-0b2c-4dff-9892-157eb37dae9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:48.398806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde25e7-0b2c-4dff-9892-157eb37dae9a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:48.399139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde25e7-0b2c-4dff-9892-157eb37dae9a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:48.399413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde25e7-0b2c-4dff-9892-157eb37dae9a None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:48.400266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde25e7-0b2c-4dff-9892-157eb37dae9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:48.400617 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde25e7-0b2c-4dff-9892-157eb37dae9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:48.402065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde25e7-0b2c-4dff-9892-157eb37dae9a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:48.421938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 375/742] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:48.423556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d985b4b-fe08-4f70-97e6-8249e1948b94 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:48.423849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d985b4b-fe08-4f70-97e6-8249e1948b94 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:48.424123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d985b4b-fe08-4f70-97e6-8249e1948b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:48.444169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8d985b4b-fe08-4f70-97e6-8249e1948b94 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:48.445513 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8d985b4b-fe08-4f70-97e6-8249e1948b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:48.465002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fb5da-5c1a-4702-8d5a-46ab8f2d3c27 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:48.476227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:48.509707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333f775-42a2-4b64-b16c-f6be849a5d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:48.510799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333f775-42a2-4b64-b16c-f6be849a5d85 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:48.511167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333f775-42a2-4b64-b16c-f6be849a5d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:48.511624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333f775-42a2-4b64-b16c-f6be849a5d85 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:48.512979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333f775-42a2-4b64-b16c-f6be849a5d85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:48.513477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333f775-42a2-4b64-b16c-f6be849a5d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:48.515878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333f775-42a2-4b64-b16c-f6be849a5d85 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:48.530402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 368/743] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:48.531580 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333f775-42a2-4b64-b16c-f6be849a5d85 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:48.550507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 376/744] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:13:48.551751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d985b4b-fe08-4f70-97e6-8249e1948b94 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:48.617697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:48.683233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d985b4b-fe08-4f70-97e6-8249e1948b94 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:48.683673 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333f775-42a2-4b64-b16c-f6be849a5d85 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:48.727648 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c9b1f-3ae9-437b-bbe1-bb6c3af53c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:48.729477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de7804-7ce8-492e-a5cb-311699ab638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:48.729664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9b1f-3ae9-437b-bbe1-bb6c3af53c09 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:48.729664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9b1f-3ae9-437b-bbe1-bb6c3af53c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:48.729664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9b1f-3ae9-437b-bbe1-bb6c3af53c09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:48.730445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7804-7ce8-492e-a5cb-311699ab638f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:48.730445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7804-7ce8-492e-a5cb-311699ab638f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:48.730445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7804-7ce8-492e-a5cb-311699ab638f None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:48.731904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de7804-7ce8-492e-a5cb-311699ab638f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:48.731904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de7804-7ce8-492e-a5cb-311699ab638f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:48.732605 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de7804-7ce8-492e-a5cb-311699ab638f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:48.738583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c9b1f-3ae9-437b-bbe1-bb6c3af53c09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:48.740074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c9b1f-3ae9-437b-bbe1-bb6c3af53c09 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:48.746738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 369/745] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:48.747588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de7804-7ce8-492e-a5cb-311699ab638f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e37c9b1f-3ae9-437b-bbe1-bb6c3af53c09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:48.759604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:48.761257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:48.763187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:48.763187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:48.763187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:48.763187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:48.763187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:48.763187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:48.763187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:48.763187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:48.763187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 377/746] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:48.766060 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c9b1f-3ae9-437b-bbe1-bb6c3af53c09 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:48.800259 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:48.941269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c9b1f-3ae9-437b-bbe1-bb6c3af53c09 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:48.953626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de7804-7ce8-492e-a5cb-311699ab638f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:48.959528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:48.986902 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96138b7a-a19d-47fa-b22d-b492286f0b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:48.987661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96138b7a-a19d-47fa-b22d-b492286f0b88 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:48.987949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96138b7a-a19d-47fa-b22d-b492286f0b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:48.988235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96138b7a-a19d-47fa-b22d-b492286f0b88 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:48.989023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96138b7a-a19d-47fa-b22d-b492286f0b88 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:48.990453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96138b7a-a19d-47fa-b22d-b492286f0b88 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:49.008149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 378/747] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:13:48 2022] POST /identity/v3/services => generated 240 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:13:49.011281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96138b7a-a19d-47fa-b22d-b492286f0b88 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:49.044559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734a7a4-f5a4-4789-8a50-cdf3a2a0255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:49.046048 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734a7a4-f5a4-4789-8a50-cdf3a2a0255f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:49.046577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734a7a4-f5a4-4789-8a50-cdf3a2a0255f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:49.047092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734a7a4-f5a4-4789-8a50-cdf3a2a0255f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:49.069808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734a7a4-f5a4-4789-8a50-cdf3a2a0255f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:49.072795 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734a7a4-f5a4-4789-8a50-cdf3a2a0255f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b734a7a4-f5a4-4789-8a50-cdf3a2a0255f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:49.111354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:49.113313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:49.116314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:49.116314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:49.116314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:49.116314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:49.116314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 370/748] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:49.116314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734a7a4-f5a4-4789-8a50-cdf3a2a0255f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:49.197569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:49.240451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96138b7a-a19d-47fa-b22d-b492286f0b88 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:49.289057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129245f-9607-4a16-a64e-5f1136f9eb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:49.289886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129245f-9607-4a16-a64e-5f1136f9eb65 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:49.290161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129245f-9607-4a16-a64e-5f1136f9eb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:49.290801 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129245f-9607-4a16-a64e-5f1136f9eb65 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:49.300865 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129245f-9607-4a16-a64e-5f1136f9eb65 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:49.302356 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129245f-9607-4a16-a64e-5f1136f9eb65 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b129245f-9607-4a16-a64e-5f1136f9eb65 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:49.320122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:49.321177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:49.322139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:49.322139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:49.322139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:49.322139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:49.322139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:49.322139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:49.322139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:49.322139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:49.322139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:13:49.322139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:49.323208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 379/749] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:13:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:49.323208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129245f-9607-4a16-a64e-5f1136f9eb65 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:49.347987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734a7a4-f5a4-4789-8a50-cdf3a2a0255f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:49.420957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ec89e-9a56-44ec-8de7-ad993986ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:49.422178 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ec89e-9a56-44ec-8de7-ad993986ac29 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:49.422464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ec89e-9a56-44ec-8de7-ad993986ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:49.422781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ec89e-9a56-44ec-8de7-ad993986ac29 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:49.423696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ec89e-9a56-44ec-8de7-ad993986ac29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:49.424266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ec89e-9a56-44ec-8de7-ad993986ac29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:49.426851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ec89e-9a56-44ec-8de7-ad993986ac29 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:49.454261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 371/750] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:49.456025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ec89e-9a56-44ec-8de7-ad993986ac29 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:49.489659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:49.491788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129245f-9607-4a16-a64e-5f1136f9eb65 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:49.553595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2169b-0d1f-4b2c-9424-fe243a2da789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:49.554326 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2169b-0d1f-4b2c-9424-fe243a2da789 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:49.554611 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2169b-0d1f-4b2c-9424-fe243a2da789 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:49.555017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2169b-0d1f-4b2c-9424-fe243a2da789 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:49.555852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2169b-0d1f-4b2c-9424-fe243a2da789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:49.556166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2169b-0d1f-4b2c-9424-fe243a2da789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:49.558018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2169b-0d1f-4b2c-9424-fe243a2da789 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:49.570403 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:49.578071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 380/751] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:49.579677 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2169b-0d1f-4b2c-9424-fe243a2da789 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:49.694911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ec89e-9a56-44ec-8de7-ad993986ac29 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:49.765728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06594ca5-3745-4791-947d-5ba6d551bc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:49.767236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06594ca5-3745-4791-947d-5ba6d551bc1e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:49.767965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06594ca5-3745-4791-947d-5ba6d551bc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:49.768786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06594ca5-3745-4791-947d-5ba6d551bc1e None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:49.771057 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06594ca5-3745-4791-947d-5ba6d551bc1e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:49.771853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06594ca5-3745-4791-947d-5ba6d551bc1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:49.775190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06594ca5-3745-4791-947d-5ba6d551bc1e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:49.811119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 372/752] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jul 21 08:13:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:49.813083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06594ca5-3745-4791-947d-5ba6d551bc1e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:49.821178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2169b-0d1f-4b2c-9424-fe243a2da789 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:49.892115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0905-2320-47fb-97a4-bd257e8d791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:49.892879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0905-2320-47fb-97a4-bd257e8d791e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:49.893176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0905-2320-47fb-97a4-bd257e8d791e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:49.893425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0905-2320-47fb-97a4-bd257e8d791e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:49.894343 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd0905-2320-47fb-97a4-bd257e8d791e None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=06e0753ca5174046841396a304262d06) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:49.895013 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd0905-2320-47fb-97a4-bd257e8d791e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:49.896685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd0905-2320-47fb-97a4-bd257e8d791e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:49.905071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 381/753] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:49 2022] GET /identity/v3/role_assignments?user.id=06e0753ca5174046841396a304262d06&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:49.906598 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0905-2320-47fb-97a4-bd257e8d791e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:49.968909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:50.030611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06594ca5-3745-4791-947d-5ba6d551bc1e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:50.038560 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:50.089390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0905-2320-47fb-97a4-bd257e8d791e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:50.104900 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c9646-63c1-4b29-991f-e447337c2915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:50.107756 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c9646-63c1-4b29-991f-e447337c2915 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:50.113860 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c9646-63c1-4b29-991f-e447337c2915 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:50.114355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c9646-63c1-4b29-991f-e447337c2915 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:50.128266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aa2a5-859d-448a-838e-b01d1128305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:50.128981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa2a5-859d-448a-838e-b01d1128305c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:50.129260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa2a5-859d-448a-838e-b01d1128305c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:50.129451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c9646-63c1-4b29-991f-e447337c2915 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:50.129556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa2a5-859d-448a-838e-b01d1128305c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:50.131866 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c9646-63c1-4b29-991f-e447337c2915 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8b4c9646-63c1-4b29-991f-e447337c2915 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:50.158079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:50.159156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:50.160140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:50.160140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:50.160140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:50.160140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:50.160140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:50.160140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:50.160140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:50.160140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:50.160140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:13:50.160140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:50.161510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 373/754] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 21 08:13:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:50.163487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06480e32-7129-45cd-8b1f-c2cfaed82c1b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:50.167007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06480e32-7129-45cd-8b1f-c2cfaed82c1b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:50.167007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06480e32-7129-45cd-8b1f-c2cfaed82c1b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:50.167480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 374/755] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:50.169675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06480e32-7129-45cd-8b1f-c2cfaed82c1b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:50.219162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04aa2a5-859d-448a-838e-b01d1128305c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:50.220801 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04aa2a5-859d-448a-838e-b01d1128305c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:50.293920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:50.344360 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 382/756] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:13:50.345890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415069d-e332-47d2-95fb-470dfc8c30ed None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:50.346176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415069d-e332-47d2-95fb-470dfc8c30ed None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:50.346448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415069d-e332-47d2-95fb-470dfc8c30ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:50.365380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7415069d-e332-47d2-95fb-470dfc8c30ed None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:50.366732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7415069d-e332-47d2-95fb-470dfc8c30ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:50.379543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06480e32-7129-45cd-8b1f-c2cfaed82c1b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:50.440251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:50.455078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f915eb-e69a-4d10-8b11-dcccd6dc1682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:50.455078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f915eb-e69a-4d10-8b11-dcccd6dc1682 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:50.455078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f915eb-e69a-4d10-8b11-dcccd6dc1682 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:50.455078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f915eb-e69a-4d10-8b11-dcccd6dc1682 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:50.455637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f915eb-e69a-4d10-8b11-dcccd6dc1682 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:50.456138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f915eb-e69a-4d10-8b11-dcccd6dc1682 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:50.456295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 383/757] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:13:50.457624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415069d-e332-47d2-95fb-470dfc8c30ed None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:50.459119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f915eb-e69a-4d10-8b11-dcccd6dc1682 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:50.495095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 375/758] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 21 08:13:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:50.504205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f915eb-e69a-4d10-8b11-dcccd6dc1682 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:50.591372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:50.602531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415069d-e332-47d2-95fb-470dfc8c30ed None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:50.620032 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f915eb-e69a-4d10-8b11-dcccd6dc1682 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:50.658101 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be51f08-2a29-429e-82cb-82a55836d8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:50.659420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be51f08-2a29-429e-82cb-82a55836d8fb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:50.659913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be51f08-2a29-429e-82cb-82a55836d8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:50.660397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be51f08-2a29-429e-82cb-82a55836d8fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:50.662172 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b3f59-923b-4dc3-b09c-d3f49d1772b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:50.663010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b3f59-923b-4dc3-b09c-d3f49d1772b3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:50.663291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b3f59-923b-4dc3-b09c-d3f49d1772b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:50.663994 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b3f59-923b-4dc3-b09c-d3f49d1772b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:50.676200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b3f59-923b-4dc3-b09c-d3f49d1772b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:50.676682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be51f08-2a29-429e-82cb-82a55836d8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:50.677758 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b3f59-923b-4dc3-b09c-d3f49d1772b3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:50.678588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be51f08-2a29-429e-82cb-82a55836d8fb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4a9b3f59-923b-4dc3-b09c-d3f49d1772b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:50.698861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:50.700156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:50.701058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:50.701058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:50.701058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:50.701058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-7be51f08-2a29-429e-82cb-82a55836d8fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:50.704670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:50.705553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:50.706475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:50.706475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:50.706475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:50.706475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:50.706690 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 376/759] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:50.706690 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b3f59-923b-4dc3-b09c-d3f49d1772b3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:50.708971 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 384/760] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:50.716070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be51f08-2a29-429e-82cb-82a55836d8fb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:50.762993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:50.838614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b3f59-923b-4dc3-b09c-d3f49d1772b3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:50.879446 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be51f08-2a29-429e-82cb-82a55836d8fb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:50.881436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b18f17-3c98-4294-8560-750e3937aa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:50.882667 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b18f17-3c98-4294-8560-750e3937aa86 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:50.883215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b18f17-3c98-4294-8560-750e3937aa86 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:50.883688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b18f17-3c98-4294-8560-750e3937aa86 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:50.884652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b18f17-3c98-4294-8560-750e3937aa86 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:50.886676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b18f17-3c98-4294-8560-750e3937aa86 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c0b18f17-3c98-4294-8560-750e3937aa86 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:50.904369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:50.905540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:13:50.906397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:50.909588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 377/761] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Jul 21 08:13:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:50.910901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b18f17-3c98-4294-8560-750e3937aa86 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:50.931870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e292-a674-4e63-8ddd-463e4c166aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:50.932877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e292-a674-4e63-8ddd-463e4c166aba None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:50.933159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e292-a674-4e63-8ddd-463e4c166aba None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:50.933435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e292-a674-4e63-8ddd-463e4c166aba None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:50.934186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e292-a674-4e63-8ddd-463e4c166aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:50.934491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e292-a674-4e63-8ddd-463e4c166aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:50.936728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e292-a674-4e63-8ddd-463e4c166aba None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:50.958000 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 385/762] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:50.958000 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e292-a674-4e63-8ddd-463e4c166aba None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:50.963894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:51.060763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b18f17-3c98-4294-8560-750e3937aa86 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:51.064183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:51.088005 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e292-a674-4e63-8ddd-463e4c166aba None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:51.112776 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93905178-f294-4f56-acdd-814a51d08759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:51.113477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905178-f294-4f56-acdd-814a51d08759 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:51.113755 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905178-f294-4f56-acdd-814a51d08759 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:51.114028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905178-f294-4f56-acdd-814a51d08759 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:51.114888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93905178-f294-4f56-acdd-814a51d08759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:51.115198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93905178-f294-4f56-acdd-814a51d08759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:51.117085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93905178-f294-4f56-acdd-814a51d08759 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:51.138672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 378/763] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:51.140388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93905178-f294-4f56-acdd-814a51d08759 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:51.142878 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1c3b7-c060-4fae-bf53-ddbe868886f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:51.144443 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1c3b7-c060-4fae-bf53-ddbe868886f9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:51.146449 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1c3b7-c060-4fae-bf53-ddbe868886f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:51.146985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1c3b7-c060-4fae-bf53-ddbe868886f9 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:51.147938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1c3b7-c060-4fae-bf53-ddbe868886f9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:51.148450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1c3b7-c060-4fae-bf53-ddbe868886f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:51.150106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1c3b7-c060-4fae-bf53-ddbe868886f9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:51.162309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 386/764] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 21 08:13:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:51.162309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1c3b7-c060-4fae-bf53-ddbe868886f9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:51.246290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:51.276294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93905178-f294-4f56-acdd-814a51d08759 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:51.290658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1c3b7-c060-4fae-bf53-ddbe868886f9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:51.321432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42379838-c919-49fb-a35f-e5514b2bf10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:51.322303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42379838-c919-49fb-a35f-e5514b2bf10b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:51.322595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42379838-c919-49fb-a35f-e5514b2bf10b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:51.322859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42379838-c919-49fb-a35f-e5514b2bf10b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:51.332075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42379838-c919-49fb-a35f-e5514b2bf10b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:51.334233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42379838-c919-49fb-a35f-e5514b2bf10b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:51.336157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160817e-7856-476f-86ce-c79fa7a18162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:51.337577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160817e-7856-476f-86ce-c79fa7a18162 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:51.337952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160817e-7856-476f-86ce-c79fa7a18162 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:51.338756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160817e-7856-476f-86ce-c79fa7a18162 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:51.346964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160817e-7856-476f-86ce-c79fa7a18162 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:51.348813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160817e-7856-476f-86ce-c79fa7a18162 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-42379838-c919-49fb-a35f-e5514b2bf10b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:51.352392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:51.353345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:51.354218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:51.354218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:51.354218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:51.354218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:51.354218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:51.354218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:51.354218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:51.354218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:51.361473 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 379/765] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:51.362778 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42379838-c919-49fb-a35f-e5514b2bf10b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f160817e-7856-476f-86ce-c79fa7a18162 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:51.367342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:51.368456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:51.369441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:51.369441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:51.369441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:51.369441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:51.369441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:51.369441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:51.369441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:51.369441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:51.376999 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 387/766] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:51.379056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160817e-7856-476f-86ce-c79fa7a18162 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:51.401329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:51.501161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42379838-c919-49fb-a35f-e5514b2bf10b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:51.545698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c017829-5bf1-4600-a002-feeab5d6b4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:51.546724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c017829-5bf1-4600-a002-feeab5d6b4ee None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:51.547218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c017829-5bf1-4600-a002-feeab5d6b4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:51.547725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c017829-5bf1-4600-a002-feeab5d6b4ee None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:51.548672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c017829-5bf1-4600-a002-feeab5d6b4ee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:51.549159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c017829-5bf1-4600-a002-feeab5d6b4ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:51.551231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c017829-5bf1-4600-a002-feeab5d6b4ee None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:51.564172 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 380/767] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 21 08:13:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:51.566358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c017829-5bf1-4600-a002-feeab5d6b4ee None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:51.619738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160817e-7856-476f-86ce-c79fa7a18162 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:51.659349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:51.672384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887d6d5-cd4f-4076-b554-97325450d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:51.673832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887d6d5-cd4f-4076-b554-97325450d64f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:51.674322 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887d6d5-cd4f-4076-b554-97325450d64f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:51.674828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887d6d5-cd4f-4076-b554-97325450d64f None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:51.675863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887d6d5-cd4f-4076-b554-97325450d64f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:51.676394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887d6d5-cd4f-4076-b554-97325450d64f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:51.679169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887d6d5-cd4f-4076-b554-97325450d64f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:51.701363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 388/768] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:51.702783 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887d6d5-cd4f-4076-b554-97325450d64f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:51.728768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:51.755131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c017829-5bf1-4600-a002-feeab5d6b4ee None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:51.826847 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993aba6-27ca-41de-9a37-bebad812b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:51.828036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993aba6-27ca-41de-9a37-bebad812b887 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:51.828615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993aba6-27ca-41de-9a37-bebad812b887 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:51.829105 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993aba6-27ca-41de-9a37-bebad812b887 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:51.830768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993aba6-27ca-41de-9a37-bebad812b887 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:51.831377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993aba6-27ca-41de-9a37-bebad812b887 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:51.834170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993aba6-27ca-41de-9a37-bebad812b887 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:51.844265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887d6d5-cd4f-4076-b554-97325450d64f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:51.876951 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 381/769] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:51.878769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993aba6-27ca-41de-9a37-bebad812b887 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:51.899324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec9d8c-1e77-4c25-ad50-be0c9e4638f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:51.900457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec9d8c-1e77-4c25-ad50-be0c9e4638f5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:51.900983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec9d8c-1e77-4c25-ad50-be0c9e4638f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:51.901451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec9d8c-1e77-4c25-ad50-be0c9e4638f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:51.903010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec9d8c-1e77-4c25-ad50-be0c9e4638f5 None admin] RBAC: Adding query filter params (interface=public, service_id=ebacf3cb6e79486c8583409aef513dad, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:51.903570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec9d8c-1e77-4c25-ad50-be0c9e4638f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:51.905679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec9d8c-1e77-4c25-ad50-be0c9e4638f5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:51.916475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 389/770] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 21 08:13:51 2022] GET /identity/v3/endpoints?service_id=ebacf3cb6e79486c8583409aef513dad&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:51.917807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec9d8c-1e77-4c25-ad50-be0c9e4638f5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:51.995587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:52.062539 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec9d8c-1e77-4c25-ad50-be0c9e4638f5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:52.094419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993aba6-27ca-41de-9a37-bebad812b887 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:52.130675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d676dd-82be-44e9-bde0-8db59cd5d827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:52.131970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d676dd-82be-44e9-bde0-8db59cd5d827 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:52.132808 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d676dd-82be-44e9-bde0-8db59cd5d827 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:52.133120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d676dd-82be-44e9-bde0-8db59cd5d827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:52.134841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d676dd-82be-44e9-bde0-8db59cd5d827 None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=300b1990926c4968b75a84a1f5794df1) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:52.135476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d676dd-82be-44e9-bde0-8db59cd5d827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:52.138435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d676dd-82be-44e9-bde0-8db59cd5d827 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:52.152249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dba9d5-d2fd-4374-9d23-f2d3b7e8bd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:52.153747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dba9d5-d2fd-4374-9d23-f2d3b7e8bd70 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:52.154263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dba9d5-d2fd-4374-9d23-f2d3b7e8bd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:52.154706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dba9d5-d2fd-4374-9d23-f2d3b7e8bd70 None admin] PATH_INFO: `/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/421f05e3d10e4393b28f77b6179ade8c/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:52.157277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dba9d5-d2fd-4374-9d23-f2d3b7e8bd70 None admin] RBAC: Authorizing `identity:create_grant(project_id=c487ed72a15c45faa40f743ae752e48b, user_id=421f05e3d10e4393b28f77b6179ade8c, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:52.159177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dba9d5-d2fd-4374-9d23-f2d3b7e8bd70 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:52.160917 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 390/771] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:13:51 2022] GET /identity/v3/role_assignments?user.id=300b1990926c4968b75a84a1f5794df1&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:52.162650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d676dd-82be-44e9-bde0-8db59cd5d827 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:52.190320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 382/772] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:13:51 2022] PUT /identity/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/421f05e3d10e4393b28f77b6179ade8c/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:13:52.192804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846510db-2c0c-4112-bf39-c05c8d1991bf None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:52.193241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846510db-2c0c-4112-bf39-c05c8d1991bf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:52.193678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846510db-2c0c-4112-bf39-c05c8d1991bf None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:52.203279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 383/773] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:52 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:52.205667 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4b6b4-5ea1-4ab3-9e90-fe4bb8c08d0c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:52.206136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4b6b4-5ea1-4ab3-9e90-fe4bb8c08d0c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:52.206585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4b6b4-5ea1-4ab3-9e90-fe4bb8c08d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:52.235583 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1de4b6b4-5ea1-4ab3-9e90-fe4bb8c08d0c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:52.237734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1de4b6b4-5ea1-4ab3-9e90-fe4bb8c08d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:52.244943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:52.444924 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 384/774] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:13:52.456590 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d676dd-82be-44e9-bde0-8db59cd5d827 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:52.504244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:52.523969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4b6b4-5ea1-4ab3-9e90-fe4bb8c08d0c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:52.547658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152c346-874a-48ca-b61d-72a40e4baff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:52.549438 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152c346-874a-48ca-b61d-72a40e4baff0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:52.549970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152c346-874a-48ca-b61d-72a40e4baff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:52.550410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152c346-874a-48ca-b61d-72a40e4baff0 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:52.551587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152c346-874a-48ca-b61d-72a40e4baff0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:52.553896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152c346-874a-48ca-b61d-72a40e4baff0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:52.571562 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 391/775] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 21 08:13:52 2022] GET /identity/v3/services => generated 772 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:52.732402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4b6b4-5ea1-4ab3-9e90-fe4bb8c08d0c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:52.790562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60884f21-ec27-425b-9d91-af3186b02640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:52.791418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60884f21-ec27-425b-9d91-af3186b02640 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:52.791696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60884f21-ec27-425b-9d91-af3186b02640 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:52.791964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60884f21-ec27-425b-9d91-af3186b02640 None admin] PATH_INFO: `/v3/services/network` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:52.792737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60884f21-ec27-425b-9d91-af3186b02640 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:52.794237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60884f21-ec27-425b-9d91-af3186b02640 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-60884f21-ec27-425b-9d91-af3186b02640 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:52.819634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:52.820728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:13:52.821571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:52.822939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 385/776] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:52 2022] GET /identity/v3/services/network => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:52.828324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152c346-874a-48ca-b61d-72a40e4baff0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:53.006328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152c346-874a-48ca-b61d-72a40e4baff0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:53.029275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fe688-b17d-4ccb-ba7d-a5d9148d83e7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:53.029787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fe688-b17d-4ccb-ba7d-a5d9148d83e7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:53.030276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fe688-b17d-4ccb-ba7d-a5d9148d83e7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:53.033510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 386/777] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:53.041851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f22cfb-6267-48e3-aaf3-cb90e9cbd7ac None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:53.042491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f22cfb-6267-48e3-aaf3-cb90e9cbd7ac None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:53.042966 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f22cfb-6267-48e3-aaf3-cb90e9cbd7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:53.054498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:53.057043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320b1a-9c74-43a9-9b31-97290db6ebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:53.057043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320b1a-9c74-43a9-9b31-97290db6ebb8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:53.058706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320b1a-9c74-43a9-9b31-97290db6ebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:53.058706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320b1a-9c74-43a9-9b31-97290db6ebb8 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:53.059028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9320b1a-9c74-43a9-9b31-97290db6ebb8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:53.059326 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9320b1a-9c74-43a9-9b31-97290db6ebb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:53.060821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9320b1a-9c74-43a9-9b31-97290db6ebb8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:53.068042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 392/778] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:13:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:53.077646 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320b1a-9c74-43a9-9b31-97290db6ebb8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:53.090547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c5f22cfb-6267-48e3-aaf3-cb90e9cbd7ac None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:53.095555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c5f22cfb-6267-48e3-aaf3-cb90e9cbd7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:53.225086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:53.357799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 387/779] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:13:53.366187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320b1a-9c74-43a9-9b31-97290db6ebb8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:53.372402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f22cfb-6267-48e3-aaf3-cb90e9cbd7ac None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:53.411512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4b735-f677-41a2-a752-22d985785c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:53.412212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4b735-f677-41a2-a752-22d985785c9d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:53.412513 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4b735-f677-41a2-a752-22d985785c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:53.413951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4b735-f677-41a2-a752-22d985785c9d None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:53.418011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4b735-f677-41a2-a752-22d985785c9d None admin] RBAC: Adding query filter params (type=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:53.418344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4b735-f677-41a2-a752-22d985785c9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:53.419774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4b735-f677-41a2-a752-22d985785c9d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:53.432234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 393/780] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:13:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:53.441357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4b735-f677-41a2-a752-22d985785c9d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:53.563757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4b735-f677-41a2-a752-22d985785c9d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:53.575309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:53.609289 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ded54-a635-4c95-9135-0dc4759724c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:53.610047 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ded54-a635-4c95-9135-0dc4759724c1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:53.610330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ded54-a635-4c95-9135-0dc4759724c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:53.610673 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ded54-a635-4c95-9135-0dc4759724c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:53.611558 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ded54-a635-4c95-9135-0dc4759724c1 None admin] RBAC: Adding query filter params (interface=public, service_id=60bc21cc8ce04287b1ba4b8c757b5a44, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:53.611872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ded54-a635-4c95-9135-0dc4759724c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:53.613601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ded54-a635-4c95-9135-0dc4759724c1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:53.628292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 394/781] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 21 08:13:53 2022] GET /identity/v3/endpoints?service_id=60bc21cc8ce04287b1ba4b8c757b5a44&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:13:53.636228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ded54-a635-4c95-9135-0dc4759724c1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:53.654386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f22cfb-6267-48e3-aaf3-cb90e9cbd7ac None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:53.732419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:53.740146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ac44b-ce88-4878-8be7-c8cca5d0ca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:53.741012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ac44b-ce88-4878-8be7-c8cca5d0ca8d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:53.741289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ac44b-ce88-4878-8be7-c8cca5d0ca8d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:53.741561 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ac44b-ce88-4878-8be7-c8cca5d0ca8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:53.764298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ac44b-ce88-4878-8be7-c8cca5d0ca8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d14ac44b-ce88-4878-8be7-c8cca5d0ca8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:53.778781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:53.781155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:53.783208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:53.783208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:53.783208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:53.783208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:53.783208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:53.783208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:53.783208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:53.783208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:53.783208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:53.783208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:53.783208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:13:53.783208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:53.795150 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 388/782] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:13:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:13:53.804546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ac44b-ce88-4878-8be7-c8cca5d0ca8d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:53.865946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ded54-a635-4c95-9135-0dc4759724c1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:53.906393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79bbdd-3e9c-4119-9bf2-8260f2981a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:53.907096 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79bbdd-3e9c-4119-9bf2-8260f2981a35 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:53.907375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79bbdd-3e9c-4119-9bf2-8260f2981a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:53.907650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79bbdd-3e9c-4119-9bf2-8260f2981a35 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:53.908461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79bbdd-3e9c-4119-9bf2-8260f2981a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:53.910139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79bbdd-3e9c-4119-9bf2-8260f2981a35 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:53.917280 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 395/783] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 21 08:13:53 2022] GET /identity/v3/services => generated 772 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:53.968226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ac44b-ce88-4878-8be7-c8cca5d0ca8d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:54.013035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcbe23-4aa9-4ba0-80b9-fce1362ec693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:54.013748 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcbe23-4aa9-4ba0-80b9-fce1362ec693 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:54.014031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcbe23-4aa9-4ba0-80b9-fce1362ec693 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:54.014303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcbe23-4aa9-4ba0-80b9-fce1362ec693 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:54.015105 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcbe23-4aa9-4ba0-80b9-fce1362ec693 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:54.015414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcbe23-4aa9-4ba0-80b9-fce1362ec693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:54.017013 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcbe23-4aa9-4ba0-80b9-fce1362ec693 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:54.031593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 389/784] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:13:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:54.034791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79bbdd-3e9c-4119-9bf2-8260f2981a35 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:54.082078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:54.161442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79bbdd-3e9c-4119-9bf2-8260f2981a35 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:54.203008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d820d82-9c44-4d34-a7b7-a26ab5625d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:54.204008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d820d82-9c44-4d34-a7b7-a26ab5625d89 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:54.204312 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d820d82-9c44-4d34-a7b7-a26ab5625d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:54.204619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d820d82-9c44-4d34-a7b7-a26ab5625d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:54.217225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d820d82-9c44-4d34-a7b7-a26ab5625d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:54.218755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d820d82-9c44-4d34-a7b7-a26ab5625d89 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-9d820d82-9c44-4d34-a7b7-a26ab5625d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:54.240195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:54.242382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:54.244532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:54.244532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:54.244532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:54.244532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:54.245073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 396/785] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:54.248066 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcbe23-4aa9-4ba0-80b9-fce1362ec693 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:54.326254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:54.372366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcbe23-4aa9-4ba0-80b9-fce1362ec693 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:54.419103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ea064-7e01-461f-b85c-3a9350da5d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:54.419779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ea064-7e01-461f-b85c-3a9350da5d73 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:54.420066 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ea064-7e01-461f-b85c-3a9350da5d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:54.420341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ea064-7e01-461f-b85c-3a9350da5d73 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:54.421209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ea064-7e01-461f-b85c-3a9350da5d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:54.421520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ea064-7e01-461f-b85c-3a9350da5d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:54.423032 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ea064-7e01-461f-b85c-3a9350da5d73 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:54.442417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 390/786] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:54.443907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d820d82-9c44-4d34-a7b7-a26ab5625d89 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:54.549299 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:54.564020 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d820d82-9c44-4d34-a7b7-a26ab5625d89 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:54.640179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038295e-1ab0-4851-a94b-5cf73a0ad736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:54.641658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038295e-1ab0-4851-a94b-5cf73a0ad736 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:54.642162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038295e-1ab0-4851-a94b-5cf73a0ad736 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:54.642644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038295e-1ab0-4851-a94b-5cf73a0ad736 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:54.666809 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038295e-1ab0-4851-a94b-5cf73a0ad736 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:54.669817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038295e-1ab0-4851-a94b-5cf73a0ad736 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0038295e-1ab0-4851-a94b-5cf73a0ad736 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:54.713913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:54.714941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:54.715873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:54.715873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:54.715873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:54.715873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:54.715873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:54.715873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:54.715873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:54.715873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:54.715873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:13:54.715873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:54.716405 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 397/787] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 21 08:13:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:54.726198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ea064-7e01-461f-b85c-3a9350da5d73 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:54.997770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ea064-7e01-461f-b85c-3a9350da5d73 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:55.014522 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14daa75-11ea-46c2-8f9c-80498004bb1f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:55.014985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14daa75-11ea-46c2-8f9c-80498004bb1f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:55.015450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14daa75-11ea-46c2-8f9c-80498004bb1f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:55.018048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 398/788] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:55.025730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c1196-fbf4-49ce-aaa7-ef8638daa5f9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:55.026219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c1196-fbf4-49ce-aaa7-ef8638daa5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:55.026711 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c1196-fbf4-49ce-aaa7-ef8638daa5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:55.037852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:55.089742 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-327c1196-fbf4-49ce-aaa7-ef8638daa5f9 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:55.091385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-327c1196-fbf4-49ce-aaa7-ef8638daa5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:55.098323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6d8af-9dcb-4a2b-88c2-9af8fc6e89ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:55.099474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6d8af-9dcb-4a2b-88c2-9af8fc6e89ea None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:55.099960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6d8af-9dcb-4a2b-88c2-9af8fc6e89ea None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:55.100411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6d8af-9dcb-4a2b-88c2-9af8fc6e89ea None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:55.102011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6d8af-9dcb-4a2b-88c2-9af8fc6e89ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:55.102542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6d8af-9dcb-4a2b-88c2-9af8fc6e89ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:55.109428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6d8af-9dcb-4a2b-88c2-9af8fc6e89ea None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:55.140881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 391/789] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jul 21 08:13:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:55.149777 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6d8af-9dcb-4a2b-88c2-9af8fc6e89ea None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:55.283409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6d8af-9dcb-4a2b-88c2-9af8fc6e89ea None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:55.313568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 399/790] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:13:55.349330 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb454a08-11bd-4d00-b53a-323bb7820068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:55.350177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb454a08-11bd-4d00-b53a-323bb7820068 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:55.350455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb454a08-11bd-4d00-b53a-323bb7820068 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:55.350727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb454a08-11bd-4d00-b53a-323bb7820068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:55.367067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb454a08-11bd-4d00-b53a-323bb7820068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:55.369280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb454a08-11bd-4d00-b53a-323bb7820068 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:55.374377 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c1196-fbf4-49ce-aaa7-ef8638daa5f9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-bb454a08-11bd-4d00-b53a-323bb7820068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:55.390088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:55.391825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:55.393662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:55.393662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:55.393662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:55.393662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:55.397570 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 392/791] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:55.398631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb454a08-11bd-4d00-b53a-323bb7820068 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:55.450849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:55.545288 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb454a08-11bd-4d00-b53a-323bb7820068 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:55.584574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:55.625852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce32bc7-292e-42a7-b188-0e1299062d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:55.627396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce32bc7-292e-42a7-b188-0e1299062d36 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:55.628154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce32bc7-292e-42a7-b188-0e1299062d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:55.628904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce32bc7-292e-42a7-b188-0e1299062d36 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:55.630601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce32bc7-292e-42a7-b188-0e1299062d36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:55.631403 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce32bc7-292e-42a7-b188-0e1299062d36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:55.634015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce32bc7-292e-42a7-b188-0e1299062d36 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:55.640411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c1196-fbf4-49ce-aaa7-ef8638daa5f9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:55.664533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 393/792] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:13:55.664533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc338a6-956b-4f70-a232-0bce219139b8 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:55.664533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc338a6-956b-4f70-a232-0bce219139b8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:55.664533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc338a6-956b-4f70-a232-0bce219139b8 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:55.668878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 394/793] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:55.670295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc338a6-956b-4f70-a232-0bce219139b8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:55.721752 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7e09a-e7c3-4399-a431-ba4b1ce3e5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:55.722594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7e09a-e7c3-4399-a431-ba4b1ce3e5dd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:55.722877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7e09a-e7c3-4399-a431-ba4b1ce3e5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:55.723155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7e09a-e7c3-4399-a431-ba4b1ce3e5dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:55.736255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7e09a-e7c3-4399-a431-ba4b1ce3e5dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4af7e09a-e7c3-4399-a431-ba4b1ce3e5dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:55.745078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:55.746960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:55.749278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:55.749278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:55.749278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:55.749278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:55.749278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:55.749278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:55.749278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:55.749278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:55.749278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:55.749278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:55.749278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:13:55.749278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:55.751745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 400/794] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:55.753643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01615faa-825e-4993-9081-bd90d314246e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:55.753643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01615faa-825e-4993-9081-bd90d314246e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:55.754143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01615faa-825e-4993-9081-bd90d314246e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:55.775745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-01615faa-825e-4993-9081-bd90d314246e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:55.777041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-01615faa-825e-4993-9081-bd90d314246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:55.847202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:55.874373 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 401/795] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:13:55.875389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc338a6-956b-4f70-a232-0bce219139b8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:55.885542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01615faa-825e-4993-9081-bd90d314246e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:55.933859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacb23c-7877-447f-b374-1dc01dab79c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:55.934816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacb23c-7877-447f-b374-1dc01dab79c2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:55.935157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacb23c-7877-447f-b374-1dc01dab79c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:55.936196 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacb23c-7877-447f-b374-1dc01dab79c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:55.947049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacb23c-7877-447f-b374-1dc01dab79c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:55.949015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacb23c-7877-447f-b374-1dc01dab79c2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-beacb23c-7877-447f-b374-1dc01dab79c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:13:55.968018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:55.969976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:55.971997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:13:55.971997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:13:55.971997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:13:55.971997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:13:55.971997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:13:55.971997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:13:55.971997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:13:55.971997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:55.974874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:55.977249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 395/796] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:55.979226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a8baa-2e6c-42d3-a55e-6e620d288b22 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:55.979802 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a8baa-2e6c-42d3-a55e-6e620d288b22 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:55.980237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a8baa-2e6c-42d3-a55e-6e620d288b22 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:55.984542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 396/797] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:55.984542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a8baa-2e6c-42d3-a55e-6e620d288b22 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:56.031861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01615faa-825e-4993-9081-bd90d314246e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:56.088131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77741d8b-7bd9-41e4-8834-d84dca8bea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:56.088957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77741d8b-7bd9-41e4-8834-d84dca8bea8c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:56.089299 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77741d8b-7bd9-41e4-8834-d84dca8bea8c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:56.089649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77741d8b-7bd9-41e4-8834-d84dca8bea8c None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:56.090696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77741d8b-7bd9-41e4-8834-d84dca8bea8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:56.091112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77741d8b-7bd9-41e4-8834-d84dca8bea8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:56.093145 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77741d8b-7bd9-41e4-8834-d84dca8bea8c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:56.106170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 402/798] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:56.108064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77741d8b-7bd9-41e4-8834-d84dca8bea8c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:56.139506 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a8baa-2e6c-42d3-a55e-6e620d288b22 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:56.185337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce439c-0011-4f81-a0e8-f90e07f1a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:56.186310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce439c-0011-4f81-a0e8-f90e07f1a814 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:56.186591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce439c-0011-4f81-a0e8-f90e07f1a814 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:56.186870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce439c-0011-4f81-a0e8-f90e07f1a814 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:56.187564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce439c-0011-4f81-a0e8-f90e07f1a814 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:56.189093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce439c-0011-4f81-a0e8-f90e07f1a814 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-71ce439c-0011-4f81-a0e8-f90e07f1a814 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:56.202695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:56.210849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:56.212384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 397/799] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Jul 21 08:13:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:56.213989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9923a-4787-45f7-85e4-70e36c10e58d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:56.213989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9923a-4787-45f7-85e4-70e36c10e58d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:56.213989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9923a-4787-45f7-85e4-70e36c10e58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:56.229762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8de9923a-4787-45f7-85e4-70e36c10e58d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:56.231080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8de9923a-4787-45f7-85e4-70e36c10e58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:56.233657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:56.269457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77741d8b-7bd9-41e4-8834-d84dca8bea8c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:56.325677 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:56.328254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 398/800] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:13:56.329223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9923a-4787-45f7-85e4-70e36c10e58d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:56.341303 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c47758-2ab8-4834-a045-65ce10fb8631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:56.343007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c47758-2ab8-4834-a045-65ce10fb8631 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:56.343888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c47758-2ab8-4834-a045-65ce10fb8631 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:56.344725 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c47758-2ab8-4834-a045-65ce10fb8631 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:56.347027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c47758-2ab8-4834-a045-65ce10fb8631 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:56.348168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c47758-2ab8-4834-a045-65ce10fb8631 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:56.351841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c47758-2ab8-4834-a045-65ce10fb8631 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:56.379394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 403/801] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:13:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:56.381497 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c47758-2ab8-4834-a045-65ce10fb8631 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:56.494771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9923a-4787-45f7-85e4-70e36c10e58d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:56.567453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a8b2a-74b9-40a8-9917-5d91aa82a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:56.569560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a8b2a-74b9-40a8-9917-5d91aa82a862 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:56.570113 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a8b2a-74b9-40a8-9917-5d91aa82a862 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:56.570512 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a8b2a-74b9-40a8-9917-5d91aa82a862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:56.577431 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c47758-2ab8-4834-a045-65ce10fb8631 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:56.578597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:56.583713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a8b2a-74b9-40a8-9917-5d91aa82a862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:56.586380 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a8b2a-74b9-40a8-9917-5d91aa82a862 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e91a8b2a-74b9-40a8-9917-5d91aa82a862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:56.607129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:56.608225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:56.609751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:56.609751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:56.609751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:56.609751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:56.609751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 399/802] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:56.609751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a8b2a-74b9-40a8-9917-5d91aa82a862 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:56.643293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749820b-feb2-4bc2-8c4d-b4534807d712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:56.644046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749820b-feb2-4bc2-8c4d-b4534807d712 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:56.644130 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749820b-feb2-4bc2-8c4d-b4534807d712 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:56.644408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749820b-feb2-4bc2-8c4d-b4534807d712 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:56.645551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749820b-feb2-4bc2-8c4d-b4534807d712 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:56.645856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749820b-feb2-4bc2-8c4d-b4534807d712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:56.647279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749820b-feb2-4bc2-8c4d-b4534807d712 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:56.653668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 404/803] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 21 08:13:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:56.658485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749820b-feb2-4bc2-8c4d-b4534807d712 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:56.761705 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:56.796935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a8b2a-74b9-40a8-9917-5d91aa82a862 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:56.850289 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749820b-feb2-4bc2-8c4d-b4534807d712 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:56.858827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854877b-9215-4337-b1be-5e4da113a1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:56.860108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854877b-9215-4337-b1be-5e4da113a1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:56.860592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854877b-9215-4337-b1be-5e4da113a1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:56.861041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854877b-9215-4337-b1be-5e4da113a1b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:56.880318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854877b-9215-4337-b1be-5e4da113a1b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2854877b-9215-4337-b1be-5e4da113a1b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:13:56.893532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:56.895701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 400/804] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:56.898654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854877b-9215-4337-b1be-5e4da113a1b6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:56.925610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38937569-6864-4102-855e-532a65d0b005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:56.927186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38937569-6864-4102-855e-532a65d0b005 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:56.927667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38937569-6864-4102-855e-532a65d0b005 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:56.928158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38937569-6864-4102-855e-532a65d0b005 None admin] PATH_INFO: `/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/06e0753ca5174046841396a304262d06/roles/9e4aabf99fc8417596f726f0229d19a6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:56.955191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38937569-6864-4102-855e-532a65d0b005 None admin] RBAC: Authorizing `identity:create_grant(project_id=c487ed72a15c45faa40f743ae752e48b, user_id=06e0753ca5174046841396a304262d06, role_id=9e4aabf99fc8417596f726f0229d19a6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:56.958080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38937569-6864-4102-855e-532a65d0b005 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:56.973425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:56.979645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 405/805] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:13:56 2022] PUT /identity/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/06e0753ca5174046841396a304262d06/roles/9e4aabf99fc8417596f726f0229d19a6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:13:56.981572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38937569-6864-4102-855e-532a65d0b005 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:57.099173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854877b-9215-4337-b1be-5e4da113a1b6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:57.168983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc539d-bd21-4fd5-a659-a4191f951986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:57.170069 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc539d-bd21-4fd5-a659-a4191f951986 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:57.170069 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc539d-bd21-4fd5-a659-a4191f951986 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:57.170474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc539d-bd21-4fd5-a659-a4191f951986 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:57.171751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc539d-bd21-4fd5-a659-a4191f951986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:57.172406 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc539d-bd21-4fd5-a659-a4191f951986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:57.174906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc539d-bd21-4fd5-a659-a4191f951986 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:57.197364 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 401/806] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:57.198874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc539d-bd21-4fd5-a659-a4191f951986 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:57.201282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38937569-6864-4102-855e-532a65d0b005 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:57.211368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:57.280199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efc8ac-bca9-44a8-9e61-8c70fe079979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:57.280966 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efc8ac-bca9-44a8-9e61-8c70fe079979 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:57.281865 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efc8ac-bca9-44a8-9e61-8c70fe079979 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:57.282217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efc8ac-bca9-44a8-9e61-8c70fe079979 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:57.283048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efc8ac-bca9-44a8-9e61-8c70fe079979 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:57.283291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efc8ac-bca9-44a8-9e61-8c70fe079979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:57.285244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efc8ac-bca9-44a8-9e61-8c70fe079979 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:57.296582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 406/807] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 21 08:13:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:57.296582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e36bd-53f2-40dd-8d7e-8b71a398c9c0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:57.296582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e36bd-53f2-40dd-8d7e-8b71a398c9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:57.296582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e36bd-53f2-40dd-8d7e-8b71a398c9c0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:57.302257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 407/808] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:57.304164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e36bd-53f2-40dd-8d7e-8b71a398c9c0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:57.378008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc539d-bd21-4fd5-a659-a4191f951986 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:57.402713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:57.445638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c38a3-f044-457c-838f-9ad0f873202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:57.447020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c38a3-f044-457c-838f-9ad0f873202e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:57.447701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c38a3-f044-457c-838f-9ad0f873202e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:57.448311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c38a3-f044-457c-838f-9ad0f873202e None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:57.449857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c38a3-f044-457c-838f-9ad0f873202e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:57.450623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c38a3-f044-457c-838f-9ad0f873202e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:57.453490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c38a3-f044-457c-838f-9ad0f873202e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:57.474883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e36bd-53f2-40dd-8d7e-8b71a398c9c0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:57.476603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 402/809] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:13:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:57.481332 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497798e-76fc-4c68-b7a7-24f680e8c57f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:57.481802 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497798e-76fc-4c68-b7a7-24f680e8c57f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:57.482291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497798e-76fc-4c68-b7a7-24f680e8c57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:57.509418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7497798e-76fc-4c68-b7a7-24f680e8c57f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:57.511421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7497798e-76fc-4c68-b7a7-24f680e8c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:57.540844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d5acc-7e73-47f3-982d-2fe367de5278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:57.542526 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d5acc-7e73-47f3-982d-2fe367de5278 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:57.542908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d5acc-7e73-47f3-982d-2fe367de5278 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:57.543064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d5acc-7e73-47f3-982d-2fe367de5278 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:57.553059 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d5acc-7e73-47f3-982d-2fe367de5278 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:57.554559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d5acc-7e73-47f3-982d-2fe367de5278 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-414d5acc-7e73-47f3-982d-2fe367de5278 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:57.582331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:57.583357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:57.586176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:57.586176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:57.586176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:57.586176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:57.586176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:57.586176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:57.586176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:57.586176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:57.586176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:13:57.586176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:57.586176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 408/810] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 21 08:13:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:57.588560 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d5acc-7e73-47f3-982d-2fe367de5278 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:57.634517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 403/811] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:13:57.634517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497798e-76fc-4c68-b7a7-24f680e8c57f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:57.678338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:57.795585 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d5acc-7e73-47f3-982d-2fe367de5278 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:57.857882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497798e-76fc-4c68-b7a7-24f680e8c57f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:57.860123 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:57.869300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dde9c-9c0f-46b0-acd8-ea1be2222e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:57.870880 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dde9c-9c0f-46b0-acd8-ea1be2222e34 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:57.871605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dde9c-9c0f-46b0-acd8-ea1be2222e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:57.872420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dde9c-9c0f-46b0-acd8-ea1be2222e34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:57.874129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94dde9c-9c0f-46b0-acd8-ea1be2222e34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:57.877117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94dde9c-9c0f-46b0-acd8-ea1be2222e34 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:57.916056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de3550-9268-4f47-a1e5-163e8159c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:57.917415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de3550-9268-4f47-a1e5-163e8159c41a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:57.917887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de3550-9268-4f47-a1e5-163e8159c41a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:57.918347 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de3550-9268-4f47-a1e5-163e8159c41a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:57.922278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 409/812] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 21 08:13:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:13:57.924808 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dde9c-9c0f-46b0-acd8-ea1be2222e34 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:57.938614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de3550-9268-4f47-a1e5-163e8159c41a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:57.943679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de3550-9268-4f47-a1e5-163e8159c41a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-56de3550-9268-4f47-a1e5-163e8159c41a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:57.991779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:57.993814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:57.995790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:57.995790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:57.995790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:57.995790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:57.995790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 404/813] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:57.996398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de3550-9268-4f47-a1e5-163e8159c41a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:58.150387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:58.154913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de3550-9268-4f47-a1e5-163e8159c41a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:58.204405 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dde9c-9c0f-46b0-acd8-ea1be2222e34 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:58.209157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc746cda-c09d-40d8-a63f-043c71f9eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:58.210729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc746cda-c09d-40d8-a63f-043c71f9eaef None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:58.211211 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc746cda-c09d-40d8-a63f-043c71f9eaef None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:58.211718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc746cda-c09d-40d8-a63f-043c71f9eaef None admin] PATH_INFO: `/v3/services/network` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:58.212654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc746cda-c09d-40d8-a63f-043c71f9eaef None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:58.214322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc746cda-c09d-40d8-a63f-043c71f9eaef None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-dc746cda-c09d-40d8-a63f-043c71f9eaef None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:58.228368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:58.229453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:13:58.230284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:58.238616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 405/814] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:13:57 2022] GET /identity/v3/services/network => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:58.238616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc746cda-c09d-40d8-a63f-043c71f9eaef None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:58.273561 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:58.294768 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cce2b4-8ddd-4e09-bad4-9517f437b4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:58.295951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cce2b4-8ddd-4e09-bad4-9517f437b4ba None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:58.296439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cce2b4-8ddd-4e09-bad4-9517f437b4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:58.296980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cce2b4-8ddd-4e09-bad4-9517f437b4ba None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:58.298627 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cce2b4-8ddd-4e09-bad4-9517f437b4ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:58.299151 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cce2b4-8ddd-4e09-bad4-9517f437b4ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:58.301954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cce2b4-8ddd-4e09-bad4-9517f437b4ba None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:58.339383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 410/815] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 21 08:13:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:58.340837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cce2b4-8ddd-4e09-bad4-9517f437b4ba None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:58.434507 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc746cda-c09d-40d8-a63f-043c71f9eaef None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:58.491172 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bf5ad-e6b4-441a-a8c6-c40b0a4af2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:58.492306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bf5ad-e6b4-441a-a8c6-c40b0a4af2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:58.492847 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bf5ad-e6b4-441a-a8c6-c40b0a4af2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:58.493323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bf5ad-e6b4-441a-a8c6-c40b0a4af2f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:58.494341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bf5ad-e6b4-441a-a8c6-c40b0a4af2f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:58.495353 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bf5ad-e6b4-441a-a8c6-c40b0a4af2f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:58.497981 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bf5ad-e6b4-441a-a8c6-c40b0a4af2f3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:58.528922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 406/816] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:58.530901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bf5ad-e6b4-441a-a8c6-c40b0a4af2f3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:58.552755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cce2b4-8ddd-4e09-bad4-9517f437b4ba None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:58.610019 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b64ab-fb97-4a50-9ff3-9c95099ebdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:58.611511 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b64ab-fb97-4a50-9ff3-9c95099ebdc4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:58.612099 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b64ab-fb97-4a50-9ff3-9c95099ebdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:58.612601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b64ab-fb97-4a50-9ff3-9c95099ebdc4 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:58.613644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b64ab-fb97-4a50-9ff3-9c95099ebdc4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:58.614160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b64ab-fb97-4a50-9ff3-9c95099ebdc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:58.615820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b64ab-fb97-4a50-9ff3-9c95099ebdc4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:58.623886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 411/817] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:13:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:58.625344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b64ab-fb97-4a50-9ff3-9c95099ebdc4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:58.634171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:58.709721 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:58.751509 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bf5ad-e6b4-441a-a8c6-c40b0a4af2f3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:58.808527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd99080-5fdb-4dde-80dd-6094be9b8668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:58.808527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd99080-5fdb-4dde-80dd-6094be9b8668 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:58.808527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd99080-5fdb-4dde-80dd-6094be9b8668 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:58.808527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd99080-5fdb-4dde-80dd-6094be9b8668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:58.862847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b64ab-fb97-4a50-9ff3-9c95099ebdc4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:58.936819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf96e3-c6fe-46c4-90ef-35369722eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:58.941169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf96e3-c6fe-46c4-90ef-35369722eae0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:58.941979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf96e3-c6fe-46c4-90ef-35369722eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:58.942590 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf96e3-c6fe-46c4-90ef-35369722eae0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:58.958363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf96e3-c6fe-46c4-90ef-35369722eae0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:58.961388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf96e3-c6fe-46c4-90ef-35369722eae0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:58.962641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd99080-5fdb-4dde-80dd-6094be9b8668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:58.966096 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd99080-5fdb-4dde-80dd-6094be9b8668 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1abf96e3-c6fe-46c4-90ef-35369722eae0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:13:58.984763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:58.986707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:58.988664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:58.988664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:58.988664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:13:58.988664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:13:58.988664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:13:58.988664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:13:58.988664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:13:58.988664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:13:58.988664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:13:58.988664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:58.996088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 412/818] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:13:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:58.997765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf96e3-c6fe-46c4-90ef-35369722eae0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:59.133198 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:59.140663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:59.169092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 407/819] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:13:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:13:59.170342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd99080-5fdb-4dde-80dd-6094be9b8668 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:59.208179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf96e3-c6fe-46c4-90ef-35369722eae0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:59.295207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e19273-45a9-43f2-b499-bb0c1955faf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:59.299046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e19273-45a9-43f2-b499-bb0c1955faf0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:59.299046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e19273-45a9-43f2-b499-bb0c1955faf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:59.299046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e19273-45a9-43f2-b499-bb0c1955faf0 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:59.299046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e19273-45a9-43f2-b499-bb0c1955faf0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:59.299046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e19273-45a9-43f2-b499-bb0c1955faf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:59.301340 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e19273-45a9-43f2-b499-bb0c1955faf0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:59.315933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 413/820] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:13:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:59.315933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e19273-45a9-43f2-b499-bb0c1955faf0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:59.334183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd99080-5fdb-4dde-80dd-6094be9b8668 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:59.375741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154849fe-f008-4361-8046-cf85fd1959bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:59.376910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154849fe-f008-4361-8046-cf85fd1959bd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:59.377404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154849fe-f008-4361-8046-cf85fd1959bd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:59.377940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154849fe-f008-4361-8046-cf85fd1959bd None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:59.379166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154849fe-f008-4361-8046-cf85fd1959bd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:59.379682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154849fe-f008-4361-8046-cf85fd1959bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:59.381547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154849fe-f008-4361-8046-cf85fd1959bd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:59.403771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 408/821] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jul 21 08:13:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:59.405089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154849fe-f008-4361-8046-cf85fd1959bd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:59.443078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:59.510117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e19273-45a9-43f2-b499-bb0c1955faf0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:59.533282 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154849fe-f008-4361-8046-cf85fd1959bd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:59.561473 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:59.578342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9eedf-ff03-4cd4-a312-899b3a604ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:59.579515 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9eedf-ff03-4cd4-a312-899b3a604ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:59.580067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9eedf-ff03-4cd4-a312-899b3a604ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:59.580521 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9eedf-ff03-4cd4-a312-899b3a604ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:59.581433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9fe19-744b-4615-9b8c-c416cdd003d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:59.582373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9fe19-744b-4615-9b8c-c416cdd003d4 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:59.582883 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9fe19-744b-4615-9b8c-c416cdd003d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:59.583375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9fe19-744b-4615-9b8c-c416cdd003d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:59.584601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9fe19-744b-4615-9b8c-c416cdd003d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:59.586402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9fe19-744b-4615-9b8c-c416cdd003d4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:59.600243 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9eedf-ff03-4cd4-a312-899b3a604ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:59.602826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9eedf-ff03-4cd4-a312-899b3a604ad4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:59.614684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 409/822] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 21 08:13:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:13:59.616180 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9fe19-744b-4615-9b8c-c416cdd003d4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-49c9eedf-ff03-4cd4-a312-899b3a604ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:59.637723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:59.638719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:59.639621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:59.639621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:59.639621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:59.639621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:13:59.640616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 414/823] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:59.650402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9eedf-ff03-4cd4-a312-899b3a604ad4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:13:59.744442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:13:59.775932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9fe19-744b-4615-9b8c-c416cdd003d4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:59.833421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e6275-c113-40e7-a806-0beb83645c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:59.834617 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e6275-c113-40e7-a806-0beb83645c89 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:59.834903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e6275-c113-40e7-a806-0beb83645c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:59.835182 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e6275-c113-40e7-a806-0beb83645c89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:59.852620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e6275-c113-40e7-a806-0beb83645c89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:59.854619 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e6275-c113-40e7-a806-0beb83645c89 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:59.873478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9eedf-ff03-4cd4-a312-899b3a604ad4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9b9e6275-c113-40e7-a806-0beb83645c89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:13:59.879065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:13:59.880033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:13:59.881208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:13:59.881208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:13:59.881208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:13:59.881208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:13:59.882047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 410/824] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:13:59.883352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df1a2f-ef9d-47a3-9196-56141cbcc96e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:59.883724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df1a2f-ef9d-47a3-9196-56141cbcc96e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:59.884049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df1a2f-ef9d-47a3-9196-56141cbcc96e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:59.890094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 411/825] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:13:59.893572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bc39-47bf-45ce-a54b-2dc2ab6b2000 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:59.894099 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bc39-47bf-45ce-a54b-2dc2ab6b2000 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:59.894962 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bc39-47bf-45ce-a54b-2dc2ab6b2000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:59.928412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409b83c-1b74-43a9-b6bb-3a85c7dc4bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:13:59.929162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409b83c-1b74-43a9-b6bb-3a85c7dc4bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:13:59.929440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409b83c-1b74-43a9-b6bb-3a85c7dc4bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:13:59.929710 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409b83c-1b74-43a9-b6bb-3a85c7dc4bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:13:59.930462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409b83c-1b74-43a9-b6bb-3a85c7dc4bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:13:59.930702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-87e4bc39-47bf-45ce-a54b-2dc2ab6b2000 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:13:59.930803 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409b83c-1b74-43a9-b6bb-3a85c7dc4bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:13:59.932218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409b83c-1b74-43a9-b6bb-3a85c7dc4bf6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:13:59.934451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-87e4bc39-47bf-45ce-a54b-2dc2ab6b2000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:13:59.950325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 415/826] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:13:59.951273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409b83c-1b74-43a9-b6bb-3a85c7dc4bf6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:00.020381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:00.107480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409b83c-1b74-43a9-b6bb-3a85c7dc4bf6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:00.157104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397169c-ddde-4baf-952c-99c3fa315426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:00.158052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397169c-ddde-4baf-952c-99c3fa315426 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:00.158468 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397169c-ddde-4baf-952c-99c3fa315426 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:00.158967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397169c-ddde-4baf-952c-99c3fa315426 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:00.159865 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397169c-ddde-4baf-952c-99c3fa315426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:00.168636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397169c-ddde-4baf-952c-99c3fa315426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:00.168868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 412/827] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:13:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:00.168868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4bc39-47bf-45ce-a54b-2dc2ab6b2000 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:00.169090 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397169c-ddde-4baf-952c-99c3fa315426 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:00.196377 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 416/828] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:00.202576 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397169c-ddde-4baf-952c-99c3fa315426 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:00.254170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:00.305306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4bc39-47bf-45ce-a54b-2dc2ab6b2000 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:00.344667 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a1d44-1c50-4498-8555-18528b579ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:00.345688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a1d44-1c50-4498-8555-18528b579ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:00.345871 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a1d44-1c50-4498-8555-18528b579ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:00.346006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a1d44-1c50-4498-8555-18528b579ee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:00.351525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:00.354733 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a1d44-1c50-4498-8555-18528b579ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:00.356275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a1d44-1c50-4498-8555-18528b579ee0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:00.359253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397169c-ddde-4baf-952c-99c3fa315426 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-cc2a1d44-1c50-4498-8555-18528b579ee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:14:00.372665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:00.373927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:00.375601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:14:00.375601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:14:00.375601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:14:00.375601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:14:00.375601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:14:00.375601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:14:00.375601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:00.375601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:00.375601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 413/829] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:00.375601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a1d44-1c50-4498-8555-18528b579ee0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:00.415653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f99c2-c144-4ef6-ae7f-5d85e6e22790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:00.416981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f99c2-c144-4ef6-ae7f-5d85e6e22790 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:00.417419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f99c2-c144-4ef6-ae7f-5d85e6e22790 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:00.417878 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f99c2-c144-4ef6-ae7f-5d85e6e22790 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:00.430933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f99c2-c144-4ef6-ae7f-5d85e6e22790 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:00.433853 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f99c2-c144-4ef6-ae7f-5d85e6e22790 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-408f99c2-c144-4ef6-ae7f-5d85e6e22790 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:14:00.459698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:00.460700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:00.461683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:14:00.461683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:14:00.461683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:14:00.461683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:14:00.461683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:14:00.461683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:14:00.461683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:00.461683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:00.467432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 417/830] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:00.467432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f99c2-c144-4ef6-ae7f-5d85e6e22790 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:00.553533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a1d44-1c50-4498-8555-18528b579ee0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:00.590860 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:00.601729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9a440-422e-4a87-8499-b187910fa871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:00.602545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9a440-422e-4a87-8499-b187910fa871 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:00.602823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9a440-422e-4a87-8499-b187910fa871 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:00.603098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9a440-422e-4a87-8499-b187910fa871 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:00.615059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9a440-422e-4a87-8499-b187910fa871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1ee9a440-422e-4a87-8499-b187910fa871 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:14:00.623067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:00.624275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:00.625192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:00.625192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:00.625192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:00.625192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:00.625192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:14:00.625192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:14:00.625192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:14:00.625192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:14:00.625192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:14:00.625192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:14:00.625192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:14:00.625192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:00.625819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f99c2-c144-4ef6-ae7f-5d85e6e22790 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:00.625903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 414/831] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:14:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:00.625903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9a440-422e-4a87-8499-b187910fa871 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:00.670388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8c0d9-1e73-4dd9-8f1a-48f3b71728bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:00.671137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8c0d9-1e73-4dd9-8f1a-48f3b71728bd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:00.671403 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8c0d9-1e73-4dd9-8f1a-48f3b71728bd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:00.671681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8c0d9-1e73-4dd9-8f1a-48f3b71728bd None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:00.672568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8c0d9-1e73-4dd9-8f1a-48f3b71728bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:00.672890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8c0d9-1e73-4dd9-8f1a-48f3b71728bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:00.674543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8c0d9-1e73-4dd9-8f1a-48f3b71728bd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:00.689906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 418/832] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:00.691428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcae37-cd94-4030-ac13-fe5c3c264035 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:00.691712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcae37-cd94-4030-ac13-fe5c3c264035 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:00.691980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcae37-cd94-4030-ac13-fe5c3c264035 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:00.693686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 419/833] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:00.694294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcae37-cd94-4030-ac13-fe5c3c264035 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:00.716910 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:00.756371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9a440-422e-4a87-8499-b187910fa871 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:00.795931 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b7bd-2861-4be8-a984-9ade8b1f754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:00.796642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b7bd-2861-4be8-a984-9ade8b1f754d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:00.796918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b7bd-2861-4be8-a984-9ade8b1f754d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:00.797187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b7bd-2861-4be8-a984-9ade8b1f754d None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:00.798003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91b7bd-2861-4be8-a984-9ade8b1f754d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:00.798315 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91b7bd-2861-4be8-a984-9ade8b1f754d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:00.799937 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91b7bd-2861-4be8-a984-9ade8b1f754d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:00.816193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 415/834] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:00.817601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b7bd-2861-4be8-a984-9ade8b1f754d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:00.825082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcae37-cd94-4030-ac13-fe5c3c264035 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:00.881084 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b11343-1615-4a46-82fc-8e421a7dafc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:00.882116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b11343-1615-4a46-82fc-8e421a7dafc6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:00.882116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b11343-1615-4a46-82fc-8e421a7dafc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:00.882351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b11343-1615-4a46-82fc-8e421a7dafc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:00.883683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b11343-1615-4a46-82fc-8e421a7dafc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:00.884073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b11343-1615-4a46-82fc-8e421a7dafc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:00.886214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b11343-1615-4a46-82fc-8e421a7dafc6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:00.889656 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:00.897141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 420/835] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:14:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:00.898349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786691d0-fe3a-45ff-a919-e9dd535baac5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:00.898633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786691d0-fe3a-45ff-a919-e9dd535baac5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:00.898912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786691d0-fe3a-45ff-a919-e9dd535baac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:00.917755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-786691d0-fe3a-45ff-a919-e9dd535baac5 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:00.919376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-786691d0-fe3a-45ff-a919-e9dd535baac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:00.975886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b7bd-2861-4be8-a984-9ade8b1f754d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:01.003257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 421/836] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:01.004363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786691d0-fe3a-45ff-a919-e9dd535baac5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:01.022326 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:01.033083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fed8c-71f1-455a-811e-ae8db0d7913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:01.034115 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fed8c-71f1-455a-811e-ae8db0d7913f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:01.034463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fed8c-71f1-455a-811e-ae8db0d7913f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:01.034801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fed8c-71f1-455a-811e-ae8db0d7913f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:01.035852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fed8c-71f1-455a-811e-ae8db0d7913f None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=421f05e3d10e4393b28f77b6179ade8c) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:01.036228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fed8c-71f1-455a-811e-ae8db0d7913f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:01.038344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fed8c-71f1-455a-811e-ae8db0d7913f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:01.048680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 416/837] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:14:00 2022] GET /identity/v3/role_assignments?user.id=421f05e3d10e4393b28f77b6179ade8c&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:01.049894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fed8c-71f1-455a-811e-ae8db0d7913f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:01.199249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786691d0-fe3a-45ff-a919-e9dd535baac5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:01.233746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fed8c-71f1-455a-811e-ae8db0d7913f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:01.253791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aeecd-eea6-474c-ad05-c2f21800a708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:01.255477 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aeecd-eea6-474c-ad05-c2f21800a708 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:01.255970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aeecd-eea6-474c-ad05-c2f21800a708 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:01.256478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aeecd-eea6-474c-ad05-c2f21800a708 None admin] PATH_INFO: `/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/300b1990926c4968b75a84a1f5794df1/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:01.259665 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5aeecd-eea6-474c-ad05-c2f21800a708 None admin] RBAC: Authorizing `identity:create_grant(project_id=c487ed72a15c45faa40f743ae752e48b, user_id=300b1990926c4968b75a84a1f5794df1, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:01.261504 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5aeecd-eea6-474c-ad05-c2f21800a708 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:01.265658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:01.290346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 422/838] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:14:01 2022] PUT /identity/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/300b1990926c4968b75a84a1f5794df1/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:14:01.291136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aeecd-eea6-474c-ad05-c2f21800a708 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:01.323731 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a3dbb-ee37-46a1-94c9-0b827956668e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:01.325161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a3dbb-ee37-46a1-94c9-0b827956668e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:01.325611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a3dbb-ee37-46a1-94c9-0b827956668e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:01.326039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a3dbb-ee37-46a1-94c9-0b827956668e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:01.343490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a3dbb-ee37-46a1-94c9-0b827956668e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:01.345153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a3dbb-ee37-46a1-94c9-0b827956668e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c87a3dbb-ee37-46a1-94c9-0b827956668e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:01.374358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:01.375350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:01.376253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:01.376253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:01.376253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:01.376253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:01.378566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 417/839] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:01.383087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a3dbb-ee37-46a1-94c9-0b827956668e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:01.429184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:01.465100 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aeecd-eea6-474c-ad05-c2f21800a708 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:01.518253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a3dbb-ee37-46a1-94c9-0b827956668e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:01.518535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda51c4d-7539-4264-b9b6-7375ae741780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:01.519352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda51c4d-7539-4264-b9b6-7375ae741780 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:01.520008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda51c4d-7539-4264-b9b6-7375ae741780 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:01.520274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda51c4d-7539-4264-b9b6-7375ae741780 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:01.521277 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda51c4d-7539-4264-b9b6-7375ae741780 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:01.523796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda51c4d-7539-4264-b9b6-7375ae741780 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-eda51c4d-7539-4264-b9b6-7375ae741780 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:01.540385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:01.542369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:01.544070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 423/840] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:14:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:01.557521 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda51c4d-7539-4264-b9b6-7375ae741780 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:01.582947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9271c51-3aa6-48d7-bbc9-d2c51e8dcf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:01.584112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9271c51-3aa6-48d7-bbc9-d2c51e8dcf65 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:01.584820 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9271c51-3aa6-48d7-bbc9-d2c51e8dcf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:01.585322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9271c51-3aa6-48d7-bbc9-d2c51e8dcf65 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:01.586718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9271c51-3aa6-48d7-bbc9-d2c51e8dcf65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:01.587249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9271c51-3aa6-48d7-bbc9-d2c51e8dcf65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:01.590100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9271c51-3aa6-48d7-bbc9-d2c51e8dcf65 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:01.616337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 418/841] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:01.623368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9271c51-3aa6-48d7-bbc9-d2c51e8dcf65 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:01.671887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:01.721729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda51c4d-7539-4264-b9b6-7375ae741780 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:01.786386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9271c51-3aa6-48d7-bbc9-d2c51e8dcf65 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:01.788223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f928b-9923-4edb-85f9-94b7eb038643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:01.789167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f928b-9923-4edb-85f9-94b7eb038643 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:01.789559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f928b-9923-4edb-85f9-94b7eb038643 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:01.789932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f928b-9923-4edb-85f9-94b7eb038643 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:01.790938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f928b-9923-4edb-85f9-94b7eb038643 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:01.791157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f928b-9923-4edb-85f9-94b7eb038643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:01.792720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f928b-9923-4edb-85f9-94b7eb038643 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:01.794151 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:01.801343 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 424/842] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:14:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:01.813453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f928b-9923-4edb-85f9-94b7eb038643 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:01.874012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddee988-ac4f-42d9-a717-e6cca0486a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:01.876860 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddee988-ac4f-42d9-a717-e6cca0486a49 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:01.878046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddee988-ac4f-42d9-a717-e6cca0486a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:01.878849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddee988-ac4f-42d9-a717-e6cca0486a49 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:01.901134 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddee988-ac4f-42d9-a717-e6cca0486a49 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:01.904774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddee988-ac4f-42d9-a717-e6cca0486a49 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9ddee988-ac4f-42d9-a717-e6cca0486a49 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:14:01.948156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:01.950051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:01.951867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:01.951867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:01.951867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:14:01.951867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:14:01.951867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:14:01.951867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:14:01.951867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:14:01.951867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:14:01.951867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:14:01.951867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:01.960681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 419/843] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 21 08:14:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:01.963444 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddee988-ac4f-42d9-a717-e6cca0486a49 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:01.963689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f928b-9923-4edb-85f9-94b7eb038643 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:02.003897 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0434-a6ad-4c49-b6fc-423640157f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:02.004548 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0434-a6ad-4c49-b6fc-423640157f54 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:02.004842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0434-a6ad-4c49-b6fc-423640157f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:02.005111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0434-a6ad-4c49-b6fc-423640157f54 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:02.005849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e0434-a6ad-4c49-b6fc-423640157f54 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:02.006170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e0434-a6ad-4c49-b6fc-423640157f54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:02.007688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e0434-a6ad-4c49-b6fc-423640157f54 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:02.013737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 425/844] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:14:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:02.101923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:02.127944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddee988-ac4f-42d9-a717-e6cca0486a49 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:02.173555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963feb8-b3d6-4a9c-9880-deb8a50e049b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:02.174312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963feb8-b3d6-4a9c-9880-deb8a50e049b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:02.174656 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963feb8-b3d6-4a9c-9880-deb8a50e049b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:02.175065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963feb8-b3d6-4a9c-9880-deb8a50e049b None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:02.176143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963feb8-b3d6-4a9c-9880-deb8a50e049b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:02.176456 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963feb8-b3d6-4a9c-9880-deb8a50e049b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:02.178068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963feb8-b3d6-4a9c-9880-deb8a50e049b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:02.206375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 420/845] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jul 21 08:14:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:02.208636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0434-a6ad-4c49-b6fc-423640157f54 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:02.310327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:02.361668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0434-a6ad-4c49-b6fc-423640157f54 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:02.404937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990038c-0c98-44b8-a131-9b1fac592c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:02.405974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990038c-0c98-44b8-a131-9b1fac592c8b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:02.406543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990038c-0c98-44b8-a131-9b1fac592c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:02.407007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990038c-0c98-44b8-a131-9b1fac592c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:02.502189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990038c-0c98-44b8-a131-9b1fac592c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:02.504227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990038c-0c98-44b8-a131-9b1fac592c8b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:02.609451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:02.672532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 426/846] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:14:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:14:02.679049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963feb8-b3d6-4a9c-9880-deb8a50e049b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:02.797392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963feb8-b3d6-4a9c-9880-deb8a50e049b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:02.837176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb94ad6-948b-4e46-9da4-db73875ce026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:02.838024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb94ad6-948b-4e46-9da4-db73875ce026 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:02.838348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb94ad6-948b-4e46-9da4-db73875ce026 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:02.839137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb94ad6-948b-4e46-9da4-db73875ce026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:02.848916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:02.852309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb94ad6-948b-4e46-9da4-db73875ce026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:02.853945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb94ad6-948b-4e46-9da4-db73875ce026 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0eb94ad6-948b-4e46-9da4-db73875ce026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:02.874317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:02.875338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:02.876652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:02.876652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:02.876652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:02.876652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:02.876652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 421/847] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:02.883150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990038c-0c98-44b8-a131-9b1fac592c8b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:03.070760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990038c-0c98-44b8-a131-9b1fac592c8b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:03.138919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78ba8a-9ed3-4f2a-8913-212b55e82d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:03.139848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78ba8a-9ed3-4f2a-8913-212b55e82d38 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:03.140245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78ba8a-9ed3-4f2a-8913-212b55e82d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:03.140679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78ba8a-9ed3-4f2a-8913-212b55e82d38 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:03.141772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78ba8a-9ed3-4f2a-8913-212b55e82d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:03.142212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78ba8a-9ed3-4f2a-8913-212b55e82d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:03.144755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78ba8a-9ed3-4f2a-8913-212b55e82d38 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:03.169111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 427/848] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:03.175409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb94ad6-948b-4e46-9da4-db73875ce026 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:03.335068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb94ad6-948b-4e46-9da4-db73875ce026 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:03.402467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386a292-81fe-446c-9b44-b429d54026c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:03.403614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386a292-81fe-446c-9b44-b429d54026c7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:03.404033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386a292-81fe-446c-9b44-b429d54026c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:03.404436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386a292-81fe-446c-9b44-b429d54026c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:03.416879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386a292-81fe-446c-9b44-b429d54026c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:03.419410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386a292-81fe-446c-9b44-b429d54026c7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8386a292-81fe-446c-9b44-b429d54026c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:14:03.444784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:03.446697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:03.449091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:14:03.449091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:14:03.449091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:14:03.449091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:14:03.449091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:14:03.449091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:14:03.449091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:03.449091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:03.449091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 422/849] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:03.453963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78ba8a-9ed3-4f2a-8913-212b55e82d38 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:03.484167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:03.639177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78ba8a-9ed3-4f2a-8913-212b55e82d38 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:03.679062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6131d-ff9c-43bc-a424-38171c693450 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:03.679379 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6131d-ff9c-43bc-a424-38171c693450 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:03.680268 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6131d-ff9c-43bc-a424-38171c693450 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:03.688531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 423/850] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:03.692380 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8917d-ba43-4b1e-afd0-30b79e900259 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:03.692791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8917d-ba43-4b1e-afd0-30b79e900259 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:03.693095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8917d-ba43-4b1e-afd0-30b79e900259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:03.698870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff052a2-b0de-4ab3-8cfd-b413fef04ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:03.699567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff052a2-b0de-4ab3-8cfd-b413fef04ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:03.699859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff052a2-b0de-4ab3-8cfd-b413fef04ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:03.700120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff052a2-b0de-4ab3-8cfd-b413fef04ac4 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:03.700972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff052a2-b0de-4ab3-8cfd-b413fef04ac4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:03.701288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff052a2-b0de-4ab3-8cfd-b413fef04ac4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:03.702782 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff052a2-b0de-4ab3-8cfd-b413fef04ac4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:03.711537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-caf8917d-ba43-4b1e-afd0-30b79e900259 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:03.712988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-caf8917d-ba43-4b1e-afd0-30b79e900259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:03.722780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 428/851] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:14:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:03.724221 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff052a2-b0de-4ab3-8cfd-b413fef04ac4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:03.768634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:03.796768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 424/852] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:03.816955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8917d-ba43-4b1e-afd0-30b79e900259 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:03.825092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:03.848196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff052a2-b0de-4ab3-8cfd-b413fef04ac4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:03.898980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19088c5c-7a03-44da-8462-175a8b87edb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:03.901156 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19088c5c-7a03-44da-8462-175a8b87edb3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:03.901675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19088c5c-7a03-44da-8462-175a8b87edb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:03.902111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19088c5c-7a03-44da-8462-175a8b87edb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:03.903158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19088c5c-7a03-44da-8462-175a8b87edb3 None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=06e0753ca5174046841396a304262d06) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:03.903657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19088c5c-7a03-44da-8462-175a8b87edb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:03.906170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19088c5c-7a03-44da-8462-175a8b87edb3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:03.916595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 429/853] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:14:03 2022] GET /identity/v3/role_assignments?user.id=06e0753ca5174046841396a304262d06&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:03.950945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8917d-ba43-4b1e-afd0-30b79e900259 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:03.995811 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a2a72-9a41-4891-9c8f-74f51dc60c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:03.996781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a2a72-9a41-4891-9c8f-74f51dc60c61 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:03.997062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a2a72-9a41-4891-9c8f-74f51dc60c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:03.997383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a2a72-9a41-4891-9c8f-74f51dc60c61 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:03.998088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a2a72-9a41-4891-9c8f-74f51dc60c61 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:03.999582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a2a72-9a41-4891-9c8f-74f51dc60c61 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ba9a2a72-9a41-4891-9c8f-74f51dc60c61 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:04.014166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:04.015412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:04.016397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 425/854] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Jul 21 08:14:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:04.025403 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19088c5c-7a03-44da-8462-175a8b87edb3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:04.157509 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19088c5c-7a03-44da-8462-175a8b87edb3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:04.209935 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee85a8a-c64f-4573-96b7-7cf0bc939a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:04.210574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee85a8a-c64f-4573-96b7-7cf0bc939a5d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:04.210860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee85a8a-c64f-4573-96b7-7cf0bc939a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:04.211138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee85a8a-c64f-4573-96b7-7cf0bc939a5d None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:04.211893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee85a8a-c64f-4573-96b7-7cf0bc939a5d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:04.212203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee85a8a-c64f-4573-96b7-7cf0bc939a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:04.213689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee85a8a-c64f-4573-96b7-7cf0bc939a5d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:04.222077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 430/855] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 21 08:14:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:04.228541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a2a72-9a41-4891-9c8f-74f51dc60c61 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:04.294725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:04.358626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a2a72-9a41-4891-9c8f-74f51dc60c61 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:04.399877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20ebd5-c95f-4ba3-9150-3abfc722ef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:04.400617 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20ebd5-c95f-4ba3-9150-3abfc722ef10 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:04.400906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20ebd5-c95f-4ba3-9150-3abfc722ef10 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:04.401184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20ebd5-c95f-4ba3-9150-3abfc722ef10 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:04.401938 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20ebd5-c95f-4ba3-9150-3abfc722ef10 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:04.402248 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20ebd5-c95f-4ba3-9150-3abfc722ef10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:04.403705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20ebd5-c95f-4ba3-9150-3abfc722ef10 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:04.409928 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 426/856] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 21 08:14:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:04.535028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84d72a-0a6c-4f82-beca-1128039128f8 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:04.535249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84d72a-0a6c-4f82-beca-1128039128f8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:04.535531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84d72a-0a6c-4f82-beca-1128039128f8 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:04.537395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 431/857] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:04.543898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb58b0-9c6d-47d8-9ab3-3d9d2a719ff9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:04.544750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb58b0-9c6d-47d8-9ab3-3d9d2a719ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:04.545478 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb58b0-9c6d-47d8-9ab3-3d9d2a719ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:04.565245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-24fb58b0-9c6d-47d8-9ab3-3d9d2a719ff9 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:04.566937 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-24fb58b0-9c6d-47d8-9ab3-3d9d2a719ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:04.708661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 427/858] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:04.744915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84d72a-0a6c-4f82-beca-1128039128f8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:04.769202 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:04.890242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84d72a-0a6c-4f82-beca-1128039128f8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:04.934671 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665c5b6-f077-49e0-b8fb-53895105f6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:04.935906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665c5b6-f077-49e0-b8fb-53895105f6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:04.936399 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665c5b6-f077-49e0-b8fb-53895105f6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:04.936937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665c5b6-f077-49e0-b8fb-53895105f6d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:04.953998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665c5b6-f077-49e0-b8fb-53895105f6d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-9665c5b6-f077-49e0-b8fb-53895105f6d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:14:04.963969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:04.965594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:04.966530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:04.966530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:04.966530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:04.966530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:04.966530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:14:04.966530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:14:04.966530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:14:04.966530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:14:04.966530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:14:04.966530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:14:04.966530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:14:04.966530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:04.969829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 432/859] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:14:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:04.979292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb58b0-9c6d-47d8-9ab3-3d9d2a719ff9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:05.065484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:05.180201 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb58b0-9c6d-47d8-9ab3-3d9d2a719ff9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:05.241656 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e87c4f-8483-416a-96ed-962b0175c11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:05.242367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e87c4f-8483-416a-96ed-962b0175c11a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:05.242651 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e87c4f-8483-416a-96ed-962b0175c11a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:05.242948 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e87c4f-8483-416a-96ed-962b0175c11a None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:05.243723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e87c4f-8483-416a-96ed-962b0175c11a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:05.244032 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e87c4f-8483-416a-96ed-962b0175c11a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:05.245521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e87c4f-8483-416a-96ed-962b0175c11a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:05.256178 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 428/860] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:05.264367 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665c5b6-f077-49e0-b8fb-53895105f6d0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:05.323575 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f50cba-866c-471d-acaa-3a0adede9268 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:05.323860 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f50cba-866c-471d-acaa-3a0adede9268 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:05.324180 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f50cba-866c-471d-acaa-3a0adede9268 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:05.325930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 429/861] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:05.332032 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123330ae-af4a-46f4-a3dd-1e9a8ebc03cc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:05.332325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123330ae-af4a-46f4-a3dd-1e9a8ebc03cc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:05.332687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123330ae-af4a-46f4-a3dd-1e9a8ebc03cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:05.350919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-123330ae-af4a-46f4-a3dd-1e9a8ebc03cc None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:05.352193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-123330ae-af4a-46f4-a3dd-1e9a8ebc03cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:05.406816 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:05.452838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 430/862] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:05.461912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665c5b6-f077-49e0-b8fb-53895105f6d0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:05.475749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123330ae-af4a-46f4-a3dd-1e9a8ebc03cc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:05.515223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66132b-b9c2-40ee-ae0b-341e99b56428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:05.516591 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66132b-b9c2-40ee-ae0b-341e99b56428 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:05.517152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66132b-b9c2-40ee-ae0b-341e99b56428 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:05.517640 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66132b-b9c2-40ee-ae0b-341e99b56428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:05.531813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66132b-b9c2-40ee-ae0b-341e99b56428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:05.533953 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66132b-b9c2-40ee-ae0b-341e99b56428 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:05.548545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ef66132b-b9c2-40ee-ae0b-341e99b56428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:05.554632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:05.555755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:05.556877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:05.556877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:05.556877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:05.556877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:05.558818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 433/863] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:05.568236 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66132b-b9c2-40ee-ae0b-341e99b56428 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:05.692103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123330ae-af4a-46f4-a3dd-1e9a8ebc03cc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:05.757071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66132b-b9c2-40ee-ae0b-341e99b56428 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:05.765727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f7359-bb03-4608-bae4-9eb43095059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:05.766794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f7359-bb03-4608-bae4-9eb43095059f None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:05.767278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f7359-bb03-4608-bae4-9eb43095059f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:05.767723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f7359-bb03-4608-bae4-9eb43095059f None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:05.769161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f7359-bb03-4608-bae4-9eb43095059f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:05.772081 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f7359-bb03-4608-bae4-9eb43095059f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:05.801672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 431/864] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:14:05 2022] POST /identity/v3/services => generated 251 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:14:05.805040 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:05.849757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a191a-ca82-4a13-b6c8-2ae55b8d7eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:05.851643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a191a-ca82-4a13-b6c8-2ae55b8d7eec None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:05.852462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a191a-ca82-4a13-b6c8-2ae55b8d7eec None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:05.853317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a191a-ca82-4a13-b6c8-2ae55b8d7eec None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:05.855041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a191a-ca82-4a13-b6c8-2ae55b8d7eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:05.856066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a191a-ca82-4a13-b6c8-2ae55b8d7eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:05.859210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a191a-ca82-4a13-b6c8-2ae55b8d7eec None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:05.887676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 434/865] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:05.897374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f7359-bb03-4608-bae4-9eb43095059f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:06.028241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:06.044166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f7359-bb03-4608-bae4-9eb43095059f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:06.095527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db627431-4bfd-482a-981f-8c956966566c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:06.096383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db627431-4bfd-482a-981f-8c956966566c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:06.096693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db627431-4bfd-482a-981f-8c956966566c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:06.096966 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db627431-4bfd-482a-981f-8c956966566c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:06.106114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db627431-4bfd-482a-981f-8c956966566c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:06.107651 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db627431-4bfd-482a-981f-8c956966566c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-db627431-4bfd-482a-981f-8c956966566c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:14:06.123882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:06.125531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:06.127467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:06.127467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:06.127467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:14:06.127467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:14:06.127467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:14:06.127467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:14:06.127467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:14:06.127467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:14:06.127467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:14:06.127467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:06.127467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 432/866] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:14:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:06.131511 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a191a-ca82-4a13-b6c8-2ae55b8d7eec None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:06.326876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a282-f1b8-48a8-8eb4-932160cf822b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:06.327544 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a282-f1b8-48a8-8eb4-932160cf822b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:06.328053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a282-f1b8-48a8-8eb4-932160cf822b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:06.330093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 433/867] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:14:06.336138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ee24d-88bb-4d8e-a05e-0c58e260dcba None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:06.336824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ee24d-88bb-4d8e-a05e-0c58e260dcba None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:06.337314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ee24d-88bb-4d8e-a05e-0c58e260dcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:06.338788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a191a-ca82-4a13-b6c8-2ae55b8d7eec None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:06.356772 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-306ee24d-88bb-4d8e-a05e-0c58e260dcba None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:06.358422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-306ee24d-88bb-4d8e-a05e-0c58e260dcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:06.417840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c282a47-1cff-4ca9-a37f-62271918239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:06.418873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c282a47-1cff-4ca9-a37f-62271918239e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:06.419295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c282a47-1cff-4ca9-a37f-62271918239e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:06.419712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c282a47-1cff-4ca9-a37f-62271918239e None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:06.424372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c282a47-1cff-4ca9-a37f-62271918239e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:06.424840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c282a47-1cff-4ca9-a37f-62271918239e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:06.427046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c282a47-1cff-4ca9-a37f-62271918239e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:06.444957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 434/868] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:06 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:06.461462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 435/869] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jul 21 08:14:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:06.465037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ee24d-88bb-4d8e-a05e-0c58e260dcba None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:06.467608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c282a47-1cff-4ca9-a37f-62271918239e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:06.545167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:06.566621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:06.595789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ee24d-88bb-4d8e-a05e-0c58e260dcba None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:06.636566 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c282a47-1cff-4ca9-a37f-62271918239e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:06.652525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702710ea-e933-41ab-bfe1-3a86a2d4caf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:06.654181 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702710ea-e933-41ab-bfe1-3a86a2d4caf6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:06.654934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702710ea-e933-41ab-bfe1-3a86a2d4caf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:06.655421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702710ea-e933-41ab-bfe1-3a86a2d4caf6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:06.672055 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702710ea-e933-41ab-bfe1-3a86a2d4caf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-702710ea-e933-41ab-bfe1-3a86a2d4caf6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:14:06.682943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:06.683957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:06.684867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:06.684867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:06.684867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:06.684867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:06.684867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:14:06.684867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:14:06.684867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:14:06.684867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:14:06.684867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:14:06.684867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:14:06.684867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:14:06.684867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:06.686746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f889d82-04b1-4724-a8a0-166e0e47d642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:06.687977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 435/870] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jul 21 08:14:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:06.688622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f889d82-04b1-4724-a8a0-166e0e47d642 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:06.689130 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f889d82-04b1-4724-a8a0-166e0e47d642 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:06.689569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f889d82-04b1-4724-a8a0-166e0e47d642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:06.697487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702710ea-e933-41ab-bfe1-3a86a2d4caf6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:06.903350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f889d82-04b1-4724-a8a0-166e0e47d642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:06.905343 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f889d82-04b1-4724-a8a0-166e0e47d642 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:06.913814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702710ea-e933-41ab-bfe1-3a86a2d4caf6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:06.947397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:06.980654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800118e-7fd5-4428-9e4c-ad9107d40801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:06.981947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800118e-7fd5-4428-9e4c-ad9107d40801 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:06.982526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800118e-7fd5-4428-9e4c-ad9107d40801 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:06.983318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800118e-7fd5-4428-9e4c-ad9107d40801 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:06.984710 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800118e-7fd5-4428-9e4c-ad9107d40801 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:06.985371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800118e-7fd5-4428-9e4c-ad9107d40801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:06.988381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800118e-7fd5-4428-9e4c-ad9107d40801 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:07.008428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 436/871] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 21 08:14:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:07.018375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800118e-7fd5-4428-9e4c-ad9107d40801 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:07.026055 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:07.034562 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 436/872] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:14:06 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:14:07.042952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f889d82-04b1-4724-a8a0-166e0e47d642 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:07.160841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800118e-7fd5-4428-9e4c-ad9107d40801 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:07.200665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3159c-9042-474f-a02c-501c14d32d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:07.201827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3159c-9042-474f-a02c-501c14d32d65 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:07.202295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3159c-9042-474f-a02c-501c14d32d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:07.202822 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3159c-9042-474f-a02c-501c14d32d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:07.215799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3159c-9042-474f-a02c-501c14d32d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:07.217707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3159c-9042-474f-a02c-501c14d32d65 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:07.218750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f889d82-04b1-4724-a8a0-166e0e47d642 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-16e3159c-9042-474f-a02c-501c14d32d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:07.237683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:07.239464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:07.241849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:07.241849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:07.241849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:07.241849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:07.241849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 437/873] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:07.241849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33651-b93e-496c-88af-51ec1d09daeb None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:07.241849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33651-b93e-496c-88af-51ec1d09daeb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:07.241849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33651-b93e-496c-88af-51ec1d09daeb None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:07.243190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 438/874] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:07.249739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf33651-b93e-496c-88af-51ec1d09daeb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:07.289477 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2964db8-1d3b-4d69-b3d4-11f31b40df23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:07.290901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2964db8-1d3b-4d69-b3d4-11f31b40df23 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:07.291398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2964db8-1d3b-4d69-b3d4-11f31b40df23 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:07.291892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2964db8-1d3b-4d69-b3d4-11f31b40df23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:07.301502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:07.320789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2964db8-1d3b-4d69-b3d4-11f31b40df23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:07.324197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2964db8-1d3b-4d69-b3d4-11f31b40df23 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c2964db8-1d3b-4d69-b3d4-11f31b40df23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:07.359889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:07.361821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:07.363655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:07.363655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:07.363655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:07.363655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:07.363655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 437/875] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:07.365328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abcc8e-93d2-4814-9301-b677364f8aa7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:07.365755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abcc8e-93d2-4814-9301-b677364f8aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:07.366234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abcc8e-93d2-4814-9301-b677364f8aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:07.370619 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:07.398473 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-53abcc8e-93d2-4814-9301-b677364f8aa7 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:07.399973 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-53abcc8e-93d2-4814-9301-b677364f8aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:07.443669 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf33651-b93e-496c-88af-51ec1d09daeb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:07.492082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad38ab5-1d73-4413-81cd-359ad63ea319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:07.492816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad38ab5-1d73-4413-81cd-359ad63ea319 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:07.493095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad38ab5-1d73-4413-81cd-359ad63ea319 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:07.493492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad38ab5-1d73-4413-81cd-359ad63ea319 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:07.494121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad38ab5-1d73-4413-81cd-359ad63ea319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:07.494429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad38ab5-1d73-4413-81cd-359ad63ea319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:07.496041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad38ab5-1d73-4413-81cd-359ad63ea319 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:07.502495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 438/876] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:07.511285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 439/877] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:07.513764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abcc8e-93d2-4814-9301-b677364f8aa7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:07.517063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad38ab5-1d73-4413-81cd-359ad63ea319 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:07.656688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad38ab5-1d73-4413-81cd-359ad63ea319 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:07.677787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abcc8e-93d2-4814-9301-b677364f8aa7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:07.684026 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:07.717852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:07.718363 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e52dd7-7ea7-4776-b006-45b5b943cb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:07.719753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52dd7-7ea7-4776-b006-45b5b943cb22 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:07.720279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52dd7-7ea7-4776-b006-45b5b943cb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:07.720764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52dd7-7ea7-4776-b006-45b5b943cb22 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:07.734207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e52dd7-7ea7-4776-b006-45b5b943cb22 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:07.736790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e52dd7-7ea7-4776-b006-45b5b943cb22 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:07.745367 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb63b7a-fd6c-4161-bce3-1b0d720018c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:07.746997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb63b7a-fd6c-4161-bce3-1b0d720018c1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:07.747739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb63b7a-fd6c-4161-bce3-1b0d720018c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:07.748465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb63b7a-fd6c-4161-bce3-1b0d720018c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:07.750065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb63b7a-fd6c-4161-bce3-1b0d720018c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:07.750812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb63b7a-fd6c-4161-bce3-1b0d720018c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:07.753684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb63b7a-fd6c-4161-bce3-1b0d720018c1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e4e52dd7-7ea7-4776-b006-45b5b943cb22 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:14:07.764596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:07.766469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:07.768977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:07.768977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:07.768977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:14:07.768977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:14:07.768977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:14:07.768977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:14:07.768977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:14:07.768977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:14:07.768977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:14:07.768977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:07.768977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 440/878] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 21 08:14:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:14:07.768977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e52dd7-7ea7-4776-b006-45b5b943cb22 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:07.782713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 439/879] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:07.784913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb63b7a-fd6c-4161-bce3-1b0d720018c1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:07.921158 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e52dd7-7ea7-4776-b006-45b5b943cb22 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:07.947493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb63b7a-fd6c-4161-bce3-1b0d720018c1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:07.981454 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0b3e9-1a80-409a-982a-320a0afbf359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:07.982387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0b3e9-1a80-409a-982a-320a0afbf359 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:07.982674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0b3e9-1a80-409a-982a-320a0afbf359 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:07.982955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0b3e9-1a80-409a-982a-320a0afbf359 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:07.984336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0b3e9-1a80-409a-982a-320a0afbf359 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:07.986214 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0b3e9-1a80-409a-982a-320a0afbf359 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:08.003246 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fb9e7-c6cf-46a3-b243-286cdf7826c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:08.004376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fb9e7-c6cf-46a3-b243-286cdf7826c2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:08.004921 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fb9e7-c6cf-46a3-b243-286cdf7826c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:08.012564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fb9e7-c6cf-46a3-b243-286cdf7826c2 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:08.012891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 441/880] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:14:07 2022] POST /identity/v3/services => generated 269 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:14:08.012891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0b3e9-1a80-409a-982a-320a0afbf359 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:08.013091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fb9e7-c6cf-46a3-b243-286cdf7826c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:08.013091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fb9e7-c6cf-46a3-b243-286cdf7826c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:08.013091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fb9e7-c6cf-46a3-b243-286cdf7826c2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:08.046715 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 440/881] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jul 21 08:14:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:08.048462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15293954-ccdf-41ff-a9a5-639e26c2a6a0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:08.048765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15293954-ccdf-41ff-a9a5-639e26c2a6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:08.049035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15293954-ccdf-41ff-a9a5-639e26c2a6a0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:08.050587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 441/882] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:08.055300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15293954-ccdf-41ff-a9a5-639e26c2a6a0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:08.070888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:08.102442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:08.178826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0b3e9-1a80-409a-982a-320a0afbf359 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:08.201920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15293954-ccdf-41ff-a9a5-639e26c2a6a0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:08.226149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db8102-0c67-41d7-9076-5c566eaf3810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:08.227218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db8102-0c67-41d7-9076-5c566eaf3810 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:08.227657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db8102-0c67-41d7-9076-5c566eaf3810 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:08.228122 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db8102-0c67-41d7-9076-5c566eaf3810 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:08.236027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db8102-0c67-41d7-9076-5c566eaf3810 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:08.237578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db8102-0c67-41d7-9076-5c566eaf3810 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:08.247111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6f273-51cc-43b3-9336-83d2770adf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:08.247811 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6f273-51cc-43b3-9336-83d2770adf20 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:08.248075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6f273-51cc-43b3-9336-83d2770adf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:08.248342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6f273-51cc-43b3-9336-83d2770adf20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c0db8102-0c67-41d7-9076-5c566eaf3810 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:14:08.256223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:08.257398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:08.258339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:14:08.258339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:14:08.258339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:14:08.258339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:14:08.258339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:14:08.258339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:14:08.258339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:08.258339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:08.258339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 442/883] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:08.260194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79e2d-80cb-4169-9258-4ce29e54b1a2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:08.260654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79e2d-80cb-4169-9258-4ce29e54b1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:08.260838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79e2d-80cb-4169-9258-4ce29e54b1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:08.282299 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-87f79e2d-80cb-4169-9258-4ce29e54b1a2 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:08.283720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-87f79e2d-80cb-4169-9258-4ce29e54b1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:08.384181 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6f273-51cc-43b3-9336-83d2770adf20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:08.386673 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6f273-51cc-43b3-9336-83d2770adf20 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:08.425887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 443/884] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:08.427916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79e2d-80cb-4169-9258-4ce29e54b1a2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:08.452838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:08.471622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:08.553333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 442/885] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:14:08 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:14:08.553333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6f273-51cc-43b3-9336-83d2770adf20 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:08.582938 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79e2d-80cb-4169-9258-4ce29e54b1a2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:08.629972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d070286-e6c9-4405-b9b0-e48e35b492aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:08.630763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d070286-e6c9-4405-b9b0-e48e35b492aa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:08.631116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d070286-e6c9-4405-b9b0-e48e35b492aa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:08.631458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d070286-e6c9-4405-b9b0-e48e35b492aa None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:08.632438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d070286-e6c9-4405-b9b0-e48e35b492aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:08.632760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d070286-e6c9-4405-b9b0-e48e35b492aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:08.634410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d070286-e6c9-4405-b9b0-e48e35b492aa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:08.656553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 444/886] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:08.656553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d070286-e6c9-4405-b9b0-e48e35b492aa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:08.692944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6f273-51cc-43b3-9336-83d2770adf20 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:08.739679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55181f-8d3a-40d0-abb2-858438af5dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:08.740861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55181f-8d3a-40d0-abb2-858438af5dcb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:08.741045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55181f-8d3a-40d0-abb2-858438af5dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:08.741296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55181f-8d3a-40d0-abb2-858438af5dcb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:08.742052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55181f-8d3a-40d0-abb2-858438af5dcb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:08.743542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55181f-8d3a-40d0-abb2-858438af5dcb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:08.747618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6b55181f-8d3a-40d0-abb2-858438af5dcb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:08.759618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:08.761230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:14:08.762707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:08.768541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 443/887] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:14:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:08.768541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55181f-8d3a-40d0-abb2-858438af5dcb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:08.776876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:08.809293 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d070286-e6c9-4405-b9b0-e48e35b492aa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:08.853611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4963f-5733-4004-ab9d-fc0c372a7a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:08.854536 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4963f-5733-4004-ab9d-fc0c372a7a60 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:08.854824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4963f-5733-4004-ab9d-fc0c372a7a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:08.855100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4963f-5733-4004-ab9d-fc0c372a7a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:08.867559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4963f-5733-4004-ab9d-fc0c372a7a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:08.869147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4963f-5733-4004-ab9d-fc0c372a7a60 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-18f4963f-5733-4004-ab9d-fc0c372a7a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:08.888480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:08.889722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:08.890927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:08.890927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:08.890927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:08.890927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:08.890927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 445/888] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:08.890927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4963f-5733-4004-ab9d-fc0c372a7a60 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:08.898301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55181f-8d3a-40d0-abb2-858438af5dcb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:08.934287 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ecf55-5b72-48e6-9230-af3c41f82f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:08.934957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ecf55-5b72-48e6-9230-af3c41f82f5b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:08.935232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ecf55-5b72-48e6-9230-af3c41f82f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:08.935590 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ecf55-5b72-48e6-9230-af3c41f82f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:08.936644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ecf55-5b72-48e6-9230-af3c41f82f5b None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=300b1990926c4968b75a84a1f5794df1) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:08.937376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ecf55-5b72-48e6-9230-af3c41f82f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:08.938553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ecf55-5b72-48e6-9230-af3c41f82f5b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:08.952534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 444/889] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:14:08 2022] GET /identity/v3/role_assignments?user.id=300b1990926c4968b75a84a1f5794df1&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:08.952534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ecf55-5b72-48e6-9230-af3c41f82f5b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:09.025882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4963f-5733-4004-ab9d-fc0c372a7a60 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:09.040931 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:09.076016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d01ea8-9482-4782-8866-23599fcdc9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:09.076749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d01ea8-9482-4782-8866-23599fcdc9fb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:09.077100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d01ea8-9482-4782-8866-23599fcdc9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:09.077443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d01ea8-9482-4782-8866-23599fcdc9fb None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:09.078251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d01ea8-9482-4782-8866-23599fcdc9fb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:09.078643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d01ea8-9482-4782-8866-23599fcdc9fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:09.080160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d01ea8-9482-4782-8866-23599fcdc9fb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:09.081685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:09.086951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ecf55-5b72-48e6-9230-af3c41f82f5b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:09.087569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 446/890] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:14:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:09.093372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d01ea8-9482-4782-8866-23599fcdc9fb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:09.139209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45c7f2-6d8f-4f2f-a6df-153d01b8d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:09.140055 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45c7f2-6d8f-4f2f-a6df-153d01b8d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:09.140667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45c7f2-6d8f-4f2f-a6df-153d01b8d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:09.140942 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45c7f2-6d8f-4f2f-a6df-153d01b8d0d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:09.142792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45c7f2-6d8f-4f2f-a6df-153d01b8d0d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:09.143174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45c7f2-6d8f-4f2f-a6df-153d01b8d0d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:09.145072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45c7f2-6d8f-4f2f-a6df-153d01b8d0d6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:09.177659 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 445/891] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:09.184746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45c7f2-6d8f-4f2f-a6df-153d01b8d0d6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:09.254442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d01ea8-9482-4782-8866-23599fcdc9fb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:09.329450 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9839b-d416-4dcb-80c8-115fd7edd5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:09.331133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9839b-d416-4dcb-80c8-115fd7edd5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:09.331921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9839b-d416-4dcb-80c8-115fd7edd5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:09.332691 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9839b-d416-4dcb-80c8-115fd7edd5a9 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:09.334265 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9839b-d416-4dcb-80c8-115fd7edd5a9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:09.335069 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9839b-d416-4dcb-80c8-115fd7edd5a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:09.337912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9839b-d416-4dcb-80c8-115fd7edd5a9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:09.352630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 447/892] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:14:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:09.358075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9839b-d416-4dcb-80c8-115fd7edd5a9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:09.391728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45c7f2-6d8f-4f2f-a6df-153d01b8d0d6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:09.460873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:09.469932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6431e-89cc-43d3-b975-6fb48ff83734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:09.471693 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6431e-89cc-43d3-b975-6fb48ff83734 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:09.472146 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6431e-89cc-43d3-b975-6fb48ff83734 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:09.472630 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6431e-89cc-43d3-b975-6fb48ff83734 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:09.474717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:09.492627 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6431e-89cc-43d3-b975-6fb48ff83734 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:09.495516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6431e-89cc-43d3-b975-6fb48ff83734 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f2f6431e-89cc-43d3-b975-6fb48ff83734 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:14:09.527112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:09.529124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:09.531507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:14:09.531507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:14:09.531507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:14:09.531507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:14:09.531507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:14:09.531507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:14:09.531507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:09.531507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:09.535640 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 446/893] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:14:09.541905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6431e-89cc-43d3-b975-6fb48ff83734 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:09.560242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9839b-d416-4dcb-80c8-115fd7edd5a9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:09.624660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92223ce9-fbd4-4b67-9567-baafab5277c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:09.624660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92223ce9-fbd4-4b67-9567-baafab5277c0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:09.625075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92223ce9-fbd4-4b67-9567-baafab5277c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:09.625636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92223ce9-fbd4-4b67-9567-baafab5277c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:09.627210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92223ce9-fbd4-4b67-9567-baafab5277c0 None admin] RBAC: Adding query filter params (interface=public, service_id=89d521339d534068bd91296a861ebfba, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:09.627884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92223ce9-fbd4-4b67-9567-baafab5277c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:09.630513 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92223ce9-fbd4-4b67-9567-baafab5277c0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:09.652638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 448/894] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 21 08:14:09 2022] GET /identity/v3/endpoints?service_id=89d521339d534068bd91296a861ebfba&interface=public®ion_id=RegionOne => generated 194 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:09.654257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92223ce9-fbd4-4b67-9567-baafab5277c0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:09.762967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6431e-89cc-43d3-b975-6fb48ff83734 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:09.833817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6baae-1211-4149-a87c-d8032a3dc0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:09.835014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6baae-1211-4149-a87c-d8032a3dc0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:09.835479 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6baae-1211-4149-a87c-d8032a3dc0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:09.836024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6baae-1211-4149-a87c-d8032a3dc0a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:09.838015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6baae-1211-4149-a87c-d8032a3dc0a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:09.838015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6baae-1211-4149-a87c-d8032a3dc0a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:09.840883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6baae-1211-4149-a87c-d8032a3dc0a8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:09.856396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92223ce9-fbd4-4b67-9567-baafab5277c0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:09.869062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 447/895] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:09.875190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6baae-1211-4149-a87c-d8032a3dc0a8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:09.913956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:09.935077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186481-362c-45ec-8f54-8ca878ac45bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:09.936620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186481-362c-45ec-8f54-8ca878ac45bb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:09.937658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186481-362c-45ec-8f54-8ca878ac45bb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:09.938358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186481-362c-45ec-8f54-8ca878ac45bb None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:09.941032 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186481-362c-45ec-8f54-8ca878ac45bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:09.943762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186481-362c-45ec-8f54-8ca878ac45bb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:09.957663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 449/896] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 21 08:14:09 2022] GET /identity/v3/services => generated 1268 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:14:09.973596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:10.078999 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6baae-1211-4149-a87c-d8032a3dc0a8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:10.146469 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09911930-3daf-4e08-9e49-514d43974cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:10.147393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09911930-3daf-4e08-9e49-514d43974cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:10.147833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09911930-3daf-4e08-9e49-514d43974cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:10.148269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09911930-3daf-4e08-9e49-514d43974cb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:10.149746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09911930-3daf-4e08-9e49-514d43974cb0 None admin] RBAC: Adding query filter params (role.id=a53fbfc77af04f2881bdc3124af55c4a, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=06e0753ca5174046841396a304262d06) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:10.150262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09911930-3daf-4e08-9e49-514d43974cb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:10.152847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09911930-3daf-4e08-9e49-514d43974cb0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:10.164324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 448/897] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:14:09 2022] GET /identity/v3/role_assignments?user.id=06e0753ca5174046841396a304262d06&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=a53fbfc77af04f2881bdc3124af55c4a => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:10.172286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca33b5-d742-45a6-8755-0f306e54dceb None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:10.173089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca33b5-d742-45a6-8755-0f306e54dceb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:10.173089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca33b5-d742-45a6-8755-0f306e54dceb None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:10.179051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 450/898] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:10.181284 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448920f4-d6a9-459a-b27b-8f0edb152629 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:10.181665 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448920f4-d6a9-459a-b27b-8f0edb152629 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:10.181885 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448920f4-d6a9-459a-b27b-8f0edb152629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:10.202199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-448920f4-d6a9-459a-b27b-8f0edb152629 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:10.203583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-448920f4-d6a9-459a-b27b-8f0edb152629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:10.320011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 449/899] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:10.343114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca33b5-d742-45a6-8755-0f306e54dceb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:10.529652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca33b5-d742-45a6-8755-0f306e54dceb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:10.608837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5ea68-4d29-4e2d-9b7d-19789fa9fc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:10.610343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5ea68-4d29-4e2d-9b7d-19789fa9fc64 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:10.610845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5ea68-4d29-4e2d-9b7d-19789fa9fc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:10.611338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5ea68-4d29-4e2d-9b7d-19789fa9fc64 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:10.612730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5ea68-4d29-4e2d-9b7d-19789fa9fc64 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:10.615637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5ea68-4d29-4e2d-9b7d-19789fa9fc64 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8ed5ea68-4d29-4e2d-9b7d-19789fa9fc64 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:10.641309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:10.642338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:14:10.643245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:10.644976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 451/900] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Jul 21 08:14:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:10.653258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448920f4-d6a9-459a-b27b-8f0edb152629 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:10.739285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:10.817742 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448920f4-d6a9-459a-b27b-8f0edb152629 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:10.860882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825ab26-2d74-46b5-a3c0-0778e0f8c5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:10.862073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825ab26-2d74-46b5-a3c0-0778e0f8c5da None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:10.862557 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825ab26-2d74-46b5-a3c0-0778e0f8c5da None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:10.863022 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825ab26-2d74-46b5-a3c0-0778e0f8c5da None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:10.863957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825ab26-2d74-46b5-a3c0-0778e0f8c5da None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:10.864464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825ab26-2d74-46b5-a3c0-0778e0f8c5da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:10.866224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825ab26-2d74-46b5-a3c0-0778e0f8c5da None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:10.872967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 450/901] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 21 08:14:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:10.882242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5ea68-4d29-4e2d-9b7d-19789fa9fc64 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:10.998983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:11.090538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5ea68-4d29-4e2d-9b7d-19789fa9fc64 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:11.160431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c87b80-317d-496c-92ac-0d38578cd212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:11.161659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c87b80-317d-496c-92ac-0d38578cd212 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:11.162159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c87b80-317d-496c-92ac-0d38578cd212 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:11.162646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c87b80-317d-496c-92ac-0d38578cd212 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:11.164162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c87b80-317d-496c-92ac-0d38578cd212 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:11.164730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c87b80-317d-496c-92ac-0d38578cd212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:11.167376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c87b80-317d-496c-92ac-0d38578cd212 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:11.178190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 452/902] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 21 08:14:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:11.187556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825ab26-2d74-46b5-a3c0-0778e0f8c5da None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:11.348785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825ab26-2d74-46b5-a3c0-0778e0f8c5da None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:11.354934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:11.392730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bd963-d241-4f34-8b8e-5b8e2dfd4f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:11.393589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bd963-d241-4f34-8b8e-5b8e2dfd4f45 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:11.393865 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bd963-d241-4f34-8b8e-5b8e2dfd4f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:11.394135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bd963-d241-4f34-8b8e-5b8e2dfd4f45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:11.395321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bd963-d241-4f34-8b8e-5b8e2dfd4f45 None admin] RBAC: Adding query filter params (interface=public, service_id=26a444c6f23844ff8117d6b88988cab0, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:11.395630 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bd963-d241-4f34-8b8e-5b8e2dfd4f45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:11.397095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bd963-d241-4f34-8b8e-5b8e2dfd4f45 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:11.403644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 451/903] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 21 08:14:11 2022] GET /identity/v3/endpoints?service_id=26a444c6f23844ff8117d6b88988cab0&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:11.413649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c87b80-317d-496c-92ac-0d38578cd212 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:11.611143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c87b80-317d-496c-92ac-0d38578cd212 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:11.655651 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:11.677474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783ab91-6fbe-427b-8450-74373eec89ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:11.678558 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783ab91-6fbe-427b-8450-74373eec89ed None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:11.679040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783ab91-6fbe-427b-8450-74373eec89ed None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:11.679532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783ab91-6fbe-427b-8450-74373eec89ed None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:11.680461 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783ab91-6fbe-427b-8450-74373eec89ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:11.682145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783ab91-6fbe-427b-8450-74373eec89ed None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:11.696663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 453/904] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 21 08:14:11 2022] GET /identity/v3/services => generated 1268 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:14:11.736284 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6804d-155f-431e-8042-99e0994e7413 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:11.737191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6804d-155f-431e-8042-99e0994e7413 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:11.737495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6804d-155f-431e-8042-99e0994e7413 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:11.739321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 452/905] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:11.748905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481a4b-ab81-4709-bed2-7a04383e5265 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:11.749842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481a4b-ab81-4709-bed2-7a04383e5265 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:11.750588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481a4b-ab81-4709-bed2-7a04383e5265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:11.782414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-eb481a4b-ab81-4709-bed2-7a04383e5265 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:11.785119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eb481a4b-ab81-4709-bed2-7a04383e5265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:11.911808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 454/906] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:11.951981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6804d-155f-431e-8042-99e0994e7413 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:12.065406 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6804d-155f-431e-8042-99e0994e7413 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:12.103824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7931e2-d9c1-414c-bb2b-cdab2fb87240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:12.104758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7931e2-d9c1-414c-bb2b-cdab2fb87240 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:12.105035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7931e2-d9c1-414c-bb2b-cdab2fb87240 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:12.105302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7931e2-d9c1-414c-bb2b-cdab2fb87240 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:12.106017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7931e2-d9c1-414c-bb2b-cdab2fb87240 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:12.107424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7931e2-d9c1-414c-bb2b-cdab2fb87240 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-7f7931e2-d9c1-414c-bb2b-cdab2fb87240 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:12.120738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:12.121819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:12.122676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 453/907] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 21 08:14:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:12.130475 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb481a4b-ab81-4709-bed2-7a04383e5265 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:12.342781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb481a4b-ab81-4709-bed2-7a04383e5265 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:12.370271 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:12.415077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf5671-82c3-4abb-8d2e-39ce9ce3428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:12.416277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5671-82c3-4abb-8d2e-39ce9ce3428f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:12.416797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5671-82c3-4abb-8d2e-39ce9ce3428f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:12.417275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5671-82c3-4abb-8d2e-39ce9ce3428f None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:12.418631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf5671-82c3-4abb-8d2e-39ce9ce3428f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:12.419149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf5671-82c3-4abb-8d2e-39ce9ce3428f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:12.421844 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf5671-82c3-4abb-8d2e-39ce9ce3428f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:12.431932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 455/908] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 21 08:14:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:12.437950 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7931e2-d9c1-414c-bb2b-cdab2fb87240 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:12.476712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:12.594764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7931e2-d9c1-414c-bb2b-cdab2fb87240 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:12.662015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eabfb4-32eb-4599-a0e4-2077d1b7d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:12.663235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eabfb4-32eb-4599-a0e4-2077d1b7d909 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:12.663699 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eabfb4-32eb-4599-a0e4-2077d1b7d909 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:12.664179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eabfb4-32eb-4599-a0e4-2077d1b7d909 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:12.665619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eabfb4-32eb-4599-a0e4-2077d1b7d909 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:12.666140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eabfb4-32eb-4599-a0e4-2077d1b7d909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:12.668782 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eabfb4-32eb-4599-a0e4-2077d1b7d909 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:12.678442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 454/909] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 21 08:14:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:12.937549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b22556-6abc-4c20-8400-033d1291eca1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:12.938257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b22556-6abc-4c20-8400-033d1291eca1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:12.938795 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b22556-6abc-4c20-8400-033d1291eca1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:12.941177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 456/910] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:12.950333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaddd5-33da-42fb-bb3d-8f36d9524f47 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:12.950881 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaddd5-33da-42fb-bb3d-8f36d9524f47 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:12.951292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaddd5-33da-42fb-bb3d-8f36d9524f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:12.981685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5dcaddd5-33da-42fb-bb3d-8f36d9524f47 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:12.983775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5dcaddd5-33da-42fb-bb3d-8f36d9524f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:13.055374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab360c-8c22-4825-ab1d-66338d7a5283 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:13.056188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab360c-8c22-4825-ab1d-66338d7a5283 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:13.056719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab360c-8c22-4825-ab1d-66338d7a5283 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:13.061207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 457/911] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:13.073116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a1943-05b0-41ab-87a3-c559e840f84e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:13.073718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a1943-05b0-41ab-87a3-c559e840f84e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:13.074546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a1943-05b0-41ab-87a3-c559e840f84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:13.101790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a64a1943-05b0-41ab-87a3-c559e840f84e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:13.104279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a64a1943-05b0-41ab-87a3-c559e840f84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:13.128531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 455/912] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:13.163568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaddd5-33da-42fb-bb3d-8f36d9524f47 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:13.215910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 458/913] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:13.221284 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:13.265923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a1943-05b0-41ab-87a3-c559e840f84e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:13.367514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaddd5-33da-42fb-bb3d-8f36d9524f47 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:13.435306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e824fb6-23e3-4e38-8d30-7490dfe65101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:13.436962 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824fb6-23e3-4e38-8d30-7490dfe65101 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:13.437481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824fb6-23e3-4e38-8d30-7490dfe65101 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:13.438047 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824fb6-23e3-4e38-8d30-7490dfe65101 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:13.459761 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e824fb6-23e3-4e38-8d30-7490dfe65101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:14:13.469668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a1943-05b0-41ab-87a3-c559e840f84e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4e824fb6-23e3-4e38-8d30-7490dfe65101 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:14:13.476535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:13.478336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:13.479890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:13.479890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:13.479890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:13.479890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:13.479890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:14:13.479890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:14:13.479890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:14:13.479890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:14:13.479890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:14:13.479890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:14:13.479890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:14:13.479890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:13.488024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 456/914] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jul 21 08:14:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:13.492098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e824fb6-23e3-4e38-8d30-7490dfe65101 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:13.498842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:13.566563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bbd9f-df20-4d4f-a3a4-2884169ff2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:13.568176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bbd9f-df20-4d4f-a3a4-2884169ff2bc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:13.568766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bbd9f-df20-4d4f-a3a4-2884169ff2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:13.569324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bbd9f-df20-4d4f-a3a4-2884169ff2bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:13.570612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bbd9f-df20-4d4f-a3a4-2884169ff2bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:13.573462 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bbd9f-df20-4d4f-a3a4-2884169ff2bc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c98bbd9f-df20-4d4f-a3a4-2884169ff2bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:13.596511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:13.598492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:13.600391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 459/915] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:14:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:13.615827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bbd9f-df20-4d4f-a3a4-2884169ff2bc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:13.699163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:13.745588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e824fb6-23e3-4e38-8d30-7490dfe65101 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:13.770331 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bbd9f-df20-4d4f-a3a4-2884169ff2bc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:13.811220 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff780de-db6f-49e8-a100-98539f76ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:13.811448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d59c63-39dd-469e-ab3a-ad51826331d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:13.812276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d59c63-39dd-469e-ab3a-ad51826331d1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:13.812551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff780de-db6f-49e8-a100-98539f76ba4d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:13.812767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d59c63-39dd-469e-ab3a-ad51826331d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:13.813132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d59c63-39dd-469e-ab3a-ad51826331d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:13.813300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff780de-db6f-49e8-a100-98539f76ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:13.813706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff780de-db6f-49e8-a100-98539f76ba4d None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:13.814195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d59c63-39dd-469e-ab3a-ad51826331d1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:13.814679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d59c63-39dd-469e-ab3a-ad51826331d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:13.814947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff780de-db6f-49e8-a100-98539f76ba4d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:13.815455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff780de-db6f-49e8-a100-98539f76ba4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:13.816441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d59c63-39dd-469e-ab3a-ad51826331d1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:13.817204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff780de-db6f-49e8-a100-98539f76ba4d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:13.823702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 460/916] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:14:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:13.830034 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff780de-db6f-49e8-a100-98539f76ba4d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:13.839088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 457/917] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 21 08:14:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:13.840662 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d59c63-39dd-469e-ab3a-ad51826331d1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:13.892098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:13.975987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d59c63-39dd-469e-ab3a-ad51826331d1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:13.990050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff780de-db6f-49e8-a100-98539f76ba4d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:14.016228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7e113-9d55-49ff-83d0-deeaef5f4c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:14.017111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7e113-9d55-49ff-83d0-deeaef5f4c23 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:14.017422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7e113-9d55-49ff-83d0-deeaef5f4c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:14.018148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7e113-9d55-49ff-83d0-deeaef5f4c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:14.031976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7e113-9d55-49ff-83d0-deeaef5f4c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:14.032646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2546ba3-b167-45a2-b681-e58e2a845091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:14.033637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2546ba3-b167-45a2-b681-e58e2a845091 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:14.033746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7e113-9d55-49ff-83d0-deeaef5f4c23 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:14.034327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2546ba3-b167-45a2-b681-e58e2a845091 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:14.034858 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2546ba3-b167-45a2-b681-e58e2a845091 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:14.035998 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2546ba3-b167-45a2-b681-e58e2a845091 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:14.036564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2546ba3-b167-45a2-b681-e58e2a845091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:14.038554 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2546ba3-b167-45a2-b681-e58e2a845091 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:14.041318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:14.050953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 461/918] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 21 08:14:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:14.052059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2546ba3-b167-45a2-b681-e58e2a845091 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-78a7e113-9d55-49ff-83d0-deeaef5f4c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:14.059889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:14.060909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:14.061830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:14.061830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:14.061830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:14.061830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:14.064152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 458/919] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:14.072553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7e113-9d55-49ff-83d0-deeaef5f4c23 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:14.176260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:14.181545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2546ba3-b167-45a2-b681-e58e2a845091 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:14.200536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7e113-9d55-49ff-83d0-deeaef5f4c23 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:14.226317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdd456-f00f-46db-b8a9-43e96cfa3c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:14.227981 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdd456-f00f-46db-b8a9-43e96cfa3c6a None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:14.228741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdd456-f00f-46db-b8a9-43e96cfa3c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:14.229430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdd456-f00f-46db-b8a9-43e96cfa3c6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:14.231098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdd456-f00f-46db-b8a9-43e96cfa3c6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:14.234526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdd456-f00f-46db-b8a9-43e96cfa3c6a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:14.247033 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78654e9b-b9c3-46b3-b3f6-f956cab1cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:14.247757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78654e9b-b9c3-46b3-b3f6-f956cab1cdc3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:14.248036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78654e9b-b9c3-46b3-b3f6-f956cab1cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:14.248306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78654e9b-b9c3-46b3-b3f6-f956cab1cdc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:14.249503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78654e9b-b9c3-46b3-b3f6-f956cab1cdc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:14.249827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78654e9b-b9c3-46b3-b3f6-f956cab1cdc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:14.251573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78654e9b-b9c3-46b3-b3f6-f956cab1cdc3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:14.270212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 459/920] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:14.282132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78654e9b-b9c3-46b3-b3f6-f956cab1cdc3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:14.284431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 462/921] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 21 08:14:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:14:14.402419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:14.478382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78654e9b-b9c3-46b3-b3f6-f956cab1cdc3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:14.528564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b290-3af3-4632-898b-e67bce8f39e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:14.529309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b290-3af3-4632-898b-e67bce8f39e4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:14.529644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b290-3af3-4632-898b-e67bce8f39e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:14.529925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b290-3af3-4632-898b-e67bce8f39e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:14.539069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649b290-3af3-4632-898b-e67bce8f39e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:14.540737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649b290-3af3-4632-898b-e67bce8f39e4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3649b290-3af3-4632-898b-e67bce8f39e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:14:14.558594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:14.559818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:14.562016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:14.562016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:14.562016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:14:14.562016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:14:14.562016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:14:14.562016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:14:14.562016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:14:14.562016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:14:14.562016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:14:14.562016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:14.563152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 460/922] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 21 08:14:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:14.566957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b290-3af3-4632-898b-e67bce8f39e4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:14.567150 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220406-afa3-4be4-9dad-b55a9c9028cd None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:14.567746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220406-afa3-4be4-9dad-b55a9c9028cd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:14.567746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220406-afa3-4be4-9dad-b55a9c9028cd None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:14.581436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 463/923] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:14 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:14.589757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86758c6-bea7-4d05-b3ba-dd6ccf4054fe None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:14.590018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86758c6-bea7-4d05-b3ba-dd6ccf4054fe None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:14.590319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86758c6-bea7-4d05-b3ba-dd6ccf4054fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:14.633907 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a86758c6-bea7-4d05-b3ba-dd6ccf4054fe None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:14.636218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a86758c6-bea7-4d05-b3ba-dd6ccf4054fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:14.683386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b290-3af3-4632-898b-e67bce8f39e4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:14.699882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:14.722761 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862c809-a640-4105-be0d-99d8a9f71e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:14.723464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c809-a640-4105-be0d-99d8a9f71e08 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:14.723745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c809-a640-4105-be0d-99d8a9f71e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:14.724014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c809-a640-4105-be0d-99d8a9f71e08 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:14.724926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862c809-a640-4105-be0d-99d8a9f71e08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:14.725237 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862c809-a640-4105-be0d-99d8a9f71e08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:14.732822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862c809-a640-4105-be0d-99d8a9f71e08 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:14.733373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 464/924] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:14.748094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 461/925] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jul 21 08:14:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:14.754347 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86758c6-bea7-4d05-b3ba-dd6ccf4054fe None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:14.760383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862c809-a640-4105-be0d-99d8a9f71e08 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:14.910427 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:14.931346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86758c6-bea7-4d05-b3ba-dd6ccf4054fe None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:14.939118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862c809-a640-4105-be0d-99d8a9f71e08 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:14.976737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24767cdc-cc57-4fd0-84c6-e37b3d1fd066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:14.977569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24767cdc-cc57-4fd0-84c6-e37b3d1fd066 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:14.978004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24767cdc-cc57-4fd0-84c6-e37b3d1fd066 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:14.978181 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24767cdc-cc57-4fd0-84c6-e37b3d1fd066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:14.990578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24767cdc-cc57-4fd0-84c6-e37b3d1fd066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:14.992069 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24767cdc-cc57-4fd0-84c6-e37b3d1fd066 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:14.993715 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a517c7c-6700-4aa2-b7d4-d216a0736d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:14.995125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a517c7c-6700-4aa2-b7d4-d216a0736d2f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:14.995860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a517c7c-6700-4aa2-b7d4-d216a0736d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:14.996045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a517c7c-6700-4aa2-b7d4-d216a0736d2f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:14.997220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a517c7c-6700-4aa2-b7d4-d216a0736d2f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:14.999800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a517c7c-6700-4aa2-b7d4-d216a0736d2f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-24767cdc-cc57-4fd0-84c6-e37b3d1fd066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:15.013222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:15.015209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:15.016793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:15.016793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:15.016793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:15.016793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:15.016793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 465/926] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:15.016793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295d7d0-5461-467a-8472-0afc24ae5356 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:15.016793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295d7d0-5461-467a-8472-0afc24ae5356 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:15.018114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295d7d0-5461-467a-8472-0afc24ae5356 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:15.018854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 466/927] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:15.022064 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295d7d0-5461-467a-8472-0afc24ae5356 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2a517c7c-6700-4aa2-b7d4-d216a0736d2f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:15.026011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:15.027852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:15.029545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 462/928] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Jul 21 08:14:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:15.035250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd872b-f986-46b8-8e94-53e5fc3234b0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:15.036153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd872b-f986-46b8-8e94-53e5fc3234b0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:15.036659 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd872b-f986-46b8-8e94-53e5fc3234b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:15.067817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b2cd872b-f986-46b8-8e94-53e5fc3234b0 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:15.068728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b2cd872b-f986-46b8-8e94-53e5fc3234b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:15.116733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:15.185886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 463/929] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:15.190984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd872b-f986-46b8-8e94-53e5fc3234b0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:15.207131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295d7d0-5461-467a-8472-0afc24ae5356 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:15.271067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ba13f-04b4-4b6b-a21c-69629ec8a674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:15.271471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ba13f-04b4-4b6b-a21c-69629ec8a674 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:15.271824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ba13f-04b4-4b6b-a21c-69629ec8a674 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:15.272102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ba13f-04b4-4b6b-a21c-69629ec8a674 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:15.273173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ba13f-04b4-4b6b-a21c-69629ec8a674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:15.273703 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ba13f-04b4-4b6b-a21c-69629ec8a674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:15.275316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ba13f-04b4-4b6b-a21c-69629ec8a674 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:15.279450 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:15.300067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 467/930] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:15.300067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ba13f-04b4-4b6b-a21c-69629ec8a674 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:15.381549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd872b-f986-46b8-8e94-53e5fc3234b0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:15.435807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1401d4c-ae09-4fc9-8b89-4282ab6f1622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:15.436592 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1401d4c-ae09-4fc9-8b89-4282ab6f1622 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:15.436798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1401d4c-ae09-4fc9-8b89-4282ab6f1622 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:15.437738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1401d4c-ae09-4fc9-8b89-4282ab6f1622 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:15.437738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1401d4c-ae09-4fc9-8b89-4282ab6f1622 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:15.438116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1401d4c-ae09-4fc9-8b89-4282ab6f1622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:15.439596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1401d4c-ae09-4fc9-8b89-4282ab6f1622 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:15.453691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 464/931] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 21 08:14:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:15.453691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1401d4c-ae09-4fc9-8b89-4282ab6f1622 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:15.503492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ba13f-04b4-4b6b-a21c-69629ec8a674 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:15.509754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:15.576441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353b195-bb21-429c-99be-f2b81be283e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:15.578217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353b195-bb21-429c-99be-f2b81be283e0 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:15.578691 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353b195-bb21-429c-99be-f2b81be283e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:15.579166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353b195-bb21-429c-99be-f2b81be283e0 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:15.580579 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353b195-bb21-429c-99be-f2b81be283e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:15.583245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353b195-bb21-429c-99be-f2b81be283e0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:15.616531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 468/932] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:14:15 2022] POST /identity/v3/services => generated 241 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:14:15.616531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353b195-bb21-429c-99be-f2b81be283e0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:15.626259 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1401d4c-ae09-4fc9-8b89-4282ab6f1622 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:15.698092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:15.703669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1794ae6-8358-4d28-83f9-ae37da4ced8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:15.704928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1794ae6-8358-4d28-83f9-ae37da4ced8a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:15.705384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1794ae6-8358-4d28-83f9-ae37da4ced8a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:15.705664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1794ae6-8358-4d28-83f9-ae37da4ced8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:15.715512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1794ae6-8358-4d28-83f9-ae37da4ced8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:15.717457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1794ae6-8358-4d28-83f9-ae37da4ced8a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e1794ae6-8358-4d28-83f9-ae37da4ced8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:14:15.737224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:15.739117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:15.741346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:14:15.741346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:14:15.741346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:14:15.741346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:14:15.741346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:14:15.741346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:14:15.741346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:15.741346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:15.741346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 465/933] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:15.755067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1794ae6-8358-4d28-83f9-ae37da4ced8a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:15.762038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353b195-bb21-429c-99be-f2b81be283e0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:15.826819 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070bcc5-5716-467d-a4ca-191f40d98d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:15.828010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070bcc5-5716-467d-a4ca-191f40d98d5c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:15.828616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070bcc5-5716-467d-a4ca-191f40d98d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:15.829165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070bcc5-5716-467d-a4ca-191f40d98d5c None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:15.830693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070bcc5-5716-467d-a4ca-191f40d98d5c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:15.831216 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070bcc5-5716-467d-a4ca-191f40d98d5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:15.835288 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070bcc5-5716-467d-a4ca-191f40d98d5c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:15.843882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 469/934] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 21 08:14:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:15.855617 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070bcc5-5716-467d-a4ca-191f40d98d5c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:15.916053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:15.956841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1794ae6-8358-4d28-83f9-ae37da4ced8a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:16.027210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebfb3d-7b01-4b4b-8f45-9e32a756aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:16.029556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebfb3d-7b01-4b4b-8f45-9e32a756aaec None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:16.029993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebfb3d-7b01-4b4b-8f45-9e32a756aaec None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:16.030446 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebfb3d-7b01-4b4b-8f45-9e32a756aaec None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:16.032354 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebfb3d-7b01-4b4b-8f45-9e32a756aaec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:16.032897 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebfb3d-7b01-4b4b-8f45-9e32a756aaec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:16.034697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebfb3d-7b01-4b4b-8f45-9e32a756aaec None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:16.049970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 466/935] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:16.060575 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070bcc5-5716-467d-a4ca-191f40d98d5c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:16.061345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebfb3d-7b01-4b4b-8f45-9e32a756aaec None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:16.095520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:16.113162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04608d5-70d5-4eac-8875-65186760cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:16.114107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04608d5-70d5-4eac-8875-65186760cfa2 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:16.114478 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04608d5-70d5-4eac-8875-65186760cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:16.114848 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04608d5-70d5-4eac-8875-65186760cfa2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:16.115702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04608d5-70d5-4eac-8875-65186760cfa2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:16.117421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04608d5-70d5-4eac-8875-65186760cfa2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:16.144645 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 470/936] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 21 08:14:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:14:16.194244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebfb3d-7b01-4b4b-8f45-9e32a756aaec None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:16.245318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9547bb5-577e-49c3-a870-bd446dfaf455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:16.246674 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9547bb5-577e-49c3-a870-bd446dfaf455 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:16.247132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9547bb5-577e-49c3-a870-bd446dfaf455 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:16.247628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9547bb5-577e-49c3-a870-bd446dfaf455 None admin] PATH_INFO: `/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/06e0753ca5174046841396a304262d06/roles/a53fbfc77af04f2881bdc3124af55c4a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:16.250585 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9547bb5-577e-49c3-a870-bd446dfaf455 None admin] RBAC: Authorizing `identity:create_grant(project_id=c487ed72a15c45faa40f743ae752e48b, user_id=06e0753ca5174046841396a304262d06, role_id=a53fbfc77af04f2881bdc3124af55c4a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:16.254013 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9547bb5-577e-49c3-a870-bd446dfaf455 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:16.274791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 467/937] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:14:16 2022] PUT /identity/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/06e0753ca5174046841396a304262d06/roles/a53fbfc77af04f2881bdc3124af55c4a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:14:16.566700 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765f781-e7cd-4719-b446-1694fa923001 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:16.567119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765f781-e7cd-4719-b446-1694fa923001 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:16.567231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765f781-e7cd-4719-b446-1694fa923001 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:16.569141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 471/938] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:16.575284 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb511d0-aad5-48f8-8c76-bc6697c04ffa None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:16.575594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb511d0-aad5-48f8-8c76-bc6697c04ffa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:16.575845 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb511d0-aad5-48f8-8c76-bc6697c04ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:16.581418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:16.596574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1fb511d0-aad5-48f8-8c76-bc6697c04ffa None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:16.597829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1fb511d0-aad5-48f8-8c76-bc6697c04ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:16.705007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 468/939] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:16.729659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765f781-e7cd-4719-b446-1694fa923001 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:16.848945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765f781-e7cd-4719-b446-1694fa923001 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:16.889028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d12d2-867c-42a7-8ee9-677c08d323ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:16.890104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d12d2-867c-42a7-8ee9-677c08d323ee None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:16.890606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d12d2-867c-42a7-8ee9-677c08d323ee None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:16.891123 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d12d2-867c-42a7-8ee9-677c08d323ee None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:16.892065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d12d2-867c-42a7-8ee9-677c08d323ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:16.894783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d12d2-867c-42a7-8ee9-677c08d323ee None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:16.896548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: WARNING keystone.server.flask.common [None req-532d12d2-867c-42a7-8ee9-677c08d323ee None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 08:14:16.917401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.sql.core [None req-532d12d2-867c-42a7-8ee9-677c08d323ee None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 08:14:16.917401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 08:14:16.917401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [parameters: {'id': 'bb92d29496af46cb84fa02bbbb4b7590', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 08:14:16.917401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80223) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-532d12d2-867c-42a7-8ee9-677c08d323ee None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb92d29496af46cb84fa02bbbb4b7590.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb92d29496af46cb84fa02bbbb4b7590. Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:14:16.936775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application result.read() Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 08:14:16.937657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application yield resource Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise self.value Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application session.commit() Jul 21 08:14:16.938596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.session.flush() Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application compat.raise_( Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 08:14:16.939543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 08:14:16.941349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application result.read() Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:14:16.942145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [parameters: {'id': 'bb92d29496af46cb84fa02bbbb4b7590', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:16.943000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:16.943923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:16.946234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:16.946234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 08:14:16.946234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 08:14:16.946234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:16.946234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:16.946234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 08:14:16.946234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 08:14:16.946234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb92d29496af46cb84fa02bbbb4b7590. Jul 21 08:14:16.946234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:16.949439 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 472/940] 10.222.0.40 () {60 vars in 1140 bytes} [Thu Jul 21 08:14:16 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:16.956597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb511d0-aad5-48f8-8c76-bc6697c04ffa None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:17.067065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb511d0-aad5-48f8-8c76-bc6697c04ffa None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:17.103925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:17.109557 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067341a-c72b-44f6-99f0-c038dbbe5ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:17.110780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067341a-c72b-44f6-99f0-c038dbbe5ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:17.111257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067341a-c72b-44f6-99f0-c038dbbe5ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:17.111673 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067341a-c72b-44f6-99f0-c038dbbe5ed1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:17.120021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067341a-c72b-44f6-99f0-c038dbbe5ed1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:17.121571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067341a-c72b-44f6-99f0-c038dbbe5ed1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8067341a-c72b-44f6-99f0-c038dbbe5ed1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:14:17.137455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:17.138453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:17.139330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:14:17.139330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:14:17.139330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:14:17.139330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:14:17.139330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:14:17.139330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:14:17.139330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:17.139330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:17.139330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 469/941] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:17.148337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d12d2-867c-42a7-8ee9-677c08d323ee None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:17.194025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:17.321014 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d12d2-867c-42a7-8ee9-677c08d323ee None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:17.360101 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef00ace-5bad-4b7b-afe5-f95b0999886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:17.360714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef00ace-5bad-4b7b-afe5-f95b0999886c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:17.360993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef00ace-5bad-4b7b-afe5-f95b0999886c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:17.361332 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef00ace-5bad-4b7b-afe5-f95b0999886c None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:17.362145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef00ace-5bad-4b7b-afe5-f95b0999886c None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:17.362452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef00ace-5bad-4b7b-afe5-f95b0999886c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:17.364171 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef00ace-5bad-4b7b-afe5-f95b0999886c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:17.388037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 473/942] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:14:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:18.079480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc310ba-9dd8-4a9a-a719-f4fd8714c777 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:18.080116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc310ba-9dd8-4a9a-a719-f4fd8714c777 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:18.080116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc310ba-9dd8-4a9a-a719-f4fd8714c777 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:18.081867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 470/943] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:18.088039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9d815-6f5c-4950-9ce1-5e48305fbcf4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:18.088584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9d815-6f5c-4950-9ce1-5e48305fbcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:18.088692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9d815-6f5c-4950-9ce1-5e48305fbcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:18.107861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b7d9d815-6f5c-4950-9ce1-5e48305fbcf4 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:18.109554 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b7d9d815-6f5c-4950-9ce1-5e48305fbcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:18.222339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 474/944] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:18.245417 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc310ba-9dd8-4a9a-a719-f4fd8714c777 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:18.381326 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc310ba-9dd8-4a9a-a719-f4fd8714c777 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:18.421567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd728bd-0484-4d6c-b8e9-ec9cbd385c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:18.422426 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd728bd-0484-4d6c-b8e9-ec9cbd385c58 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:18.422699 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd728bd-0484-4d6c-b8e9-ec9cbd385c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:18.422980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd728bd-0484-4d6c-b8e9-ec9cbd385c58 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:18.423705 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd728bd-0484-4d6c-b8e9-ec9cbd385c58 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:18.425339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd728bd-0484-4d6c-b8e9-ec9cbd385c58 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0dd728bd-0484-4d6c-b8e9-ec9cbd385c58 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:18.438764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:18.440723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:18.442345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 471/945] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 21 08:14:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:18.448248 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9d815-6f5c-4950-9ce1-5e48305fbcf4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:18.477792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:18.597688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57ad45-111e-4f29-9345-afedee19f11f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:18.598176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57ad45-111e-4f29-9345-afedee19f11f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:18.598652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57ad45-111e-4f29-9345-afedee19f11f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:18.601678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 472/946] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:18.612943 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd922a45-a004-4e07-9a2e-ae09b47815d7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:18.613631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd922a45-a004-4e07-9a2e-ae09b47815d7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:18.614262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd922a45-a004-4e07-9a2e-ae09b47815d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:18.620153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9d815-6f5c-4950-9ce1-5e48305fbcf4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:18.647603 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bd922a45-a004-4e07-9a2e-ae09b47815d7 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:18.649912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bd922a45-a004-4e07-9a2e-ae09b47815d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:18.664077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994936f-e1b1-4bd0-96fe-58d344a72016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:18.665157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994936f-e1b1-4bd0-96fe-58d344a72016 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:18.665573 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994936f-e1b1-4bd0-96fe-58d344a72016 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:18.666082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994936f-e1b1-4bd0-96fe-58d344a72016 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:18.667105 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994936f-e1b1-4bd0-96fe-58d344a72016 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:18.667832 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994936f-e1b1-4bd0-96fe-58d344a72016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:18.669775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994936f-e1b1-4bd0-96fe-58d344a72016 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:18.680736 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 475/947] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 21 08:14:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:18.683436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994936f-e1b1-4bd0-96fe-58d344a72016 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:18.770922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:18.803430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:18.810435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 473/948] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:18.825706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994936f-e1b1-4bd0-96fe-58d344a72016 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:18.848381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd922a45-a004-4e07-9a2e-ae09b47815d7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:18.866440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ea7e-2129-4e63-81f9-66afd51dc5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:18.867433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ea7e-2129-4e63-81f9-66afd51dc5fd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:18.867859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ea7e-2129-4e63-81f9-66afd51dc5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:18.868271 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ea7e-2129-4e63-81f9-66afd51dc5fd None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:18.869174 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ea7e-2129-4e63-81f9-66afd51dc5fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:18.869636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ea7e-2129-4e63-81f9-66afd51dc5fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:18.871195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ea7e-2129-4e63-81f9-66afd51dc5fd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:18.882476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 476/949] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 21 08:14:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:18.884121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ea7e-2129-4e63-81f9-66afd51dc5fd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:18.997857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ea7e-2129-4e63-81f9-66afd51dc5fd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:19.038057 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984cde1-24bf-4e2d-94f7-101585b56b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:19.039036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984cde1-24bf-4e2d-94f7-101585b56b74 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:19.039477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984cde1-24bf-4e2d-94f7-101585b56b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:19.039895 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984cde1-24bf-4e2d-94f7-101585b56b74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:19.040908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984cde1-24bf-4e2d-94f7-101585b56b74 None admin] RBAC: Adding query filter params (interface=public, service_id=63ff69fd1c9c40e0ba67b736c5b2c84e, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:19.041405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984cde1-24bf-4e2d-94f7-101585b56b74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:19.042990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984cde1-24bf-4e2d-94f7-101585b56b74 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:19.048634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd922a45-a004-4e07-9a2e-ae09b47815d7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:19.054323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 477/950] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 21 08:14:18 2022] GET /identity/v3/endpoints?service_id=63ff69fd1c9c40e0ba67b736c5b2c84e&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:19.056027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984cde1-24bf-4e2d-94f7-101585b56b74 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:19.074194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:19.127485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863cdea-a756-4bb9-a4ac-12be47ed6835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:19.129187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863cdea-a756-4bb9-a4ac-12be47ed6835 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:19.129944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863cdea-a756-4bb9-a4ac-12be47ed6835 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:19.130905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863cdea-a756-4bb9-a4ac-12be47ed6835 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:19.132148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863cdea-a756-4bb9-a4ac-12be47ed6835 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:19.135335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863cdea-a756-4bb9-a4ac-12be47ed6835 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2863cdea-a756-4bb9-a4ac-12be47ed6835 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:19.161770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:19.162970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:14:19.163846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:19.172741 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 474/951] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:19.174646 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863cdea-a756-4bb9-a4ac-12be47ed6835 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:19.180927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984cde1-24bf-4e2d-94f7-101585b56b74 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:19.221812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48279506-3f35-493e-815a-7072f941c526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:19.222884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48279506-3f35-493e-815a-7072f941c526 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:19.223358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48279506-3f35-493e-815a-7072f941c526 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:19.223823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48279506-3f35-493e-815a-7072f941c526 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:19.224769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48279506-3f35-493e-815a-7072f941c526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:19.226501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48279506-3f35-493e-815a-7072f941c526 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:19.240652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 478/952] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 21 08:14:19 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:14:19.284310 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:19.322382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23c95-c032-45b4-acbc-b4018f45ba5b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:19.322669 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23c95-c032-45b4-acbc-b4018f45ba5b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:19.322925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23c95-c032-45b4-acbc-b4018f45ba5b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:19.324761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 479/953] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:19.331605 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448e656-5af9-4ae0-bb99-a86d10aff38f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:19.331882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448e656-5af9-4ae0-bb99-a86d10aff38f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:19.332244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448e656-5af9-4ae0-bb99-a86d10aff38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:19.358665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0448e656-5af9-4ae0-bb99-a86d10aff38f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:19.360672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0448e656-5af9-4ae0-bb99-a86d10aff38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:19.404371 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863cdea-a756-4bb9-a4ac-12be47ed6835 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:19.465662 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60b1b-beed-4e2f-ab66-89a9960d4327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:19.466766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60b1b-beed-4e2f-ab66-89a9960d4327 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:19.467055 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60b1b-beed-4e2f-ab66-89a9960d4327 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:19.467332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60b1b-beed-4e2f-ab66-89a9960d4327 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:19.468032 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b60b1b-beed-4e2f-ab66-89a9960d4327 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:19.468333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b60b1b-beed-4e2f-ab66-89a9960d4327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:19.469855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b60b1b-beed-4e2f-ab66-89a9960d4327 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:19.477972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 475/954] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:14:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:19.483651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60b1b-beed-4e2f-ab66-89a9960d4327 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:19.488398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 480/955] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:19.513204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448e656-5af9-4ae0-bb99-a86d10aff38f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:19.533727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:19.614674 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60b1b-beed-4e2f-ab66-89a9960d4327 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:19.633953 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:19.664404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31099698-4db1-40d8-bad6-8c9202c3d0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:19.665142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31099698-4db1-40d8-bad6-8c9202c3d0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:19.665421 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31099698-4db1-40d8-bad6-8c9202c3d0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:19.665696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31099698-4db1-40d8-bad6-8c9202c3d0a8 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:19.666452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31099698-4db1-40d8-bad6-8c9202c3d0a8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:19.666736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31099698-4db1-40d8-bad6-8c9202c3d0a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:19.668171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31099698-4db1-40d8-bad6-8c9202c3d0a8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:19.673508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448e656-5af9-4ae0-bb99-a86d10aff38f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:19.684749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 476/956] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:14:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:19.684749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43389a5-d544-442f-a967-16e448280558 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:19.684749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43389a5-d544-442f-a967-16e448280558 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:19.684749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43389a5-d544-442f-a967-16e448280558 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:19.684749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 477/957] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:19.691823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1094b2-e2b6-40f4-971e-ec5bf110c277 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:19.692726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1094b2-e2b6-40f4-971e-ec5bf110c277 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:19.693268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1094b2-e2b6-40f4-971e-ec5bf110c277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:19.729780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7c1094b2-e2b6-40f4-971e-ec5bf110c277 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:19.731126 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7c1094b2-e2b6-40f4-971e-ec5bf110c277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:19.737892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ead50b-53f9-439d-92d4-0c0fd6bbb923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:19.739388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ead50b-53f9-439d-92d4-0c0fd6bbb923 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:19.739882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ead50b-53f9-439d-92d4-0c0fd6bbb923 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:19.740465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ead50b-53f9-439d-92d4-0c0fd6bbb923 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:19.767224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ead50b-53f9-439d-92d4-0c0fd6bbb923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-92ead50b-53f9-439d-92d4-0c0fd6bbb923 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:14:19.792601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:19.793637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:19.794474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:19.794474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:19.794474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:19.794474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:19.794474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:14:19.794474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:14:19.794474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:14:19.794474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:14:19.794474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:14:19.794474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:14:19.794474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:14:19.794474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:19.796418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 481/958] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jul 21 08:14:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:19.804295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ead50b-53f9-439d-92d4-0c0fd6bbb923 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:19.860368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 478/959] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:19.902821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1094b2-e2b6-40f4-971e-ec5bf110c277 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:19.916994 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:20.002867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ead50b-53f9-439d-92d4-0c0fd6bbb923 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:20.056325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0f33f-883c-4c6a-a6cd-148a4f406c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:20.057460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0f33f-883c-4c6a-a6cd-148a4f406c10 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:20.057980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0f33f-883c-4c6a-a6cd-148a4f406c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:20.058515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0f33f-883c-4c6a-a6cd-148a4f406c10 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:20.059509 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0f33f-883c-4c6a-a6cd-148a4f406c10 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:20.060097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0f33f-883c-4c6a-a6cd-148a4f406c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:20.061802 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0f33f-883c-4c6a-a6cd-148a4f406c10 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:20.071822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1094b2-e2b6-40f4-971e-ec5bf110c277 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:20.080945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 482/960] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 21 08:14:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:20.083647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0f33f-883c-4c6a-a6cd-148a4f406c10 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:20.083851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:20.120011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e5958-9040-4c3e-877d-7383e5df9d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:20.120828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e5958-9040-4c3e-877d-7383e5df9d06 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:20.121108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e5958-9040-4c3e-877d-7383e5df9d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:20.121379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e5958-9040-4c3e-877d-7383e5df9d06 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:20.122177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e5958-9040-4c3e-877d-7383e5df9d06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:20.124670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e5958-9040-4c3e-877d-7383e5df9d06 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:20.126377 dv-cinder-850318-4-smb devstack@keystone.service[80224]: WARNING keystone.server.flask.common [None req-502e5958-9040-4c3e-877d-7383e5df9d06 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 08:14:20.142575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.sql.core [None req-502e5958-9040-4c3e-877d-7383e5df9d06 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 08:14:20.142575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 08:14:20.142575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [parameters: {'user_id': '74c5410bf5a2453298bdadef023454e0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 08:14:20.142575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80224) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-502e5958-9040-4c3e-877d-7383e5df9d06 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 21 08:14:20.151138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:14:20.152174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application yield resource Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise self.value Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application session.commit() Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 08:14:20.153911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.flush() Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application compat.raise_( Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 08:14:20.155191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:14:20.156819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:14:20.158825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [parameters: {'user_id': '74c5410bf5a2453298bdadef023454e0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:20.161114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 08:14:20.164791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 08:14:20.168954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 08:14:20.168954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 08:14:20.168954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 08:14:20.168954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 08:14:20.168954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 08:14:20.168954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:20.168954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 479/961] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 21 08:14:19 2022] POST /identity/v3/users => generated 160 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:20.168954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e5958-9040-4c3e-877d-7383e5df9d06 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:20.280083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0f33f-883c-4c6a-a6cd-148a4f406c10 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:20.322053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:20.326352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e5958-9040-4c3e-877d-7383e5df9d06 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:20.330182 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e87b4-c331-452f-9e3d-725e59336382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:20.331693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e87b4-c331-452f-9e3d-725e59336382 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:20.332258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e87b4-c331-452f-9e3d-725e59336382 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:20.332917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e87b4-c331-452f-9e3d-725e59336382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:20.352896 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e87b4-c331-452f-9e3d-725e59336382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:20.356318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e87b4-c331-452f-9e3d-725e59336382 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:20.371434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d11ab-277b-4c7c-ab34-bd64780f18eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:20.372365 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d11ab-277b-4c7c-ab34-bd64780f18eb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:20.372956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d11ab-277b-4c7c-ab34-bd64780f18eb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:20.374075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d11ab-277b-4c7c-ab34-bd64780f18eb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:20.384688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d11ab-277b-4c7c-ab34-bd64780f18eb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:20.386418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d11ab-277b-4c7c-ab34-bd64780f18eb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-da1e87b4-c331-452f-9e3d-725e59336382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:20.393159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:20.395251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:20.397968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:20.397968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:20.397968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:20.397968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:20.401555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 483/962] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-204d11ab-277b-4c7c-ab34-bd64780f18eb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:14:20.408632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:20.409729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:20.410717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:20.410717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:20.410717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:14:20.410717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:14:20.410717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:14:20.410717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:14:20.410717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:14:20.410717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:14:20.410717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:14:20.410717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:20.411297 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 480/963] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:14:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:20.413183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e87b4-c331-452f-9e3d-725e59336382 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:20.417278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d11ab-277b-4c7c-ab34-bd64780f18eb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:20.452820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:20.554186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d11ab-277b-4c7c-ab34-bd64780f18eb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:20.594483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e87b4-c331-452f-9e3d-725e59336382 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:20.612336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fc884-3896-403d-ae6c-a0b96743cfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:20.613756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fc884-3896-403d-ae6c-a0b96743cfee None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:20.614287 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fc884-3896-403d-ae6c-a0b96743cfee None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:20.615711 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fc884-3896-403d-ae6c-a0b96743cfee None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:20.617165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fc884-3896-403d-ae6c-a0b96743cfee None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:20.617665 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fc884-3896-403d-ae6c-a0b96743cfee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:20.619691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fc884-3896-403d-ae6c-a0b96743cfee None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:20.644683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23921c-bdb8-4838-b2a1-1b5a387adc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:20.645545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23921c-bdb8-4838-b2a1-1b5a387adc90 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:20.645955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23921c-bdb8-4838-b2a1-1b5a387adc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:20.646469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23921c-bdb8-4838-b2a1-1b5a387adc90 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:20.647620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23921c-bdb8-4838-b2a1-1b5a387adc90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:20.648003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23921c-bdb8-4838-b2a1-1b5a387adc90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:20.650447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23921c-bdb8-4838-b2a1-1b5a387adc90 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:20.671837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 484/964] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:20.673238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23921c-bdb8-4838-b2a1-1b5a387adc90 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:20.684688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 481/965] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 21 08:14:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:20.728407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:20.810932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23921c-bdb8-4838-b2a1-1b5a387adc90 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:20.854831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbec91-dc45-40ad-8f82-0eff8f82b909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:20.855977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbec91-dc45-40ad-8f82-0eff8f82b909 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:20.856461 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbec91-dc45-40ad-8f82-0eff8f82b909 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:20.856915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbec91-dc45-40ad-8f82-0eff8f82b909 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:20.866710 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbec91-dc45-40ad-8f82-0eff8f82b909 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:20.868573 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbec91-dc45-40ad-8f82-0eff8f82b909 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-febbec91-dc45-40ad-8f82-0eff8f82b909 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:14:20.886488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:20.895200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:20.899147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:20.899147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:20.899147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:14:20.899147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:14:20.899147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:14:20.899147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:14:20.899147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:14:20.899147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:14:20.899147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:14:20.899147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:20.899147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 485/966] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 21 08:14:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:20.911406 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fc884-3896-403d-ae6c-a0b96743cfee None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:21.034407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:21.058451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fc884-3896-403d-ae6c-a0b96743cfee None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:21.133740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2e39b-6d5b-4b45-8c37-0b9366de336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:21.134942 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2e39b-6d5b-4b45-8c37-0b9366de336e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:21.135445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2e39b-6d5b-4b45-8c37-0b9366de336e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:21.135937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2e39b-6d5b-4b45-8c37-0b9366de336e None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:21.137686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2e39b-6d5b-4b45-8c37-0b9366de336e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:21.138244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2e39b-6d5b-4b45-8c37-0b9366de336e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:21.141047 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2e39b-6d5b-4b45-8c37-0b9366de336e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:21.181739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 482/967] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jul 21 08:14:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:21.190971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbec91-dc45-40ad-8f82-0eff8f82b909 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:21.388019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbec91-dc45-40ad-8f82-0eff8f82b909 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:21.392160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:21.462051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beb718-fc1c-4efd-8736-66b4910bd792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:21.463006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb718-fc1c-4efd-8736-66b4910bd792 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:21.463299 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb718-fc1c-4efd-8736-66b4910bd792 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:21.463582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb718-fc1c-4efd-8736-66b4910bd792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:21.529791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd76336-bb5d-469b-929d-274ee431f5a1 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:21.530067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd76336-bb5d-469b-929d-274ee431f5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:21.530409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd76336-bb5d-469b-929d-274ee431f5a1 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:21.532016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 483/968] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:14:21.537732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bc896-ca6b-46b2-ad62-9ead96429584 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:21.538012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bc896-ca6b-46b2-ad62-9ead96429584 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:21.538316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bc896-ca6b-46b2-ad62-9ead96429584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:21.562984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d84bc896-ca6b-46b2-ad62-9ead96429584 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:21.565908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d84bc896-ca6b-46b2-ad62-9ead96429584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:21.600470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48beb718-fc1c-4efd-8736-66b4910bd792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:21.602709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48beb718-fc1c-4efd-8736-66b4910bd792 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:21.678624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 484/969] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:21.720525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bc896-ca6b-46b2-ad62-9ead96429584 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:21.742639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 486/970] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:14:21 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:14:21.744042 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beb718-fc1c-4efd-8736-66b4910bd792 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:21.747018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:21.859833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:21.908159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bc896-ca6b-46b2-ad62-9ead96429584 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:21.910011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beb718-fc1c-4efd-8736-66b4910bd792 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:21.963689 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a644498-98c6-4096-8163-1cfae6769b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:21.965481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a644498-98c6-4096-8163-1cfae6769b31 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:21.965935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a644498-98c6-4096-8163-1cfae6769b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:21.966563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a644498-98c6-4096-8163-1cfae6769b31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:21.977745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91062a-ef37-4af5-a1c1-2e20ca068a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:21.979001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91062a-ef37-4af5-a1c1-2e20ca068a38 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:21.979642 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91062a-ef37-4af5-a1c1-2e20ca068a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:21.980306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91062a-ef37-4af5-a1c1-2e20ca068a38 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:21.981723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91062a-ef37-4af5-a1c1-2e20ca068a38 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:21.983846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91062a-ef37-4af5-a1c1-2e20ca068a38 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:21.985884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a644498-98c6-4096-8163-1cfae6769b31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:21.988340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a644498-98c6-4096-8163-1cfae6769b31 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ae91062a-ef37-4af5-a1c1-2e20ca068a38 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:22.008412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:22.009540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:22.010419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:22.011316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 485/971] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 21 08:14:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:14:22.017284 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91062a-ef37-4af5-a1c1-2e20ca068a38 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9a644498-98c6-4096-8163-1cfae6769b31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:22.019676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:22.021305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:22.022969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:22.022969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:22.022969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:22.022969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:22.024918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 487/972] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:22.029281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a644498-98c6-4096-8163-1cfae6769b31 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:22.098158 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:22.149962 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a644498-98c6-4096-8163-1cfae6769b31 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:22.184436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91062a-ef37-4af5-a1c1-2e20ca068a38 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:22.186652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e853f-950a-41a6-b825-76d4b789f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:22.187342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e853f-950a-41a6-b825-76d4b789f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:22.187624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e853f-950a-41a6-b825-76d4b789f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:22.187900 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e853f-950a-41a6-b825-76d4b789f9e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:22.188687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e853f-950a-41a6-b825-76d4b789f9e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:22.188998 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e853f-950a-41a6-b825-76d4b789f9e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:22.190522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e853f-950a-41a6-b825-76d4b789f9e8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:22.203340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 488/973] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:22.204889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ebb09-2266-4bd7-84e1-6930b8b83edd None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:22.205182 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ebb09-2266-4bd7-84e1-6930b8b83edd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:22.205457 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ebb09-2266-4bd7-84e1-6930b8b83edd None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:22.208806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 489/974] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:22.209576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ebb09-2266-4bd7-84e1-6930b8b83edd None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:22.244890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f9d01-9cc5-4c00-be91-c5eab6056fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:22.245797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f9d01-9cc5-4c00-be91-c5eab6056fea None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:22.246265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f9d01-9cc5-4c00-be91-c5eab6056fea None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:22.246720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f9d01-9cc5-4c00-be91-c5eab6056fea None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:22.248022 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f9d01-9cc5-4c00-be91-c5eab6056fea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:22.248580 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f9d01-9cc5-4c00-be91-c5eab6056fea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:22.250753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f9d01-9cc5-4c00-be91-c5eab6056fea None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:22.266010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 486/975] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 21 08:14:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:22.266010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe025d-f88f-4baa-877f-45e63dca5d48 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:22.266010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe025d-f88f-4baa-877f-45e63dca5d48 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:22.266010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe025d-f88f-4baa-877f-45e63dca5d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:22.270343 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:22.287315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4cfe025d-f88f-4baa-877f-45e63dca5d48 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:22.288849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4cfe025d-f88f-4baa-877f-45e63dca5d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:22.336975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ebb09-2266-4bd7-84e1-6930b8b83edd None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:22.357104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:22.378445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 487/976] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:22.379741 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe025d-f88f-4baa-877f-45e63dca5d48 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:22.395867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856e91f-5963-47d6-b3fc-aaa2449812fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:22.396810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856e91f-5963-47d6-b3fc-aaa2449812fd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:22.397113 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856e91f-5963-47d6-b3fc-aaa2449812fd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:22.397434 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856e91f-5963-47d6-b3fc-aaa2449812fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:22.405732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856e91f-5963-47d6-b3fc-aaa2449812fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:22.407164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856e91f-5963-47d6-b3fc-aaa2449812fd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e856e91f-5963-47d6-b3fc-aaa2449812fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:14:22.424442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:22.425782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:22.427649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:14:22.427649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:14:22.427649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:14:22.427649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:14:22.427649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:14:22.427649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:14:22.427649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:22.427649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:22.427649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 490/977] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:22.427649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856e91f-5963-47d6-b3fc-aaa2449812fd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:22.508795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe025d-f88f-4baa-877f-45e63dca5d48 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:22.551354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856e91f-5963-47d6-b3fc-aaa2449812fd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:22.553326 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250695c3-3b45-43ad-a0c6-14adc81a6359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:22.554036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250695c3-3b45-43ad-a0c6-14adc81a6359 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:22.554323 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250695c3-3b45-43ad-a0c6-14adc81a6359 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:22.554597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250695c3-3b45-43ad-a0c6-14adc81a6359 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:22.555330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250695c3-3b45-43ad-a0c6-14adc81a6359 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:22.555636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250695c3-3b45-43ad-a0c6-14adc81a6359 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:22.557130 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250695c3-3b45-43ad-a0c6-14adc81a6359 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:22.558846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:22.571528 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 488/978] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 21 08:14:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:22.572884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250695c3-3b45-43ad-a0c6-14adc81a6359 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:22.594981 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c197aa-78c8-46fe-a729-e4000827f6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:22.596197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c197aa-78c8-46fe-a729-e4000827f6c5 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:22.596740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c197aa-78c8-46fe-a729-e4000827f6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:22.597223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c197aa-78c8-46fe-a729-e4000827f6c5 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:22.598597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c197aa-78c8-46fe-a729-e4000827f6c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:22.601270 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c197aa-78c8-46fe-a729-e4000827f6c5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:22.620447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 491/979] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:14:22 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:14:22.621334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c197aa-78c8-46fe-a729-e4000827f6c5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:22.669083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:22.740722 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250695c3-3b45-43ad-a0c6-14adc81a6359 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:22.783329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c197aa-78c8-46fe-a729-e4000827f6c5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:22.807071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf9615-596b-4d5f-b5bd-59bcca3ed085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:22.808294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf9615-596b-4d5f-b5bd-59bcca3ed085 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:22.809033 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf9615-596b-4d5f-b5bd-59bcca3ed085 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:22.809555 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf9615-596b-4d5f-b5bd-59bcca3ed085 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:22.811142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf9615-596b-4d5f-b5bd-59bcca3ed085 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:22.812061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf9615-596b-4d5f-b5bd-59bcca3ed085 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:22.814086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf9615-596b-4d5f-b5bd-59bcca3ed085 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:22.831527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f57c7-9de2-4145-bad9-c20862665b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:22.832343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f57c7-9de2-4145-bad9-c20862665b45 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:22.832718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f57c7-9de2-4145-bad9-c20862665b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:22.833067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f57c7-9de2-4145-bad9-c20862665b45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:22.834355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f57c7-9de2-4145-bad9-c20862665b45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:22.836527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f57c7-9de2-4145-bad9-c20862665b45 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:22.838889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 489/980] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:22.846285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf9615-596b-4d5f-b5bd-59bcca3ed085 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:22.872796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 492/981] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 21 08:14:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:14:22.937345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:22.994054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf9615-596b-4d5f-b5bd-59bcca3ed085 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:23.047841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96d572-ca0e-47d8-b4d3-137377f2468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:23.048589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d572-ca0e-47d8-b4d3-137377f2468c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:23.048876 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d572-ca0e-47d8-b4d3-137377f2468c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:23.049165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d572-ca0e-47d8-b4d3-137377f2468c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:23.050025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96d572-ca0e-47d8-b4d3-137377f2468c None admin] RBAC: Adding query filter params (role.id=a53fbfc77af04f2881bdc3124af55c4a, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=06e0753ca5174046841396a304262d06) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:23.050336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96d572-ca0e-47d8-b4d3-137377f2468c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:23.051894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96d572-ca0e-47d8-b4d3-137377f2468c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:23.059966 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 490/982] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:14:22 2022] GET /identity/v3/role_assignments?user.id=06e0753ca5174046841396a304262d06&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=a53fbfc77af04f2881bdc3124af55c4a => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:25.029238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d16cb-5853-442e-a324-929de825389f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:25.029797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d16cb-5853-442e-a324-929de825389f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:25.030202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d16cb-5853-442e-a324-929de825389f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:25.032874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 493/983] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:25.039339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517168af-a443-4740-b947-ebad7d2044bf None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:25.040127 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517168af-a443-4740-b947-ebad7d2044bf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:25.040127 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517168af-a443-4740-b947-ebad7d2044bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:25.059858 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-517168af-a443-4740-b947-ebad7d2044bf None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:25.061136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-517168af-a443-4740-b947-ebad7d2044bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:25.152171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 491/984] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:25.175875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d16cb-5853-442e-a324-929de825389f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:25.206191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338f4f2-5f29-4765-bd38-acfea562a992 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:25.206872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338f4f2-5f29-4765-bd38-acfea562a992 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:25.207388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338f4f2-5f29-4765-bd38-acfea562a992 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:25.209135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 492/985] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:14:25.215894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5f2dd-fc75-4965-811d-b3d82a765b5d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:25.216448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5f2dd-fc75-4965-811d-b3d82a765b5d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:25.216797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5f2dd-fc75-4965-811d-b3d82a765b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:25.235929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-faf5f2dd-fc75-4965-811d-b3d82a765b5d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:25.237219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-faf5f2dd-fc75-4965-811d-b3d82a765b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:25.294406 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:25.310764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:25.331082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d16cb-5853-442e-a324-929de825389f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:25.344708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 493/986] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:25.368519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5f2dd-fc75-4965-811d-b3d82a765b5d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:25.375668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a60dc-a7b5-4992-804e-d123f6e93b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:25.376536 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a60dc-a7b5-4992-804e-d123f6e93b70 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:25.376881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a60dc-a7b5-4992-804e-d123f6e93b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:25.377155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a60dc-a7b5-4992-804e-d123f6e93b70 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:25.377827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a60dc-a7b5-4992-804e-d123f6e93b70 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:25.379263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a60dc-a7b5-4992-804e-d123f6e93b70 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-cf5a60dc-a7b5-4992-804e-d123f6e93b70 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:25.392417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:25.393557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:25.394760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:25.399466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 494/987] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 21 08:14:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:25.400750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a60dc-a7b5-4992-804e-d123f6e93b70 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:25.540293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5f2dd-fc75-4965-811d-b3d82a765b5d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:25.544630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a60dc-a7b5-4992-804e-d123f6e93b70 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:25.586529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7b99a-2575-460b-a171-9584bb3155b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:25.587365 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7b99a-2575-460b-a171-9584bb3155b0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:25.587632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7b99a-2575-460b-a171-9584bb3155b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:25.587899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7b99a-2575-460b-a171-9584bb3155b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:25.588625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7b99a-2575-460b-a171-9584bb3155b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:25.590070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7b99a-2575-460b-a171-9584bb3155b0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-dbe7b99a-2575-460b-a171-9584bb3155b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:25.602877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:25.604873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:25.606565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 494/988] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Jul 21 08:14:25 2022] GET /identity/v3/services/image => generated 86 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:25.614077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7b99a-2575-460b-a171-9584bb3155b0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:25.615490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f0f35-2a46-4b11-b4d8-030cc30f4ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:25.616184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f0f35-2a46-4b11-b4d8-030cc30f4ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:25.616450 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f0f35-2a46-4b11-b4d8-030cc30f4ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:25.616760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f0f35-2a46-4b11-b4d8-030cc30f4ed3 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:25.617485 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f0f35-2a46-4b11-b4d8-030cc30f4ed3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:25.617787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f0f35-2a46-4b11-b4d8-030cc30f4ed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:25.619229 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f0f35-2a46-4b11-b4d8-030cc30f4ed3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:25.631669 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 495/989] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 21 08:14:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:25.633023 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f0f35-2a46-4b11-b4d8-030cc30f4ed3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:25.655275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:25.698978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:25.798920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7b99a-2575-460b-a171-9584bb3155b0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:25.822045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f0f35-2a46-4b11-b4d8-030cc30f4ed3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:25.860256 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48a5f6-b5d5-449b-8111-7e02d8ed70f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:25.861488 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a5f6-b5d5-449b-8111-7e02d8ed70f7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:25.861988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a5f6-b5d5-449b-8111-7e02d8ed70f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:25.862445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a5f6-b5d5-449b-8111-7e02d8ed70f7 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:25.863657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48a5f6-b5d5-449b-8111-7e02d8ed70f7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:25.864174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48a5f6-b5d5-449b-8111-7e02d8ed70f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:25.866858 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48a5f6-b5d5-449b-8111-7e02d8ed70f7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:25.875891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 495/990] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:25.883107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48a5f6-b5d5-449b-8111-7e02d8ed70f7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:25.889856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61b86c-5c4a-48cf-af95-ace62444e049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:25.891266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61b86c-5c4a-48cf-af95-ace62444e049 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:25.891976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61b86c-5c4a-48cf-af95-ace62444e049 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:25.892719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61b86c-5c4a-48cf-af95-ace62444e049 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:25.895203 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61b86c-5c4a-48cf-af95-ace62444e049 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:25.896001 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61b86c-5c4a-48cf-af95-ace62444e049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:25.899536 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61b86c-5c4a-48cf-af95-ace62444e049 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:25.908595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 496/991] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 21 08:14:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:25.911366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f4299-431f-4ba5-92b8-320b0958ebd4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:25.911868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f4299-431f-4ba5-92b8-320b0958ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:25.912355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f4299-431f-4ba5-92b8-320b0958ebd4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:25.916542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 497/992] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:25.916542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f4299-431f-4ba5-92b8-320b0958ebd4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:26.022004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48a5f6-b5d5-449b-8111-7e02d8ed70f7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:26.029690 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:26.034904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:26.069044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f4299-431f-4ba5-92b8-320b0958ebd4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:26.080597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f2504-dc45-4aa9-88f1-83a396d76ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:26.081648 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f2504-dc45-4aa9-88f1-83a396d76ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:26.081995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f2504-dc45-4aa9-88f1-83a396d76ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:26.082369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f2504-dc45-4aa9-88f1-83a396d76ed5 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:26.083206 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f2504-dc45-4aa9-88f1-83a396d76ed5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:26.083676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f2504-dc45-4aa9-88f1-83a396d76ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:26.085314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f2504-dc45-4aa9-88f1-83a396d76ed5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:26.091205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 496/993] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:26.092621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33748895-5122-4591-be3a-b7088ec2a5fd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:26.092913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33748895-5122-4591-be3a-b7088ec2a5fd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:26.093196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33748895-5122-4591-be3a-b7088ec2a5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:26.123029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-33748895-5122-4591-be3a-b7088ec2a5fd None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:26.125080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-33748895-5122-4591-be3a-b7088ec2a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:26.126269 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45f630-41ab-474d-8e75-0d8a03c8ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:26.127277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45f630-41ab-474d-8e75-0d8a03c8ecd7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:26.127726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45f630-41ab-474d-8e75-0d8a03c8ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:26.128133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45f630-41ab-474d-8e75-0d8a03c8ecd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:26.129532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45f630-41ab-474d-8e75-0d8a03c8ecd7 None admin] RBAC: Adding query filter params (interface=admin, service_id=63ff69fd1c9c40e0ba67b736c5b2c84e, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:26.131367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45f630-41ab-474d-8e75-0d8a03c8ecd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:26.132668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45f630-41ab-474d-8e75-0d8a03c8ecd7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:26.145863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 498/994] 10.222.0.40 () {56 vars in 1249 bytes} [Thu Jul 21 08:14:25 2022] GET /identity/v3/endpoints?service_id=63ff69fd1c9c40e0ba67b736c5b2c84e&interface=admin®ion_id=RegionOne => generated 193 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:26.147366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45f630-41ab-474d-8e75-0d8a03c8ecd7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:26.258293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 497/995] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:26.299687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33748895-5122-4591-be3a-b7088ec2a5fd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:26.337828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45f630-41ab-474d-8e75-0d8a03c8ecd7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:26.381584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e56f90-6124-4a58-bb62-b3938e6cb21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:26.382278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e56f90-6124-4a58-bb62-b3938e6cb21b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:26.382560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e56f90-6124-4a58-bb62-b3938e6cb21b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:26.382833 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e56f90-6124-4a58-bb62-b3938e6cb21b None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:26.383537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e56f90-6124-4a58-bb62-b3938e6cb21b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:26.385018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e56f90-6124-4a58-bb62-b3938e6cb21b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:26.392550 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 499/996] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 21 08:14:26 2022] GET /identity/v3/services => generated 1727 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:14:26.488753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:26.495127 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33748895-5122-4591-be3a-b7088ec2a5fd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:26.569156 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d402af-2414-42fd-9099-4a18444fb509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:26.570577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d402af-2414-42fd-9099-4a18444fb509 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:26.571042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d402af-2414-42fd-9099-4a18444fb509 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:26.571529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d402af-2414-42fd-9099-4a18444fb509 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:26.572814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d402af-2414-42fd-9099-4a18444fb509 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:26.575346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d402af-2414-42fd-9099-4a18444fb509 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c0d402af-2414-42fd-9099-4a18444fb509 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:26.598410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:26.599529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:14:26.601042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:26.601855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 498/997] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:14:26.610854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e56f90-6124-4a58-bb62-b3938e6cb21b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:26.624217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:26.822319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e56f90-6124-4a58-bb62-b3938e6cb21b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:26.895986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3691627-e764-47e2-8afc-84341d03df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:26.897141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3691627-e764-47e2-8afc-84341d03df38 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:26.897633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3691627-e764-47e2-8afc-84341d03df38 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:26.898107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3691627-e764-47e2-8afc-84341d03df38 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:26.899496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3691627-e764-47e2-8afc-84341d03df38 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:26.900020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3691627-e764-47e2-8afc-84341d03df38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:26.902692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3691627-e764-47e2-8afc-84341d03df38 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:26.920764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 500/998] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:14:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:26.922579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d402af-2414-42fd-9099-4a18444fb509 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:27.130875 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d402af-2414-42fd-9099-4a18444fb509 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:27.200439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81e747-5606-4d7f-bf8d-b5ac6d7dac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:27.201537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81e747-5606-4d7f-bf8d-b5ac6d7dac85 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:27.202044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81e747-5606-4d7f-bf8d-b5ac6d7dac85 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:27.202525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81e747-5606-4d7f-bf8d-b5ac6d7dac85 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:27.203925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81e747-5606-4d7f-bf8d-b5ac6d7dac85 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:27.204542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81e747-5606-4d7f-bf8d-b5ac6d7dac85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:27.207255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81e747-5606-4d7f-bf8d-b5ac6d7dac85 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:27.217819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 499/999] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:14:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:27.227443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3691627-e764-47e2-8afc-84341d03df38 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:27.366655 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:27.434468 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3691627-e764-47e2-8afc-84341d03df38 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:27.496840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108df26-d3d3-460a-af80-27fbaec72893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:27.498005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108df26-d3d3-460a-af80-27fbaec72893 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:27.498508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108df26-d3d3-460a-af80-27fbaec72893 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:27.499013 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108df26-d3d3-460a-af80-27fbaec72893 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:27.500642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108df26-d3d3-460a-af80-27fbaec72893 None admin] RBAC: Adding query filter params (interface=public, service_id=f4751baab49a4f508761568f5aacaf75, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:27.501218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108df26-d3d3-460a-af80-27fbaec72893 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:27.503984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108df26-d3d3-460a-af80-27fbaec72893 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:27.520572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 501/1000] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 21 08:14:27 2022] GET /identity/v3/endpoints?service_id=f4751baab49a4f508761568f5aacaf75&interface=public®ion_id=RegionOne => generated 194 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:27.525682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81e747-5606-4d7f-bf8d-b5ac6d7dac85 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:27.585841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:27.724183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81e747-5606-4d7f-bf8d-b5ac6d7dac85 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:27.766139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ac86a-3575-4d0d-ab61-8b96c42c1ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:27.766705 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ac86a-3575-4d0d-ab61-8b96c42c1ffc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:27.767037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ac86a-3575-4d0d-ab61-8b96c42c1ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:27.767388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ac86a-3575-4d0d-ab61-8b96c42c1ffc None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:27.768082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ac86a-3575-4d0d-ab61-8b96c42c1ffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:27.769901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ac86a-3575-4d0d-ab61-8b96c42c1ffc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:27.777597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 500/1001] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 21 08:14:27 2022] GET /identity/v3/services => generated 1727 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:14:28.472149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe07f0-7571-44b0-9784-89a175a00105 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:28.473038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe07f0-7571-44b0-9784-89a175a00105 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:28.473038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe07f0-7571-44b0-9784-89a175a00105 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:28.474582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 502/1002] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:14:28.480388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e082258-0938-466a-b3b8-197715780b10 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:28.481268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e082258-0938-466a-b3b8-197715780b10 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:28.481268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e082258-0938-466a-b3b8-197715780b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:28.499473 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5e082258-0938-466a-b3b8-197715780b10 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:28.500728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5e082258-0938-466a-b3b8-197715780b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:28.584838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 501/1003] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:28.608070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe07f0-7571-44b0-9784-89a175a00105 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:28.696639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a74e14-3712-43d4-b419-55af58739e31 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:28.697164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a74e14-3712-43d4-b419-55af58739e31 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:28.697164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a74e14-3712-43d4-b419-55af58739e31 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:28.698771 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 502/1004] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:14:28.704510 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369eaa8-c54a-4ce3-a7fe-347f889a3581 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:28.704888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369eaa8-c54a-4ce3-a7fe-347f889a3581 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:28.705166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369eaa8-c54a-4ce3-a7fe-347f889a3581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:28.724556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2369eaa8-c54a-4ce3-a7fe-347f889a3581 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:28.725793 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2369eaa8-c54a-4ce3-a7fe-347f889a3581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:28.745432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:28.781012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe07f0-7571-44b0-9784-89a175a00105 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:28.816973 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 503/1005] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:28.831273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd02db5-f0af-49e0-b02b-48c93f97cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:28.832107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd02db5-f0af-49e0-b02b-48c93f97cde7 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:28.832657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd02db5-f0af-49e0-b02b-48c93f97cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:28.833193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd02db5-f0af-49e0-b02b-48c93f97cde7 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:28.834470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd02db5-f0af-49e0-b02b-48c93f97cde7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:28.836395 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd02db5-f0af-49e0-b02b-48c93f97cde7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:28.837694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369eaa8-c54a-4ce3-a7fe-347f889a3581 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:28.839359 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:28.854487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 503/1006] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:14:28 2022] POST /identity/v3/services => generated 242 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:14:29.029982 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369eaa8-c54a-4ce3-a7fe-347f889a3581 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:29.114062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af8297-ed0a-41e7-964f-be1dc056a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:29.116071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8297-ed0a-41e7-964f-be1dc056a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:29.116922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8297-ed0a-41e7-964f-be1dc056a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:29.117721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8297-ed0a-41e7-964f-be1dc056a9f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:29.119376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af8297-ed0a-41e7-964f-be1dc056a9f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:29.122563 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af8297-ed0a-41e7-964f-be1dc056a9f8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d6af8297-ed0a-41e7-964f-be1dc056a9f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:29.148922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:29.150908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:14:29.152685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:29.157805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 504/1007] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 21 08:14:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:29.166307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd02db5-f0af-49e0-b02b-48c93f97cde7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:29.381839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd02db5-f0af-49e0-b02b-48c93f97cde7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:29.449696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1182d8-4147-4a4d-8ff3-3d7bbecae258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:29.450954 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1182d8-4147-4a4d-8ff3-3d7bbecae258 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:29.451450 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1182d8-4147-4a4d-8ff3-3d7bbecae258 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:29.452068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1182d8-4147-4a4d-8ff3-3d7bbecae258 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:29.453513 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1182d8-4147-4a4d-8ff3-3d7bbecae258 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:29.454061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1182d8-4147-4a4d-8ff3-3d7bbecae258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:29.457035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1182d8-4147-4a4d-8ff3-3d7bbecae258 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:29.472839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 504/1008] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 21 08:14:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:29.477468 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af8297-ed0a-41e7-964f-be1dc056a9f8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:29.505207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:29.694645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af8297-ed0a-41e7-964f-be1dc056a9f8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:29.758456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fd062-bfba-4e95-a51f-ba389f890629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:29.759166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fd062-bfba-4e95-a51f-ba389f890629 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:29.759451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fd062-bfba-4e95-a51f-ba389f890629 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:29.759720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fd062-bfba-4e95-a51f-ba389f890629 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:29.760434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fd062-bfba-4e95-a51f-ba389f890629 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:29.760773 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fd062-bfba-4e95-a51f-ba389f890629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:29.762214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fd062-bfba-4e95-a51f-ba389f890629 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:29.768831 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 505/1009] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 21 08:14:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:29.775911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1182d8-4147-4a4d-8ff3-3d7bbecae258 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:29.865613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:29.926661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1182d8-4147-4a4d-8ff3-3d7bbecae258 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:29.938238 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d82739-295c-42bc-ab5d-9939120bdc69 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:29.938668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d82739-295c-42bc-ab5d-9939120bdc69 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:29.938842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d82739-295c-42bc-ab5d-9939120bdc69 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:29.940541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 506/1010] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:14:29.946387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d9391-94e4-4e2a-8842-68744d57bda6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:29.946656 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d9391-94e4-4e2a-8842-68744d57bda6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:29.946830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d9391-94e4-4e2a-8842-68744d57bda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:29.964977 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dc5d9391-94e4-4e2a-8842-68744d57bda6 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:29.966216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dc5d9391-94e4-4e2a-8842-68744d57bda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:29.974757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77105e-70e9-4c4f-8106-0b065cef9e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:29.976165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77105e-70e9-4c4f-8106-0b065cef9e4a None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:29.976439 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77105e-70e9-4c4f-8106-0b065cef9e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:29.976754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77105e-70e9-4c4f-8106-0b065cef9e4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:29.978057 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77105e-70e9-4c4f-8106-0b065cef9e4a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:29.979971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77105e-70e9-4c4f-8106-0b065cef9e4a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:30.004015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 505/1011] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 21 08:14:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:14:30.096222 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 507/1012] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:29 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:30.121066 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77105e-70e9-4c4f-8106-0b065cef9e4a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:30.297859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77105e-70e9-4c4f-8106-0b065cef9e4a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:30.326342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:30.351868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff559-6981-4722-8cdd-275f84afbdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:30.352935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff559-6981-4722-8cdd-275f84afbdfc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:30.353360 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff559-6981-4722-8cdd-275f84afbdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:30.353773 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff559-6981-4722-8cdd-275f84afbdfc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:30.354593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ff559-6981-4722-8cdd-275f84afbdfc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:30.356175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ff559-6981-4722-8cdd-275f84afbdfc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ed4ff559-6981-4722-8cdd-275f84afbdfc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:30.372253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:30.374383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:30.375969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 506/1013] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:30.385375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d9391-94e4-4e2a-8842-68744d57bda6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:30.387943 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:30.510405 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d9391-94e4-4e2a-8842-68744d57bda6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:30.555478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72073ed-dd1a-4d87-93dc-d0d289658487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:30.556064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72073ed-dd1a-4d87-93dc-d0d289658487 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:30.556687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72073ed-dd1a-4d87-93dc-d0d289658487 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:30.556687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72073ed-dd1a-4d87-93dc-d0d289658487 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:30.557388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72073ed-dd1a-4d87-93dc-d0d289658487 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:30.557751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72073ed-dd1a-4d87-93dc-d0d289658487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:30.559385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72073ed-dd1a-4d87-93dc-d0d289658487 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:30.568993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 508/1014] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:14:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:30.575988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff559-6981-4722-8cdd-275f84afbdfc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:30.708233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff559-6981-4722-8cdd-275f84afbdfc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:30.750516 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55bcee-435b-4a73-9ff6-e7fbc8b170e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:30.751213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55bcee-435b-4a73-9ff6-e7fbc8b170e0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:30.751563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55bcee-435b-4a73-9ff6-e7fbc8b170e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:30.751842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55bcee-435b-4a73-9ff6-e7fbc8b170e0 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:30.752620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55bcee-435b-4a73-9ff6-e7fbc8b170e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:30.752934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55bcee-435b-4a73-9ff6-e7fbc8b170e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:30.754387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55bcee-435b-4a73-9ff6-e7fbc8b170e0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:30.760781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 507/1015] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 21 08:14:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:30.767727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72073ed-dd1a-4d87-93dc-d0d289658487 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:30.890490 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:30.948409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72073ed-dd1a-4d87-93dc-d0d289658487 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:30.991747 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a509-879e-4f97-9552-6fa4980026c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:30.992432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a509-879e-4f97-9552-6fa4980026c4 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:30.992745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a509-879e-4f97-9552-6fa4980026c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:30.993021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a509-879e-4f97-9552-6fa4980026c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:30.993787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a509-879e-4f97-9552-6fa4980026c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:30.995211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a509-879e-4f97-9552-6fa4980026c4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:31.021180 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 509/1016] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 21 08:14:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:14:31.296664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013292fd-27be-45c8-a7e3-1e0fc422333f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:31.296991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013292fd-27be-45c8-a7e3-1e0fc422333f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:31.297267 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013292fd-27be-45c8-a7e3-1e0fc422333f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:31.299092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 508/1017] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:31.305028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf226c-a704-44ce-bd66-f56d42dc4072 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:31.305313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf226c-a704-44ce-bd66-f56d42dc4072 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:31.305597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf226c-a704-44ce-bd66-f56d42dc4072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:31.328793 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-94bf226c-a704-44ce-bd66-f56d42dc4072 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:31.330789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-94bf226c-a704-44ce-bd66-f56d42dc4072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:31.473517 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 510/1018] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:31.496406 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013292fd-27be-45c8-a7e3-1e0fc422333f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:31.586708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:31.697878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013292fd-27be-45c8-a7e3-1e0fc422333f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:31.766172 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fa0aa-45da-48da-ad62-9c8fcb3ad1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:31.767774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fa0aa-45da-48da-ad62-9c8fcb3ad1dd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:31.768270 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fa0aa-45da-48da-ad62-9c8fcb3ad1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:31.768792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fa0aa-45da-48da-ad62-9c8fcb3ad1dd None admin] PATH_INFO: `/v3/services/image` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:31.770368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fa0aa-45da-48da-ad62-9c8fcb3ad1dd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:31.773095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fa0aa-45da-48da-ad62-9c8fcb3ad1dd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8b0fa0aa-45da-48da-ad62-9c8fcb3ad1dd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:31.796027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:31.797206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:14:31.798049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:31.798840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 509/1019] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Jul 21 08:14:31 2022] GET /identity/v3/services/image => generated 86 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:31.808171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf226c-a704-44ce-bd66-f56d42dc4072 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:31.910153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:32.022042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf226c-a704-44ce-bd66-f56d42dc4072 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:32.091409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381140c-a87c-45a5-b8ca-4c965180926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:32.092604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381140c-a87c-45a5-b8ca-4c965180926b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:32.093092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381140c-a87c-45a5-b8ca-4c965180926b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:32.093569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381140c-a87c-45a5-b8ca-4c965180926b None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:32.094897 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381140c-a87c-45a5-b8ca-4c965180926b None admin] RBAC: Adding query filter params (name=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:32.095599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381140c-a87c-45a5-b8ca-4c965180926b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:32.098358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381140c-a87c-45a5-b8ca-4c965180926b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:32.116538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 511/1020] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:32.118644 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fa0aa-45da-48da-ad62-9c8fcb3ad1dd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:32.251862 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fa0aa-45da-48da-ad62-9c8fcb3ad1dd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:32.265676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:32.304956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0aace-09db-415e-9f29-1e5e9867753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:32.305664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0aace-09db-415e-9f29-1e5e9867753d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:32.305942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0aace-09db-415e-9f29-1e5e9867753d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:32.306215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0aace-09db-415e-9f29-1e5e9867753d None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:32.306971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0aace-09db-415e-9f29-1e5e9867753d None admin] RBAC: Adding query filter params (type=image) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:32.307459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0aace-09db-415e-9f29-1e5e9867753d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:32.308779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0aace-09db-415e-9f29-1e5e9867753d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:32.322542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 510/1021] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:32.329878 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381140c-a87c-45a5-b8ca-4c965180926b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:32.442090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e299637-37dc-49ef-bc01-bd0bde67b2fa None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:32.442718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e299637-37dc-49ef-bc01-bd0bde67b2fa None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:32.443318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e299637-37dc-49ef-bc01-bd0bde67b2fa None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:32.446425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 511/1022] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:32.455031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326e5f7-0beb-4677-acab-fa29f08ed1d4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:32.455523 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326e5f7-0beb-4677-acab-fa29f08ed1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:32.455995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326e5f7-0beb-4677-acab-fa29f08ed1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:32.484239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9326e5f7-0beb-4677-acab-fa29f08ed1d4 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:32.486194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9326e5f7-0beb-4677-acab-fa29f08ed1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:32.530124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381140c-a87c-45a5-b8ca-4c965180926b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:32.558176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:32.577191 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 512/1023] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:32.601047 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3a4ac-8fd6-4fe6-aa7c-3cf26581d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:32.601782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326e5f7-0beb-4677-acab-fa29f08ed1d4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:32.602240 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3a4ac-8fd6-4fe6-aa7c-3cf26581d725 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:32.602667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3a4ac-8fd6-4fe6-aa7c-3cf26581d725 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:32.603142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3a4ac-8fd6-4fe6-aa7c-3cf26581d725 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:32.604751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3a4ac-8fd6-4fe6-aa7c-3cf26581d725 None admin] RBAC: Adding query filter params (interface=public, service_id=986ea6d51bb443ccb7ee11e447f65dbf, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:32.605325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3a4ac-8fd6-4fe6-aa7c-3cf26581d725 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:32.607982 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3a4ac-8fd6-4fe6-aa7c-3cf26581d725 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:32.617776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 512/1024] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 21 08:14:32 2022] GET /identity/v3/endpoints?service_id=986ea6d51bb443ccb7ee11e447f65dbf&interface=public®ion_id=RegionOne => generated 194 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:32.624666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3a4ac-8fd6-4fe6-aa7c-3cf26581d725 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:32.796327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326e5f7-0beb-4677-acab-fa29f08ed1d4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:32.802090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:32.833069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3a4ac-8fd6-4fe6-aa7c-3cf26581d725 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:32.865933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389c738-825d-465f-a3a2-5c2158040108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:32.867314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389c738-825d-465f-a3a2-5c2158040108 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:32.867780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389c738-825d-465f-a3a2-5c2158040108 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:32.868243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389c738-825d-465f-a3a2-5c2158040108 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:32.870562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389c738-825d-465f-a3a2-5c2158040108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:32.873483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389c738-825d-465f-a3a2-5c2158040108 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:32.876849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 513/1025] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:32.883764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389c738-825d-465f-a3a2-5c2158040108 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:32.904109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5560420-15fa-4382-84ff-734a1552d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:32.905283 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560420-15fa-4382-84ff-734a1552d88e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:32.905756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560420-15fa-4382-84ff-734a1552d88e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:32.906209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560420-15fa-4382-84ff-734a1552d88e None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:32.907494 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5560420-15fa-4382-84ff-734a1552d88e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:32.910200 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5560420-15fa-4382-84ff-734a1552d88e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:32.932544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 513/1026] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 21 08:14:32 2022] GET /identity/v3/services => generated 1957 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:14:33.078734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389c738-825d-465f-a3a2-5c2158040108 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:33.155571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ad160-5f2e-43ad-af6e-dfe1bf35f48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:33.156718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ad160-5f2e-43ad-af6e-dfe1bf35f48f None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:33.157202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ad160-5f2e-43ad-af6e-dfe1bf35f48f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:33.157678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ad160-5f2e-43ad-af6e-dfe1bf35f48f None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:33.158985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ad160-5f2e-43ad-af6e-dfe1bf35f48f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:33.161557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ad160-5f2e-43ad-af6e-dfe1bf35f48f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:33.211733 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 514/1027] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:14:32 2022] POST /identity/v3/projects => generated 311 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:14:33.464786 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc466e-5792-4616-8b9d-d32f60e05308 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:33.465188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc466e-5792-4616-8b9d-d32f60e05308 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:33.465813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc466e-5792-4616-8b9d-d32f60e05308 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:33.468011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 514/1028] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:33.476399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f279f-c7e5-4e00-942b-06d007305bc4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:33.476879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f279f-c7e5-4e00-942b-06d007305bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:33.477292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f279f-c7e5-4e00-942b-06d007305bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:33.507137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c20f279f-c7e5-4e00-942b-06d007305bc4 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:33.509324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c20f279f-c7e5-4e00-942b-06d007305bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:33.547246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:33.651404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 515/1029] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:33.676440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc466e-5792-4616-8b9d-d32f60e05308 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:33.755979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:33.876789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc466e-5792-4616-8b9d-d32f60e05308 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:33.934187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30425-1488-4e98-ad24-1f6c0c70fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:33.935069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30425-1488-4e98-ad24-1f6c0c70fe31 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:33.935388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30425-1488-4e98-ad24-1f6c0c70fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:33.935673 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30425-1488-4e98-ad24-1f6c0c70fe31 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:33.949217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef30425-1488-4e98-ad24-1f6c0c70fe31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-aef30425-1488-4e98-ad24-1f6c0c70fe31 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:14:33.957838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:33.959828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:33.961652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 515/1030] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jul 21 08:14:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:33.973996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f279f-c7e5-4e00-942b-06d007305bc4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:34.175896 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f279f-c7e5-4e00-942b-06d007305bc4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:34.244602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbab8b-66ca-4bc8-93d1-10b987a282a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:34.245745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbab8b-66ca-4bc8-93d1-10b987a282a6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:34.246246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbab8b-66ca-4bc8-93d1-10b987a282a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:34.246742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbab8b-66ca-4bc8-93d1-10b987a282a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:34.248212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbab8b-66ca-4bc8-93d1-10b987a282a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:34.248821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbab8b-66ca-4bc8-93d1-10b987a282a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:34.251498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbab8b-66ca-4bc8-93d1-10b987a282a6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:34.276355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 516/1031] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 21 08:14:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:34.278738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30425-1488-4e98-ad24-1f6c0c70fe31 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:34.447920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:34.452563 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30425-1488-4e98-ad24-1f6c0c70fe31 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:34.498038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8d128-537c-4d23-94af-138d0577dcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:34.498876 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d128-537c-4d23-94af-138d0577dcbe None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:34.499143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d128-537c-4d23-94af-138d0577dcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:34.499415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d128-537c-4d23-94af-138d0577dcbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:34.513209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8d128-537c-4d23-94af-138d0577dcbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:34.514699 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8d128-537c-4d23-94af-138d0577dcbe None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-86e8d128-537c-4d23-94af-138d0577dcbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:34.534679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:34.544855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:34.549655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:34.549655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:34.549655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:34.549655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:34.549655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 516/1032] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:34.550338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbab8b-66ca-4bc8-93d1-10b987a282a6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:34.588435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:34.707927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbab8b-66ca-4bc8-93d1-10b987a282a6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:34.751696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faae6fb-bd1f-4a33-a371-2b95842fe86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:34.752444 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faae6fb-bd1f-4a33-a371-2b95842fe86d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:34.752842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faae6fb-bd1f-4a33-a371-2b95842fe86d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:34.753062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faae6fb-bd1f-4a33-a371-2b95842fe86d None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:34.753859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faae6fb-bd1f-4a33-a371-2b95842fe86d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:34.754191 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faae6fb-bd1f-4a33-a371-2b95842fe86d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:34.755760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faae6fb-bd1f-4a33-a371-2b95842fe86d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:34.771878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 517/1033] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:34.778306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8d128-537c-4d23-94af-138d0577dcbe None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:34.972995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8d128-537c-4d23-94af-138d0577dcbe None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:35.038314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815d730-a012-4dac-9655-355fa12144c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:35.039698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815d730-a012-4dac-9655-355fa12144c0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:35.040209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815d730-a012-4dac-9655-355fa12144c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:35.040768 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815d730-a012-4dac-9655-355fa12144c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:35.055597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815d730-a012-4dac-9655-355fa12144c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:35.058519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815d730-a012-4dac-9655-355fa12144c0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4815d730-a012-4dac-9655-355fa12144c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:14:35.088358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:35.090023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:35.098285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:35.098285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:35.098285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:14:35.098285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:14:35.098285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:14:35.098285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:14:35.098285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:14:35.098285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:14:35.098285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:14:35.098285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:35.098285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 517/1034] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 21 08:14:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:14:35.104250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faae6fb-bd1f-4a33-a371-2b95842fe86d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:35.271068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:35.331184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faae6fb-bd1f-4a33-a371-2b95842fe86d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:35.403518 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ce5bd-d255-4375-a2a7-76be8739ccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:35.404703 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ce5bd-d255-4375-a2a7-76be8739ccde None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:35.405184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ce5bd-d255-4375-a2a7-76be8739ccde None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:35.405655 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ce5bd-d255-4375-a2a7-76be8739ccde None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:35.407269 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ce5bd-d255-4375-a2a7-76be8739ccde None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:35.407810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ce5bd-d255-4375-a2a7-76be8739ccde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:35.410597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ce5bd-d255-4375-a2a7-76be8739ccde None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:35.452394 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 518/1035] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 21 08:14:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:35.458267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815d730-a012-4dac-9655-355fa12144c0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:35.488614 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:35.667553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815d730-a012-4dac-9655-355fa12144c0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:35.684713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82a7b3-d513-43f8-bcdc-dc5c16452803 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:35.685128 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82a7b3-d513-43f8-bcdc-dc5c16452803 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:35.685262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82a7b3-d513-43f8-bcdc-dc5c16452803 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:35.687012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 519/1036] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:14:35.692949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61982e9-55df-456f-ad6d-673e958b22a6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:35.693248 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61982e9-55df-456f-ad6d-673e958b22a6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:35.693527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61982e9-55df-456f-ad6d-673e958b22a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:35.717235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a61982e9-55df-456f-ad6d-673e958b22a6 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:35.719044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a61982e9-55df-456f-ad6d-673e958b22a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:35.724847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d104da6-86de-4875-a78a-633a70c7da5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:35.725924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d104da6-86de-4875-a78a-633a70c7da5e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:35.726397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d104da6-86de-4875-a78a-633a70c7da5e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:35.726887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d104da6-86de-4875-a78a-633a70c7da5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:35.809328 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 520/1037] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:35.810745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d364-b15b-4324-8020-e3e4f0bdc19d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:35.811040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d364-b15b-4324-8020-e3e4f0bdc19d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:35.811291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d364-b15b-4324-8020-e3e4f0bdc19d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:35.812959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 521/1038] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:35.818706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055da85e-b192-40fc-a164-7522434f63a5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:35.819146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055da85e-b192-40fc-a164-7522434f63a5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:35.819349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055da85e-b192-40fc-a164-7522434f63a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:35.819641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d104da6-86de-4875-a78a-633a70c7da5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:35.822430 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d104da6-86de-4875-a78a-633a70c7da5e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:35.841248 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-055da85e-b192-40fc-a164-7522434f63a5 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:35.842682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-055da85e-b192-40fc-a164-7522434f63a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:35.847622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:35.922851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:35.936406 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 522/1039] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:35.937354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055da85e-b192-40fc-a164-7522434f63a5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:35.960778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 518/1040] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:14:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:14:35.963016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d104da6-86de-4875-a78a-633a70c7da5e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:36.080995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055da85e-b192-40fc-a164-7522434f63a5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:36.088117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d104da6-86de-4875-a78a-633a70c7da5e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:36.103851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:36.131175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655e88b-b692-479f-8e24-d0fdb0e762e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:36.132008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655e88b-b692-479f-8e24-d0fdb0e762e5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:36.132532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655e88b-b692-479f-8e24-d0fdb0e762e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:36.132836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655e88b-b692-479f-8e24-d0fdb0e762e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:36.135957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760674f6-8cf0-4fd8-9e21-7fe22f0b5f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:36.137449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760674f6-8cf0-4fd8-9e21-7fe22f0b5f86 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:36.137995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760674f6-8cf0-4fd8-9e21-7fe22f0b5f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:36.138485 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760674f6-8cf0-4fd8-9e21-7fe22f0b5f86 None admin] PATH_INFO: `/v3/services/image` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:36.139864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760674f6-8cf0-4fd8-9e21-7fe22f0b5f86 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:36.142940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760674f6-8cf0-4fd8-9e21-7fe22f0b5f86 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:36.146180 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655e88b-b692-479f-8e24-d0fdb0e762e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:36.147693 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655e88b-b692-479f-8e24-d0fdb0e762e5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-760674f6-8cf0-4fd8-9e21-7fe22f0b5f86 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:36.166031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:36.167566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:14:36.173231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2655e88b-b692-479f-8e24-d0fdb0e762e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:36.174027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:36.174817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:36.176216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:36.176216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:36.176216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:36.176216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:36.176216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 519/1041] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:36.176725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 523/1042] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Jul 21 08:14:35 2022] GET /identity/v3/services/image => generated 86 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:36.176899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655e88b-b692-479f-8e24-d0fdb0e762e5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:36.178046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760674f6-8cf0-4fd8-9e21-7fe22f0b5f86 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:36.277392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:36.323051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655e88b-b692-479f-8e24-d0fdb0e762e5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:36.334615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760674f6-8cf0-4fd8-9e21-7fe22f0b5f86 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:36.373002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75958e-be36-46ba-a770-a9dbd9d8ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:36.373695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75958e-be36-46ba-a770-a9dbd9d8ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:36.373981 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75958e-be36-46ba-a770-a9dbd9d8ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:36.374381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75958e-be36-46ba-a770-a9dbd9d8ceb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:36.375268 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75958e-be36-46ba-a770-a9dbd9d8ceb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:36.375560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75958e-be36-46ba-a770-a9dbd9d8ceb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:36.377113 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75958e-be36-46ba-a770-a9dbd9d8ceb6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:36.378954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562202e0-c07d-4a84-8069-e969db0c413b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:36.379995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562202e0-c07d-4a84-8069-e969db0c413b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:36.380579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562202e0-c07d-4a84-8069-e969db0c413b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:36.380928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562202e0-c07d-4a84-8069-e969db0c413b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:36.382372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562202e0-c07d-4a84-8069-e969db0c413b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:36.383975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562202e0-c07d-4a84-8069-e969db0c413b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:36.386328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 520/1043] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:36.387293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562202e0-c07d-4a84-8069-e969db0c413b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:36.397007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 524/1044] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:36.397936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75958e-be36-46ba-a770-a9dbd9d8ceb6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:36.431510 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:36.520145 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562202e0-c07d-4a84-8069-e969db0c413b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:36.528549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75958e-be36-46ba-a770-a9dbd9d8ceb6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:36.549025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:36.577581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175a390-73cf-48fe-9c67-d5fb6de24af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:36.578335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175a390-73cf-48fe-9c67-d5fb6de24af0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:36.578623 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175a390-73cf-48fe-9c67-d5fb6de24af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:36.578900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175a390-73cf-48fe-9c67-d5fb6de24af0 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:36.579056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6b242-9da2-48d2-b621-bab38c848ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:36.579703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175a390-73cf-48fe-9c67-d5fb6de24af0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:36.580051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175a390-73cf-48fe-9c67-d5fb6de24af0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:36.580189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6b242-9da2-48d2-b621-bab38c848ecf None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:36.580762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6b242-9da2-48d2-b621-bab38c848ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:36.581307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6b242-9da2-48d2-b621-bab38c848ecf None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:36.581602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175a390-73cf-48fe-9c67-d5fb6de24af0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:36.582781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6b242-9da2-48d2-b621-bab38c848ecf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:36.585750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6b242-9da2-48d2-b621-bab38c848ecf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:36.588303 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 521/1045] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:36.589241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175a390-73cf-48fe-9c67-d5fb6de24af0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:36.616590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 525/1046] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:14:36 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:14:36.617644 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6b242-9da2-48d2-b621-bab38c848ecf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:36.766924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:36.781158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175a390-73cf-48fe-9c67-d5fb6de24af0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:36.792961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6b242-9da2-48d2-b621-bab38c848ecf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:36.841197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04f20a-af96-45cd-9dde-c338191f359b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:36.842066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04f20a-af96-45cd-9dde-c338191f359b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:36.842378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04f20a-af96-45cd-9dde-c338191f359b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:36.842638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04f20a-af96-45cd-9dde-c338191f359b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:36.852761 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04f20a-af96-45cd-9dde-c338191f359b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:36.854515 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04f20a-af96-45cd-9dde-c338191f359b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2b04f20a-af96-45cd-9dde-c338191f359b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:14:36.872564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:36.874372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:36.876175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:14:36.876175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:14:36.876175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:14:36.876175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:14:36.876175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:14:36.876175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:14:36.876175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:36.876175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:36.876175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 522/1047] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:36.880211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04f20a-af96-45cd-9dde-c338191f359b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:36.883287 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134c35e-2895-47f0-960c-49c81e9f7e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:36.884329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134c35e-2895-47f0-960c-49c81e9f7e46 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:36.884866 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134c35e-2895-47f0-960c-49c81e9f7e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:36.886361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134c35e-2895-47f0-960c-49c81e9f7e46 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:36.887626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134c35e-2895-47f0-960c-49c81e9f7e46 None admin] RBAC: Adding query filter params (type=image) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:36.888040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134c35e-2895-47f0-960c-49c81e9f7e46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:36.891595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134c35e-2895-47f0-960c-49c81e9f7e46 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:36.903386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 526/1048] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:36.912534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134c35e-2895-47f0-960c-49c81e9f7e46 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:36.986740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:37.076303 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04f20a-af96-45cd-9dde-c338191f359b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:37.120832 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134c35e-2895-47f0-960c-49c81e9f7e46 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:37.135482 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5a7bf-b5ab-4eea-89b3-b65a315525c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:37.136613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5a7bf-b5ab-4eea-89b3-b65a315525c2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:37.137079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5a7bf-b5ab-4eea-89b3-b65a315525c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:37.137467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5a7bf-b5ab-4eea-89b3-b65a315525c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:37.138643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5a7bf-b5ab-4eea-89b3-b65a315525c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:37.139107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5a7bf-b5ab-4eea-89b3-b65a315525c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:37.141058 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5a7bf-b5ab-4eea-89b3-b65a315525c2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:37.160289 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 523/1049] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:14:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:37.171441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5a7bf-b5ab-4eea-89b3-b65a315525c2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:37.177913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa4c9-d474-4374-8009-20c1ac567b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:37.178637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa4c9-d474-4374-8009-20c1ac567b03 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:37.178921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa4c9-d474-4374-8009-20c1ac567b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:37.179197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa4c9-d474-4374-8009-20c1ac567b03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:37.180664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afa4c9-d474-4374-8009-20c1ac567b03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:37.181454 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afa4c9-d474-4374-8009-20c1ac567b03 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:37.218545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 527/1050] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 21 08:14:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:14:37.218843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:37.352623 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5a7bf-b5ab-4eea-89b3-b65a315525c2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:37.413882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd2654-a870-4df0-bd44-b7795d5f7162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:37.414582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd2654-a870-4df0-bd44-b7795d5f7162 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:37.414848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd2654-a870-4df0-bd44-b7795d5f7162 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:37.415112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd2654-a870-4df0-bd44-b7795d5f7162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:37.415983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd2654-a870-4df0-bd44-b7795d5f7162 None admin] RBAC: Adding query filter params (role.id=a53fbfc77af04f2881bdc3124af55c4a, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=421f05e3d10e4393b28f77b6179ade8c) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:37.416307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd2654-a870-4df0-bd44-b7795d5f7162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:37.417875 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd2654-a870-4df0-bd44-b7795d5f7162 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:37.432567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 524/1051] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:14:37 2022] GET /identity/v3/role_assignments?user.id=421f05e3d10e4393b28f77b6179ade8c&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=a53fbfc77af04f2881bdc3124af55c4a => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:38.950885 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf6965-9d85-42ef-8045-0ae062bf4c0b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:38.951726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf6965-9d85-42ef-8045-0ae062bf4c0b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:38.951726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf6965-9d85-42ef-8045-0ae062bf4c0b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:38.953121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 528/1052] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:38.960200 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8c18-0189-4591-8318-7bb143aed02a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:38.960855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8c18-0189-4591-8318-7bb143aed02a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:38.961302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8c18-0189-4591-8318-7bb143aed02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:38.996570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-aa6e8c18-0189-4591-8318-7bb143aed02a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:38.999094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aa6e8c18-0189-4591-8318-7bb143aed02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:39.108079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 525/1053] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:39.131872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf6965-9d85-42ef-8045-0ae062bf4c0b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:39.251826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:39.263608 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf6965-9d85-42ef-8045-0ae062bf4c0b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:39.324432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727efc0-1849-42ef-8b8e-8d5857278a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:39.325903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727efc0-1849-42ef-8b8e-8d5857278a53 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:39.326446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727efc0-1849-42ef-8b8e-8d5857278a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:39.327020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727efc0-1849-42ef-8b8e-8d5857278a53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:39.348160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727efc0-1849-42ef-8b8e-8d5857278a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9727efc0-1849-42ef-8b8e-8d5857278a53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:14:39.362236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:39.363603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:39.364460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:39.364460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:39.364460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:39.364460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:39.364460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:14:39.364460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:14:39.364460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:14:39.364460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:14:39.364460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:14:39.364460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:14:39.364460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:14:39.364460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:39.371210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 529/1054] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:14:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:39.375768 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8c18-0189-4591-8318-7bb143aed02a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:39.390201 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:39.510762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8c18-0189-4591-8318-7bb143aed02a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:39.555360 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e977964-5932-4f61-af84-2baae9ae0056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:39.556293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e977964-5932-4f61-af84-2baae9ae0056 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:39.556620 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e977964-5932-4f61-af84-2baae9ae0056 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:39.556907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e977964-5932-4f61-af84-2baae9ae0056 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:39.557699 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e977964-5932-4f61-af84-2baae9ae0056 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:39.558093 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e977964-5932-4f61-af84-2baae9ae0056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:39.559769 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e977964-5932-4f61-af84-2baae9ae0056 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:39.571261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 526/1055] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:14:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:39.577716 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727efc0-1849-42ef-8b8e-8d5857278a53 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:39.683010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad29700-913f-47e2-bc7e-8331a194423f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:39.683311 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad29700-913f-47e2-bc7e-8331a194423f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:39.683678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad29700-913f-47e2-bc7e-8331a194423f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:39.685486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 527/1056] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:14:39.691078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cf44a-91ad-401c-94a9-a66aea0b09eb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:39.691330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cf44a-91ad-401c-94a9-a66aea0b09eb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:39.691671 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cf44a-91ad-401c-94a9-a66aea0b09eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:39.717317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b35cf44a-91ad-401c-94a9-a66aea0b09eb None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:39.718936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b35cf44a-91ad-401c-94a9-a66aea0b09eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:39.766018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727efc0-1849-42ef-8b8e-8d5857278a53 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:39.812901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:39.823079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 528/1057] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:39.827149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b619d5-dfe8-4ab8-a2ea-48722afa9b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:39.828721 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b619d5-dfe8-4ab8-a2ea-48722afa9b44 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:39.829275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b619d5-dfe8-4ab8-a2ea-48722afa9b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:39.829756 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b619d5-dfe8-4ab8-a2ea-48722afa9b44 None admin] PATH_INFO: `/v3/users/12d880e778ab4cbfbddcb3dba2fd17ab` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:39.848344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cf44a-91ad-401c-94a9-a66aea0b09eb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:39.851546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b619d5-dfe8-4ab8-a2ea-48722afa9b44 None admin] RBAC: Authorizing `identity:get_user(user_id=12d880e778ab4cbfbddcb3dba2fd17ab)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:39.854124 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b619d5-dfe8-4ab8-a2ea-48722afa9b44 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:39.857559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 530/1058] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:14:39 2022] GET /identity/v3/users/12d880e778ab4cbfbddcb3dba2fd17ab => generated 285 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:39.869161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b619d5-dfe8-4ab8-a2ea-48722afa9b44 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:39.893698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:39.987801 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cf44a-91ad-401c-94a9-a66aea0b09eb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:40.039507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b339d07-3be7-485e-a63e-3754b8580743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:40.040480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339d07-3be7-485e-a63e-3754b8580743 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:40.040946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339d07-3be7-485e-a63e-3754b8580743 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:40.041365 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339d07-3be7-485e-a63e-3754b8580743 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:40.057736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b339d07-3be7-485e-a63e-3754b8580743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:14:40.062440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b619d5-dfe8-4ab8-a2ea-48722afa9b44 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-5b339d07-3be7-485e-a63e-3754b8580743 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:14:40.068191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:40.070462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:40.072079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:40.072079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:40.072079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:40.072079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:40.072079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:14:40.072079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:14:40.072079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:14:40.072079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:14:40.072079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:14:40.072079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:14:40.072079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:14:40.072079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:40.077517 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 529/1059] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jul 21 08:14:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:40.079182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b339d07-3be7-485e-a63e-3754b8580743 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:40.147034 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:40.157298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883778b8-ba4d-4100-82b8-845b440b4fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:40.158486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883778b8-ba4d-4100-82b8-845b440b4fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:40.158907 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883778b8-ba4d-4100-82b8-845b440b4fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:40.159307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883778b8-ba4d-4100-82b8-845b440b4fb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:40.210058 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b339d07-3be7-485e-a63e-3754b8580743 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:40.245189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883778b8-ba4d-4100-82b8-845b440b4fb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:40.246876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883778b8-ba4d-4100-82b8-845b440b4fb4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:40.263794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:40.266787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932af37-548a-4966-91cd-9b16e697284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:40.267528 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932af37-548a-4966-91cd-9b16e697284a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:40.267821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932af37-548a-4966-91cd-9b16e697284a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:40.268069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932af37-548a-4966-91cd-9b16e697284a None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:40.269251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932af37-548a-4966-91cd-9b16e697284a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:40.269553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932af37-548a-4966-91cd-9b16e697284a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:40.271006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932af37-548a-4966-91cd-9b16e697284a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:40.288909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 530/1060] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 21 08:14:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:40.288909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454a9e4-ff30-4f8a-bf04-583e5d44b9d0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:40.288909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454a9e4-ff30-4f8a-bf04-583e5d44b9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:40.288909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454a9e4-ff30-4f8a-bf04-583e5d44b9d0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:40.288909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 531/1061] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:40.290511 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abea45e-cd27-4d70-bf94-1a4c419177fe None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:40.290730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abea45e-cd27-4d70-bf94-1a4c419177fe None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:40.291001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abea45e-cd27-4d70-bf94-1a4c419177fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:40.310182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1abea45e-cd27-4d70-bf94-1a4c419177fe None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:40.311425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1abea45e-cd27-4d70-bf94-1a4c419177fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:40.379537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 531/1062] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:14:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:14:40.380420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883778b8-ba4d-4100-82b8-845b440b4fb4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:40.403427 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 532/1063] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:40.404723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abea45e-cd27-4d70-bf94-1a4c419177fe None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:40.487590 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:40.534956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883778b8-ba4d-4100-82b8-845b440b4fb4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:40.551054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:40.564852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abea45e-cd27-4d70-bf94-1a4c419177fe None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:40.582209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc475669-d077-4b0b-a725-b4002275eecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:40.583038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc475669-d077-4b0b-a725-b4002275eecf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:40.583312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc475669-d077-4b0b-a725-b4002275eecf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:40.583585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc475669-d077-4b0b-a725-b4002275eecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:40.595696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc475669-d077-4b0b-a725-b4002275eecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:40.597267 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc475669-d077-4b0b-a725-b4002275eecf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:40.608720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6661536-60c8-4a74-8eb0-e66482b808db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:40.609602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6661536-60c8-4a74-8eb0-e66482b808db None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:40.609878 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6661536-60c8-4a74-8eb0-e66482b808db None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:40.610143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6661536-60c8-4a74-8eb0-e66482b808db None admin] PATH_INFO: `/v3/projects/01766d6380134193b8f8c77e1370b9d6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:40.611457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6661536-60c8-4a74-8eb0-e66482b808db None admin] RBAC: Authorizing `identity:get_project(project_id=01766d6380134193b8f8c77e1370b9d6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:40.612960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6661536-60c8-4a74-8eb0-e66482b808db None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:40.614701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 533/1064] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:14:40 2022] GET /identity/v3/projects/01766d6380134193b8f8c77e1370b9d6 => generated 311 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:40.615482 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6661536-60c8-4a74-8eb0-e66482b808db None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-bc475669-d077-4b0b-a725-b4002275eecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:40.617260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:40.618205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:40.619098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:40.619098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:40.619098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:40.619098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:40.621420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 532/1065] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:40.628519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc475669-d077-4b0b-a725-b4002275eecf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:40.747341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc475669-d077-4b0b-a725-b4002275eecf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:40.765254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6661536-60c8-4a74-8eb0-e66482b808db None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:40.785918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:40.804131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40935b39-4f84-4053-a6f0-10f2a6d502ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:40.805193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40935b39-4f84-4053-a6f0-10f2a6d502ab None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:40.805652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40935b39-4f84-4053-a6f0-10f2a6d502ab None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:40.805956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40935b39-4f84-4053-a6f0-10f2a6d502ab None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:40.806929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703827d-c633-423a-8865-884ddb79f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:40.807041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40935b39-4f84-4053-a6f0-10f2a6d502ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:40.807582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40935b39-4f84-4053-a6f0-10f2a6d502ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:40.807675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703827d-c633-423a-8865-884ddb79f97e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:40.807866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703827d-c633-423a-8865-884ddb79f97e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:40.808137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703827d-c633-423a-8865-884ddb79f97e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:40.809774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40935b39-4f84-4053-a6f0-10f2a6d502ab None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:40.828119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 533/1066] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:40.831269 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40935b39-4f84-4053-a6f0-10f2a6d502ab None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:40.865692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:40.892118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703827d-c633-423a-8865-884ddb79f97e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:40.894272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703827d-c633-423a-8865-884ddb79f97e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:40.958840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40935b39-4f84-4053-a6f0-10f2a6d502ab None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:40.998889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fee1c-36b1-4c55-8b32-fcb03acbfcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:40.999555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fee1c-36b1-4c55-8b32-fcb03acbfcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:40.999830 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fee1c-36b1-4c55-8b32-fcb03acbfcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:41.000100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fee1c-36b1-4c55-8b32-fcb03acbfcf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:41.000966 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fee1c-36b1-4c55-8b32-fcb03acbfcf8 None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=01766d6380134193b8f8c77e1370b9d6, user.id=12d880e778ab4cbfbddcb3dba2fd17ab) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:41.001389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fee1c-36b1-4c55-8b32-fcb03acbfcf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:41.002892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fee1c-36b1-4c55-8b32-fcb03acbfcf8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:41.006596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 534/1067] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:14:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:14:41.007796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703827d-c633-423a-8865-884ddb79f97e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:41.020638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 534/1068] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:14:40 2022] GET /identity/v3/role_assignments?user.id=12d880e778ab4cbfbddcb3dba2fd17ab&scope.project.id=01766d6380134193b8f8c77e1370b9d6&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:41.020638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fee1c-36b1-4c55-8b32-fcb03acbfcf8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:41.056974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:41.187744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703827d-c633-423a-8865-884ddb79f97e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:41.189927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:41.207845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fee1c-36b1-4c55-8b32-fcb03acbfcf8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:41.243480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6fd30-36a1-4b45-adb8-f5c6a994e154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:41.244321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6fd30-36a1-4b45-adb8-f5c6a994e154 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:41.244636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6fd30-36a1-4b45-adb8-f5c6a994e154 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:41.244929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6fd30-36a1-4b45-adb8-f5c6a994e154 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:41.254084 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6fd30-36a1-4b45-adb8-f5c6a994e154 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:41.255621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6fd30-36a1-4b45-adb8-f5c6a994e154 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6bb6fd30-36a1-4b45-adb8-f5c6a994e154 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:14:41.273492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:41.276212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:41.277847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:41.277847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:41.277847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:14:41.277847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:14:41.277847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:14:41.277847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:14:41.277847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:14:41.277847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:14:41.277847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:14:41.277847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:41.277847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 535/1069] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 21 08:14:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:41.281272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0937ee-b95a-47a2-b0c2-443be8db533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:41.282380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6fd30-36a1-4b45-adb8-f5c6a994e154 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:41.282649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0937ee-b95a-47a2-b0c2-443be8db533e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:41.283047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0937ee-b95a-47a2-b0c2-443be8db533e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:41.283628 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0937ee-b95a-47a2-b0c2-443be8db533e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:41.300657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0937ee-b95a-47a2-b0c2-443be8db533e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:41.302306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0937ee-b95a-47a2-b0c2-443be8db533e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8c0937ee-b95a-47a2-b0c2-443be8db533e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:41.326498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:41.328281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:41.330177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:41.330177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:41.330177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:41.330177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:41.330177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 535/1070] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:14:41.337449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0937ee-b95a-47a2-b0c2-443be8db533e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:41.403764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:41.436362 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6fd30-36a1-4b45-adb8-f5c6a994e154 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:41.493375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ba235-f9d9-4f96-9435-4f885ae440b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:41.494082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ba235-f9d9-4f96-9435-4f885ae440b1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:41.494395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ba235-f9d9-4f96-9435-4f885ae440b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:41.494651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ba235-f9d9-4f96-9435-4f885ae440b1 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:41.495498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ba235-f9d9-4f96-9435-4f885ae440b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:41.495806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ba235-f9d9-4f96-9435-4f885ae440b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:41.497354 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ba235-f9d9-4f96-9435-4f885ae440b1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:41.520678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 536/1071] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 21 08:14:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:41.529438 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ba235-f9d9-4f96-9435-4f885ae440b1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:41.538560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0937ee-b95a-47a2-b0c2-443be8db533e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:41.607000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ba40-9814-456b-a167-c350ebf1aeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:41.608090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ba40-9814-456b-a167-c350ebf1aeff None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:41.608623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ba40-9814-456b-a167-c350ebf1aeff None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:41.609122 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ba40-9814-456b-a167-c350ebf1aeff None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:41.610625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897ba40-9814-456b-a167-c350ebf1aeff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:41.611186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897ba40-9814-456b-a167-c350ebf1aeff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:41.614930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897ba40-9814-456b-a167-c350ebf1aeff None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:41.636170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:41.643146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 536/1072] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:41.679612 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ba235-f9d9-4f96-9435-4f885ae440b1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:41.731232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8051c1-0fa8-4a04-bbbd-4d7d2cca6163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:41.732357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8051c1-0fa8-4a04-bbbd-4d7d2cca6163 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:41.732852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8051c1-0fa8-4a04-bbbd-4d7d2cca6163 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:41.733276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8051c1-0fa8-4a04-bbbd-4d7d2cca6163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:41.737527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:41.749702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8051c1-0fa8-4a04-bbbd-4d7d2cca6163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:41.751702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8051c1-0fa8-4a04-bbbd-4d7d2cca6163 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ec8051c1-0fa8-4a04-bbbd-4d7d2cca6163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:41.776113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:41.777863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:41.780944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:41.780944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:41.780944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:41.780944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:41.780944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 537/1073] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:41.788387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ba40-9814-456b-a167-c350ebf1aeff None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:41.927897 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ba40-9814-456b-a167-c350ebf1aeff None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:41.971560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d8ce2-913e-4e4d-99eb-74c4485b78aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:41.972255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d8ce2-913e-4e4d-99eb-74c4485b78aa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:41.972659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d8ce2-913e-4e4d-99eb-74c4485b78aa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:41.972816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d8ce2-913e-4e4d-99eb-74c4485b78aa None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:41.973569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d8ce2-913e-4e4d-99eb-74c4485b78aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:41.973953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d8ce2-913e-4e4d-99eb-74c4485b78aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:41.975460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d8ce2-913e-4e4d-99eb-74c4485b78aa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:41.993810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 537/1074] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:42.003406 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8051c1-0fa8-4a04-bbbd-4d7d2cca6163 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:42.150585 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8051c1-0fa8-4a04-bbbd-4d7d2cca6163 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:42.203780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac80d3f-72fd-44cc-b0a7-254c84d66c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:42.204975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac80d3f-72fd-44cc-b0a7-254c84d66c33 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:42.205339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac80d3f-72fd-44cc-b0a7-254c84d66c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:42.205683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac80d3f-72fd-44cc-b0a7-254c84d66c33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:42.214265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac80d3f-72fd-44cc-b0a7-254c84d66c33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:42.215879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac80d3f-72fd-44cc-b0a7-254c84d66c33 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-bac80d3f-72fd-44cc-b0a7-254c84d66c33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:14:42.233106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:42.234651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:42.236746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:14:42.236746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:14:42.236746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:14:42.236746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:14:42.236746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:14:42.236746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:14:42.236746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:42.236746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:42.238005 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 538/1075] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:42.241428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d8ce2-913e-4e4d-99eb-74c4485b78aa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:42.343064 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:42.390561 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d8ce2-913e-4e4d-99eb-74c4485b78aa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:42.431317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16251-9c18-44a3-b57e-e8ec7e4e7b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:42.431995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16251-9c18-44a3-b57e-e8ec7e4e7b02 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:42.432270 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16251-9c18-44a3-b57e-e8ec7e4e7b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:42.432574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16251-9c18-44a3-b57e-e8ec7e4e7b02 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:42.433394 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16251-9c18-44a3-b57e-e8ec7e4e7b02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:42.433698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16251-9c18-44a3-b57e-e8ec7e4e7b02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:42.435207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16251-9c18-44a3-b57e-e8ec7e4e7b02 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:42.450277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 538/1076] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:42.457206 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac80d3f-72fd-44cc-b0a7-254c84d66c33 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:42.552634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:42.659687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac80d3f-72fd-44cc-b0a7-254c84d66c33 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:42.728834 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0df286-0ddb-4328-92e3-089f250d3923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:42.730446 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0df286-0ddb-4328-92e3-089f250d3923 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:42.730918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0df286-0ddb-4328-92e3-089f250d3923 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:42.731391 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0df286-0ddb-4328-92e3-089f250d3923 None admin] PATH_INFO: `/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/421f05e3d10e4393b28f77b6179ade8c/roles/a53fbfc77af04f2881bdc3124af55c4a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:42.735128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0df286-0ddb-4328-92e3-089f250d3923 None admin] RBAC: Authorizing `identity:create_grant(project_id=c487ed72a15c45faa40f743ae752e48b, user_id=421f05e3d10e4393b28f77b6179ade8c, role_id=a53fbfc77af04f2881bdc3124af55c4a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:42.737844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0df286-0ddb-4328-92e3-089f250d3923 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:42.757197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 539/1077] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:14:42 2022] PUT /identity/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/421f05e3d10e4393b28f77b6179ade8c/roles/a53fbfc77af04f2881bdc3124af55c4a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:14:43.245286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf30c7a-5b6a-4be1-95c5-9039121c0285 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:43.245867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf30c7a-5b6a-4be1-95c5-9039121c0285 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:43.245867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf30c7a-5b6a-4be1-95c5-9039121c0285 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:43.247264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 539/1078] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:43.253576 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab238228-602f-4d96-a5cf-1a267bcbb203 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:43.254123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab238228-602f-4d96-a5cf-1a267bcbb203 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:43.254216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab238228-602f-4d96-a5cf-1a267bcbb203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:43.275180 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ab238228-602f-4d96-a5cf-1a267bcbb203 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:43.276431 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ab238228-602f-4d96-a5cf-1a267bcbb203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:43.357847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 540/1079] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:43.381356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf30c7a-5b6a-4be1-95c5-9039121c0285 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:43.507630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf30c7a-5b6a-4be1-95c5-9039121c0285 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:43.533872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:43.550983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04369b-1b58-46f9-9653-eb0562ef6789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:43.551813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04369b-1b58-46f9-9653-eb0562ef6789 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:43.552118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04369b-1b58-46f9-9653-eb0562ef6789 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:43.552388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04369b-1b58-46f9-9653-eb0562ef6789 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:43.564702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04369b-1b58-46f9-9653-eb0562ef6789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-eb04369b-1b58-46f9-9653-eb0562ef6789 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:14:43.572538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:43.574632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:43.576720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:43.576720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:43.576720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:43.576720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:43.576720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:14:43.576720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:14:43.576720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:14:43.576720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:14:43.576720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:14:43.576720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:14:43.576720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:14:43.576720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:43.579201 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 540/1080] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:14:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:43.580818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab238228-602f-4d96-a5cf-1a267bcbb203 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:43.659195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:43.733118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab238228-602f-4d96-a5cf-1a267bcbb203 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:43.772051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c645ce-8160-4eb7-9123-98ad6e6892d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:43.772700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c645ce-8160-4eb7-9123-98ad6e6892d8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:43.773003 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c645ce-8160-4eb7-9123-98ad6e6892d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:43.773271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c645ce-8160-4eb7-9123-98ad6e6892d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:43.774043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c645ce-8160-4eb7-9123-98ad6e6892d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:43.774342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c645ce-8160-4eb7-9123-98ad6e6892d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:43.775772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c645ce-8160-4eb7-9123-98ad6e6892d8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:43.785958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 541/1081] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:14:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:43.793214 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04369b-1b58-46f9-9653-eb0562ef6789 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:43.932256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04369b-1b58-46f9-9653-eb0562ef6789 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:43.972713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a2848-6943-449c-9278-7e2d1ec9714d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:43.973759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a2848-6943-449c-9278-7e2d1ec9714d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:43.974125 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a2848-6943-449c-9278-7e2d1ec9714d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:43.974487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a2848-6943-449c-9278-7e2d1ec9714d None admin] PATH_INFO: `/v3/users/12d880e778ab4cbfbddcb3dba2fd17ab` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:43.975923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a2848-6943-449c-9278-7e2d1ec9714d None admin] RBAC: Authorizing `identity:get_user(user_id=12d880e778ab4cbfbddcb3dba2fd17ab)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:43.977460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a2848-6943-449c-9278-7e2d1ec9714d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:43.979209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 541/1082] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:14:43 2022] GET /identity/v3/users/12d880e778ab4cbfbddcb3dba2fd17ab => generated 285 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:43.988177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c645ce-8160-4eb7-9123-98ad6e6892d8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:44.102749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:44.105986 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c645ce-8160-4eb7-9123-98ad6e6892d8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:44.145599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5b12a-9477-496e-a9f0-74843755325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:44.146484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5b12a-9477-496e-a9f0-74843755325c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:44.146756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5b12a-9477-496e-a9f0-74843755325c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:44.147024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5b12a-9477-496e-a9f0-74843755325c None admin] PATH_INFO: `/v3/projects/01766d6380134193b8f8c77e1370b9d6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:44.148288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5b12a-9477-496e-a9f0-74843755325c None admin] RBAC: Authorizing `identity:get_project(project_id=01766d6380134193b8f8c77e1370b9d6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:44.149789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5b12a-9477-496e-a9f0-74843755325c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:44.157874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 542/1083] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:14:43 2022] GET /identity/v3/projects/01766d6380134193b8f8c77e1370b9d6 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:44.160261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a2848-6943-449c-9278-7e2d1ec9714d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:44.220270 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:44.300419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a2848-6943-449c-9278-7e2d1ec9714d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:44.357575 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e0cd8-dabb-40b0-b68a-17a613125c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:44.358647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e0cd8-dabb-40b0-b68a-17a613125c19 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:44.359012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e0cd8-dabb-40b0-b68a-17a613125c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:44.359286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e0cd8-dabb-40b0-b68a-17a613125c19 None admin] PATH_INFO: `/v3/projects/01766d6380134193b8f8c77e1370b9d6/users/12d880e778ab4cbfbddcb3dba2fd17ab/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:44.362341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e0cd8-dabb-40b0-b68a-17a613125c19 None admin] RBAC: Authorizing `identity:create_grant(project_id=01766d6380134193b8f8c77e1370b9d6, user_id=12d880e778ab4cbfbddcb3dba2fd17ab, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:44.364854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e0cd8-dabb-40b0-b68a-17a613125c19 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:44.380357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 542/1084] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:14:44 2022] PUT /identity/v3/projects/01766d6380134193b8f8c77e1370b9d6/users/12d880e778ab4cbfbddcb3dba2fd17ab/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:14:44.978020 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ccb6e-89ff-4db6-8601-6805514106e2 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:44.978623 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ccb6e-89ff-4db6-8601-6805514106e2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:44.978623 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ccb6e-89ff-4db6-8601-6805514106e2 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:44.980044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 543/1085] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:44.986508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc60d8-4a28-4e1a-a112-c9be967bfcf4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:44.986751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc60d8-4a28-4e1a-a112-c9be967bfcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:44.987070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc60d8-4a28-4e1a-a112-c9be967bfcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:45.005861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-77cc60d8-4a28-4e1a-a112-c9be967bfcf4 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:45.007140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-77cc60d8-4a28-4e1a-a112-c9be967bfcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:45.082159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 543/1086] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:45.106134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ccb6e-89ff-4db6-8601-6805514106e2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:45.240423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ccb6e-89ff-4db6-8601-6805514106e2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:45.283988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446cfc1-2468-4de7-b24d-2b66a3e9eb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:45.284921 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446cfc1-2468-4de7-b24d-2b66a3e9eb4a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:45.285202 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446cfc1-2468-4de7-b24d-2b66a3e9eb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:45.285475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446cfc1-2468-4de7-b24d-2b66a3e9eb4a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:45.298232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446cfc1-2468-4de7-b24d-2b66a3e9eb4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2446cfc1-2468-4de7-b24d-2b66a3e9eb4a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:14:45.307554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:45.309401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:45.310946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 544/1087] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jul 21 08:14:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:45.317705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc60d8-4a28-4e1a-a112-c9be967bfcf4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:45.365059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:45.440269 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc60d8-4a28-4e1a-a112-c9be967bfcf4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:45.480759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff50ac-9e3a-4525-992c-269a60111d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:45.481458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff50ac-9e3a-4525-992c-269a60111d25 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:45.481739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff50ac-9e3a-4525-992c-269a60111d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:45.482012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff50ac-9e3a-4525-992c-269a60111d25 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:45.482784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff50ac-9e3a-4525-992c-269a60111d25 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:45.483090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff50ac-9e3a-4525-992c-269a60111d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:45.484587 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff50ac-9e3a-4525-992c-269a60111d25 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:45.495183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 544/1088] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 21 08:14:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:45.501453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446cfc1-2468-4de7-b24d-2b66a3e9eb4a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:45.547050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:45.691189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446cfc1-2468-4de7-b24d-2b66a3e9eb4a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:45.759254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b05efd-a496-4b90-8a34-f731d6b175e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:45.760398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b05efd-a496-4b90-8a34-f731d6b175e9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:45.761116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b05efd-a496-4b90-8a34-f731d6b175e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:45.761663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b05efd-a496-4b90-8a34-f731d6b175e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:45.776090 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b05efd-a496-4b90-8a34-f731d6b175e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:45.777754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b05efd-a496-4b90-8a34-f731d6b175e9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-45b05efd-a496-4b90-8a34-f731d6b175e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:45.797610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:45.798667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:45.799658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:45.799658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:45.799658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:45.799658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:45.805709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 545/1089] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:45.805908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff50ac-9e3a-4525-992c-269a60111d25 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:45.931769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:45.935885 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff50ac-9e3a-4525-992c-269a60111d25 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:45.982344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8076ea1-ecd1-4e0b-8c56-8fb46a116dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:45.983056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8076ea1-ecd1-4e0b-8c56-8fb46a116dac None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:45.983337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8076ea1-ecd1-4e0b-8c56-8fb46a116dac None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:45.983615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8076ea1-ecd1-4e0b-8c56-8fb46a116dac None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:45.984396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8076ea1-ecd1-4e0b-8c56-8fb46a116dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:45.984761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8076ea1-ecd1-4e0b-8c56-8fb46a116dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:45.986321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8076ea1-ecd1-4e0b-8c56-8fb46a116dac None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:46.002027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 545/1090] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:46.010299 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b05efd-a496-4b90-8a34-f731d6b175e9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:46.114374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:46.150302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b05efd-a496-4b90-8a34-f731d6b175e9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:46.202390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c1355-6e6d-44f7-8ccc-795ef0ac66f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:46.203266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c1355-6e6d-44f7-8ccc-795ef0ac66f5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:46.203581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c1355-6e6d-44f7-8ccc-795ef0ac66f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:46.203895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c1355-6e6d-44f7-8ccc-795ef0ac66f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:46.213634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c1355-6e6d-44f7-8ccc-795ef0ac66f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:46.215229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c1355-6e6d-44f7-8ccc-795ef0ac66f5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-786c1355-6e6d-44f7-8ccc-795ef0ac66f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:14:46.231664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:46.232949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:46.234038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:46.234038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:46.234038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:14:46.234038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:14:46.234038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:14:46.234038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:14:46.234038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:14:46.234038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:14:46.234038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:14:46.234038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:46.234038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 546/1091] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 21 08:14:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:46.239776 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8076ea1-ecd1-4e0b-8c56-8fb46a116dac None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:46.405851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8076ea1-ecd1-4e0b-8c56-8fb46a116dac None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:46.470156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a394bb-1e5b-43bd-98e7-2bfc9014bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:46.471045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a394bb-1e5b-43bd-98e7-2bfc9014bcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:46.471457 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a394bb-1e5b-43bd-98e7-2bfc9014bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:46.471758 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a394bb-1e5b-43bd-98e7-2bfc9014bcf1 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:46.473730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a394bb-1e5b-43bd-98e7-2bfc9014bcf1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:46.474360 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a394bb-1e5b-43bd-98e7-2bfc9014bcf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:46.476826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a394bb-1e5b-43bd-98e7-2bfc9014bcf1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:46.511866 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 546/1092] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 21 08:14:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:46.521378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c1355-6e6d-44f7-8ccc-795ef0ac66f5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:46.522517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa062cf7-b1bb-4878-9bf6-63058610f8bb None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:46.522798 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa062cf7-b1bb-4878-9bf6-63058610f8bb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:46.523077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa062cf7-b1bb-4878-9bf6-63058610f8bb None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:46.525550 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 547/1093] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:14:46.531727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2d728-0271-4597-9fae-f5ef8e12cd1c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:46.532039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2d728-0271-4597-9fae-f5ef8e12cd1c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:46.532326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2d728-0271-4597-9fae-f5ef8e12cd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:46.551287 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-efb2d728-0271-4597-9fae-f5ef8e12cd1c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:46.552637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-efb2d728-0271-4597-9fae-f5ef8e12cd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:46.567826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:46.640333 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 548/1094] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:14:46.652440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c1355-6e6d-44f7-8ccc-795ef0ac66f5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:46.664809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2d728-0271-4597-9fae-f5ef8e12cd1c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:46.694727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf829c-985a-4f7c-aac4-fca0f86fed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:46.695398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf829c-985a-4f7c-aac4-fca0f86fed6a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:46.695686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf829c-985a-4f7c-aac4-fca0f86fed6a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:46.695956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf829c-985a-4f7c-aac4-fca0f86fed6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:46.707879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:46.777402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf829c-985a-4f7c-aac4-fca0f86fed6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:46.779113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf829c-985a-4f7c-aac4-fca0f86fed6a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:46.794914 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2d728-0271-4597-9fae-f5ef8e12cd1c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:46.833905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446ea7b-2f24-4487-a825-f5bd84690140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:46.834638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446ea7b-2f24-4487-a825-f5bd84690140 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:46.834919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446ea7b-2f24-4487-a825-f5bd84690140 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:46.835192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446ea7b-2f24-4487-a825-f5bd84690140 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:46.848154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446ea7b-2f24-4487-a825-f5bd84690140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5446ea7b-2f24-4487-a825-f5bd84690140 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:14:46.856130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:46.858078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:14:46.859942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 549/1095] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:14:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:14:46.863968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446ea7b-2f24-4487-a825-f5bd84690140 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:46.878582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:46.896816 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 547/1096] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:14:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:14:46.903678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf829c-985a-4f7c-aac4-fca0f86fed6a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:46.952087 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:46.983678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446ea7b-2f24-4487-a825-f5bd84690140 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:47.021608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf829c-985a-4f7c-aac4-fca0f86fed6a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:47.023123 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc28380-6312-41d4-b196-c877b99b0154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:47.023831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc28380-6312-41d4-b196-c877b99b0154 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:47.024116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc28380-6312-41d4-b196-c877b99b0154 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:47.024391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc28380-6312-41d4-b196-c877b99b0154 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:47.025209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc28380-6312-41d4-b196-c877b99b0154 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:47.025515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc28380-6312-41d4-b196-c877b99b0154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:47.026960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc28380-6312-41d4-b196-c877b99b0154 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:47.041933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 550/1097] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:14:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:47.043338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc28380-6312-41d4-b196-c877b99b0154 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:47.063265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd5282-0b32-44d1-8015-894f33a4ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:47.064133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd5282-0b32-44d1-8015-894f33a4ea91 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:47.064412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd5282-0b32-44d1-8015-894f33a4ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:47.064721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd5282-0b32-44d1-8015-894f33a4ea91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:47.076570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd5282-0b32-44d1-8015-894f33a4ea91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:47.078139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd5282-0b32-44d1-8015-894f33a4ea91 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-20bd5282-0b32-44d1-8015-894f33a4ea91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:14:47.098295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:47.100264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:47.102461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:14:47.102461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:14:47.102461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:14:47.102461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:47.104697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 548/1098] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:14:47.105493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd5282-0b32-44d1-8015-894f33a4ea91 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:47.136082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:47.175038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc28380-6312-41d4-b196-c877b99b0154 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:47.215090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1704d57-8804-4d5c-8c9d-cd2e4092aa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:47.216010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1704d57-8804-4d5c-8c9d-cd2e4092aa40 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:47.216295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1704d57-8804-4d5c-8c9d-cd2e4092aa40 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:47.216604 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1704d57-8804-4d5c-8c9d-cd2e4092aa40 None admin] PATH_INFO: `/v3/users/12d880e778ab4cbfbddcb3dba2fd17ab` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:47.217937 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1704d57-8804-4d5c-8c9d-cd2e4092aa40 None admin] RBAC: Authorizing `identity:get_user(user_id=12d880e778ab4cbfbddcb3dba2fd17ab)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:47.219513 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1704d57-8804-4d5c-8c9d-cd2e4092aa40 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:47.221384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 551/1099] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:14:47 2022] GET /identity/v3/users/12d880e778ab4cbfbddcb3dba2fd17ab => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:47.228196 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1704d57-8804-4d5c-8c9d-cd2e4092aa40 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:47.230356 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:47.242991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd5282-0b32-44d1-8015-894f33a4ea91 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:47.284895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbfce0-b3fd-4b86-b5d1-c85a80cdcb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:47.285588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbfce0-b3fd-4b86-b5d1-c85a80cdcb9c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:47.285865 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbfce0-b3fd-4b86-b5d1-c85a80cdcb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:47.286135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbfce0-b3fd-4b86-b5d1-c85a80cdcb9c None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:47.286879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbfce0-b3fd-4b86-b5d1-c85a80cdcb9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:47.287176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbfce0-b3fd-4b86-b5d1-c85a80cdcb9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:47.288652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbfce0-b3fd-4b86-b5d1-c85a80cdcb9c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:47.303170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 549/1100] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:47.308971 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbfce0-b3fd-4b86-b5d1-c85a80cdcb9c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:47.383475 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1704d57-8804-4d5c-8c9d-cd2e4092aa40 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:47.432288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbfce0-b3fd-4b86-b5d1-c85a80cdcb9c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:47.440047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760e825-33be-4cb4-aaea-c8d4d7569894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:47.441137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760e825-33be-4cb4-aaea-c8d4d7569894 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:47.441641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760e825-33be-4cb4-aaea-c8d4d7569894 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:47.442136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760e825-33be-4cb4-aaea-c8d4d7569894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:47.454556 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:47.480831 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646104e5-f82c-4216-9e23-ab7488564a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:47.482341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646104e5-f82c-4216-9e23-ab7488564a66 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:47.482846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646104e5-f82c-4216-9e23-ab7488564a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:47.483336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646104e5-f82c-4216-9e23-ab7488564a66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:47.498145 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646104e5-f82c-4216-9e23-ab7488564a66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:47.501068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646104e5-f82c-4216-9e23-ab7488564a66 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-646104e5-f82c-4216-9e23-ab7488564a66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:14:47.521332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:14:47.522635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:14:47.523987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:14:47.523987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:14:47.523987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:14:47.523987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:14:47.523987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:14:47.523987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:14:47.523987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:14:47.523987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:14:47.524982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760e825-33be-4cb4-aaea-c8d4d7569894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:47.525123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 550/1101] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:14:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:14:47.525300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760e825-33be-4cb4-aaea-c8d4d7569894 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:47.528998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646104e5-f82c-4216-9e23-ab7488564a66 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:47.545917 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:47.649069 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 552/1102] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:14:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:14:47.655483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760e825-33be-4cb4-aaea-c8d4d7569894 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:47.677580 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646104e5-f82c-4216-9e23-ab7488564a66 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:47.712851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:47.723860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a7948-54ec-4b7a-8602-ca8c404df9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:47.724969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a7948-54ec-4b7a-8602-ca8c404df9cf None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:47.725420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a7948-54ec-4b7a-8602-ca8c404df9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:47.725780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a7948-54ec-4b7a-8602-ca8c404df9cf None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:47.727134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a7948-54ec-4b7a-8602-ca8c404df9cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:47.727611 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a7948-54ec-4b7a-8602-ca8c404df9cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:47.730103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a7948-54ec-4b7a-8602-ca8c404df9cf None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:47.747512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 551/1103] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:14:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:47.754859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a7948-54ec-4b7a-8602-ca8c404df9cf None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:47.800215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760e825-33be-4cb4-aaea-c8d4d7569894 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:47.838028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504c165-94d8-4c13-b5f0-eddbfc616afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:47.838905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504c165-94d8-4c13-b5f0-eddbfc616afe None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:47.839186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504c165-94d8-4c13-b5f0-eddbfc616afe None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:47.839460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504c165-94d8-4c13-b5f0-eddbfc616afe None admin] PATH_INFO: `/v3/projects/01766d6380134193b8f8c77e1370b9d6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:47.840726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504c165-94d8-4c13-b5f0-eddbfc616afe None admin] RBAC: Authorizing `identity:get_project(project_id=01766d6380134193b8f8c77e1370b9d6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:47.842212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504c165-94d8-4c13-b5f0-eddbfc616afe None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:47.844022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 553/1104] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:14:47 2022] GET /identity/v3/projects/01766d6380134193b8f8c77e1370b9d6 => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:47.850827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504c165-94d8-4c13-b5f0-eddbfc616afe None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:47.858762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:47.901589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a7948-54ec-4b7a-8602-ca8c404df9cf None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:47.947205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a64781-cd32-416e-af96-c714a8a5697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:47.947905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a64781-cd32-416e-af96-c714a8a5697e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:47.948179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a64781-cd32-416e-af96-c714a8a5697e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:47.948453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a64781-cd32-416e-af96-c714a8a5697e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:47.949352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a64781-cd32-416e-af96-c714a8a5697e None admin] RBAC: Adding query filter params (role.id=a53fbfc77af04f2881bdc3124af55c4a, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=421f05e3d10e4393b28f77b6179ade8c) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:47.949678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a64781-cd32-416e-af96-c714a8a5697e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:47.951146 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a64781-cd32-416e-af96-c714a8a5697e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:47.958253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 552/1105] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:14:47 2022] GET /identity/v3/role_assignments?user.id=421f05e3d10e4393b28f77b6179ade8c&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=a53fbfc77af04f2881bdc3124af55c4a => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:48.027961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504c165-94d8-4c13-b5f0-eddbfc616afe None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:48.045406 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:48.101838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e032ed-33af-460e-86b8-ecc1a8ca39f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:48.103459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e032ed-33af-460e-86b8-ecc1a8ca39f8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:48.103938 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e032ed-33af-460e-86b8-ecc1a8ca39f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:48.104728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e032ed-33af-460e-86b8-ecc1a8ca39f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:48.106610 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e032ed-33af-460e-86b8-ecc1a8ca39f8 None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=01766d6380134193b8f8c77e1370b9d6, user.id=12d880e778ab4cbfbddcb3dba2fd17ab) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:48.107156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e032ed-33af-460e-86b8-ecc1a8ca39f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:48.110033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e032ed-33af-460e-86b8-ecc1a8ca39f8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:48.121597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 554/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:14:47 2022] GET /identity/v3/role_assignments?user.id=12d880e778ab4cbfbddcb3dba2fd17ab&scope.project.id=01766d6380134193b8f8c77e1370b9d6&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:50.418547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6765d-a3e0-4888-8d92-c1230fed436e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:50.419132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6765d-a3e0-4888-8d92-c1230fed436e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:50.419229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6765d-a3e0-4888-8d92-c1230fed436e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:50.420916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 553/1107] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:50.428555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5f87e-1884-497f-86f3-e14f196001e7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:50.429438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5f87e-1884-497f-86f3-e14f196001e7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:50.429438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5f87e-1884-497f-86f3-e14f196001e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:50.447742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d0d5f87e-1884-497f-86f3-e14f196001e7 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:50.449006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d0d5f87e-1884-497f-86f3-e14f196001e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:50.528651 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 555/1108] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:50.555015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6765d-a3e0-4888-8d92-c1230fed436e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:50.678423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6765d-a3e0-4888-8d92-c1230fed436e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:50.719018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c055b-85d9-4c5c-8730-ed63c809629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:50.719919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c055b-85d9-4c5c-8730-ed63c809629e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:50.720203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c055b-85d9-4c5c-8730-ed63c809629e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:50.720480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c055b-85d9-4c5c-8730-ed63c809629e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:50.721796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c055b-85d9-4c5c-8730-ed63c809629e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:50.723331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c055b-85d9-4c5c-8730-ed63c809629e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:50.725159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 554/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:14:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:50.735329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5f87e-1884-497f-86f3-e14f196001e7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:50.918169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:50.922031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5f87e-1884-497f-86f3-e14f196001e7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:50.963344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598864b6-5bff-46e6-9de2-4d123ee12f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:50.964120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598864b6-5bff-46e6-9de2-4d123ee12f1e None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:50.964439 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598864b6-5bff-46e6-9de2-4d123ee12f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:50.964801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598864b6-5bff-46e6-9de2-4d123ee12f1e None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:50.965592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598864b6-5bff-46e6-9de2-4d123ee12f1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:50.967139 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598864b6-5bff-46e6-9de2-4d123ee12f1e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:50.992209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 556/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:14:50 2022] POST /identity/v3/users => generated 286 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:14:53.176729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddb57f-4b26-4c18-a599-1cbbf18bcc7b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:53.177351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddb57f-4b26-4c18-a599-1cbbf18bcc7b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:53.177351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddb57f-4b26-4c18-a599-1cbbf18bcc7b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:53.178758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 555/1111] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:53.187719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc703b9a-bc20-4548-8014-55d1bb9ab4ba None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:53.188377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc703b9a-bc20-4548-8014-55d1bb9ab4ba None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:53.188377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc703b9a-bc20-4548-8014-55d1bb9ab4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:53.208295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fc703b9a-bc20-4548-8014-55d1bb9ab4ba None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:53.209720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fc703b9a-bc20-4548-8014-55d1bb9ab4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:53.303979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 557/1112] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:53.330298 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddb57f-4b26-4c18-a599-1cbbf18bcc7b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:53.334655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:53.457921 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddb57f-4b26-4c18-a599-1cbbf18bcc7b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:53.500710 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa3dc8-0012-4f47-b6a7-b46928acf72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:53.501588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa3dc8-0012-4f47-b6a7-b46928acf72d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:53.501892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa3dc8-0012-4f47-b6a7-b46928acf72d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:53.502166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa3dc8-0012-4f47-b6a7-b46928acf72d None admin] PATH_INFO: `/v3/roles/cbcda598469c41f19a1d3109e5d4c236` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:53.503879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa3dc8-0012-4f47-b6a7-b46928acf72d None admin] RBAC: Authorizing `identity:get_role(role_id=cbcda598469c41f19a1d3109e5d4c236)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:53.505364 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa3dc8-0012-4f47-b6a7-b46928acf72d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:53.506853 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 556/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:14:53 2022] GET /identity/v3/roles/cbcda598469c41f19a1d3109e5d4c236 => generated 223 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:53.513362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc703b9a-bc20-4548-8014-55d1bb9ab4ba None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:53.635692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:53.665443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc703b9a-bc20-4548-8014-55d1bb9ab4ba None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:53.734087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b63696-00e6-414d-8338-e48d9758225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:53.735657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b63696-00e6-414d-8338-e48d9758225f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:53.736162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b63696-00e6-414d-8338-e48d9758225f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:53.736669 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b63696-00e6-414d-8338-e48d9758225f None admin] PATH_INFO: `/v3/users/0f419079d27a44fd90060f60e6f626c8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:53.763366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b63696-00e6-414d-8338-e48d9758225f None admin] RBAC: Authorizing `identity:get_user(user_id=0f419079d27a44fd90060f60e6f626c8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:53.766245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b63696-00e6-414d-8338-e48d9758225f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:53.769832 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 558/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:14:53 2022] GET /identity/v3/users/0f419079d27a44fd90060f60e6f626c8 => generated 286 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:53.776428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa3dc8-0012-4f47-b6a7-b46928acf72d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:53.861221 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:53.900720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa3dc8-0012-4f47-b6a7-b46928acf72d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:53.941030 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50bb9c-8a1d-4ff3-bc09-87e7db6106cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:53.942026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50bb9c-8a1d-4ff3-bc09-87e7db6106cc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:53.942296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50bb9c-8a1d-4ff3-bc09-87e7db6106cc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:53.942585 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50bb9c-8a1d-4ff3-bc09-87e7db6106cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:54.025901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50bb9c-8a1d-4ff3-bc09-87e7db6106cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:54.027327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50bb9c-8a1d-4ff3-bc09-87e7db6106cc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:54.106684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:54.144608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 557/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:14:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:14:54.151935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b63696-00e6-414d-8338-e48d9758225f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:54.270601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b63696-00e6-414d-8338-e48d9758225f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:54.314541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900d86b-a43a-4f1c-acff-3a8d74eb2573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:54.315456 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d86b-a43a-4f1c-acff-3a8d74eb2573 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:54.315732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d86b-a43a-4f1c-acff-3a8d74eb2573 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:54.316003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d86b-a43a-4f1c-acff-3a8d74eb2573 None admin] PATH_INFO: `/v3/projects/01766d6380134193b8f8c77e1370b9d6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:54.317381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900d86b-a43a-4f1c-acff-3a8d74eb2573 None admin] RBAC: Authorizing `identity:get_project(project_id=01766d6380134193b8f8c77e1370b9d6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:54.318875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900d86b-a43a-4f1c-acff-3a8d74eb2573 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:54.320731 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 559/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:14:54 2022] GET /identity/v3/projects/01766d6380134193b8f8c77e1370b9d6 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:14:54.327586 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50bb9c-8a1d-4ff3-bc09-87e7db6106cc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:54.443791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50bb9c-8a1d-4ff3-bc09-87e7db6106cc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:54.484994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be48af-b1c5-490e-bd92-25bd8203fe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:54.485812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be48af-b1c5-490e-bd92-25bd8203fe3e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:54.486140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be48af-b1c5-490e-bd92-25bd8203fe3e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:54.486461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be48af-b1c5-490e-bd92-25bd8203fe3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:54.487372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be48af-b1c5-490e-bd92-25bd8203fe3e None admin] RBAC: Adding query filter params (role.id=cbcda598469c41f19a1d3109e5d4c236, scope.project.id=01766d6380134193b8f8c77e1370b9d6, user.id=0f419079d27a44fd90060f60e6f626c8) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:14:54.487731 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be48af-b1c5-490e-bd92-25bd8203fe3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:54.489338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be48af-b1c5-490e-bd92-25bd8203fe3e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:54.496376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 558/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:14:54 2022] GET /identity/v3/role_assignments?user.id=0f419079d27a44fd90060f60e6f626c8&scope.project.id=01766d6380134193b8f8c77e1370b9d6&role.id=cbcda598469c41f19a1d3109e5d4c236 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:56.638931 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c4a0-4bb8-468a-bd62-ecb6372d6b24 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:56.639534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c4a0-4bb8-468a-bd62-ecb6372d6b24 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:56.639534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c4a0-4bb8-468a-bd62-ecb6372d6b24 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:56.641016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 560/1118] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:56.647649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291739f1-729e-42e3-978d-93f94c00d3be None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:56.648210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291739f1-729e-42e3-978d-93f94c00d3be None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:56.648210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291739f1-729e-42e3-978d-93f94c00d3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:56.667052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-291739f1-729e-42e3-978d-93f94c00d3be None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:56.668348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-291739f1-729e-42e3-978d-93f94c00d3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:56.701191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:56.747479 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 559/1119] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:56.771761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c4a0-4bb8-468a-bd62-ecb6372d6b24 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:56.788880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:56.888739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c4a0-4bb8-468a-bd62-ecb6372d6b24 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:56.929565 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25d92a-304f-4f5a-a590-2fc1d3a8c67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:56.930431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d92a-304f-4f5a-a590-2fc1d3a8c67b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:56.930766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d92a-304f-4f5a-a590-2fc1d3a8c67b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:56.931094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d92a-304f-4f5a-a590-2fc1d3a8c67b None admin] PATH_INFO: `/v3/roles/cbcda598469c41f19a1d3109e5d4c236` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:56.932840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25d92a-304f-4f5a-a590-2fc1d3a8c67b None admin] RBAC: Authorizing `identity:get_role(role_id=cbcda598469c41f19a1d3109e5d4c236)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:56.934331 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25d92a-304f-4f5a-a590-2fc1d3a8c67b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:56.935857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 561/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:14:56 2022] GET /identity/v3/roles/cbcda598469c41f19a1d3109e5d4c236 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:56.942203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291739f1-729e-42e3-978d-93f94c00d3be None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:57.058975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291739f1-729e-42e3-978d-93f94c00d3be None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:57.098124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62101d5-7466-4d9a-a8a0-d8b44b065aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:57.099011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62101d5-7466-4d9a-a8a0-d8b44b065aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:57.099289 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62101d5-7466-4d9a-a8a0-d8b44b065aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:57.099654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62101d5-7466-4d9a-a8a0-d8b44b065aa7 None admin] PATH_INFO: `/v3/users/0f419079d27a44fd90060f60e6f626c8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:57.101173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62101d5-7466-4d9a-a8a0-d8b44b065aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=0f419079d27a44fd90060f60e6f626c8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:57.102755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62101d5-7466-4d9a-a8a0-d8b44b065aa7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:57.104405 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 560/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:14:56 2022] GET /identity/v3/users/0f419079d27a44fd90060f60e6f626c8 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:57.111004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25d92a-304f-4f5a-a590-2fc1d3a8c67b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:57.204807 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:57.226106 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25d92a-304f-4f5a-a590-2fc1d3a8c67b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:57.264931 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8078d0-5d72-40ca-a6f9-daf6a9989c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:57.265824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8078d0-5d72-40ca-a6f9-daf6a9989c68 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:57.266280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8078d0-5d72-40ca-a6f9-daf6a9989c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:57.266442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8078d0-5d72-40ca-a6f9-daf6a9989c68 None admin] PATH_INFO: `/v3/projects/01766d6380134193b8f8c77e1370b9d6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:57.267751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8078d0-5d72-40ca-a6f9-daf6a9989c68 None admin] RBAC: Authorizing `identity:get_project(project_id=01766d6380134193b8f8c77e1370b9d6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:57.269685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8078d0-5d72-40ca-a6f9-daf6a9989c68 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:57.271616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 562/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:14:57 2022] GET /identity/v3/projects/01766d6380134193b8f8c77e1370b9d6 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:14:57.278493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62101d5-7466-4d9a-a8a0-d8b44b065aa7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:14:57.316976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:14:57.390992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62101d5-7466-4d9a-a8a0-d8b44b065aa7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:14:57.430956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485e3ff-11eb-406f-a775-d31ef7007259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:14:57.431867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485e3ff-11eb-406f-a775-d31ef7007259 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:57.432148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485e3ff-11eb-406f-a775-d31ef7007259 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:57.432393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485e3ff-11eb-406f-a775-d31ef7007259 None admin] PATH_INFO: `/v3/projects/01766d6380134193b8f8c77e1370b9d6/users/0f419079d27a44fd90060f60e6f626c8/roles/cbcda598469c41f19a1d3109e5d4c236` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:57.434832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485e3ff-11eb-406f-a775-d31ef7007259 None admin] RBAC: Authorizing `identity:create_grant(project_id=01766d6380134193b8f8c77e1370b9d6, user_id=0f419079d27a44fd90060f60e6f626c8, role_id=cbcda598469c41f19a1d3109e5d4c236)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:14:57.436332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485e3ff-11eb-406f-a775-d31ef7007259 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:14:57.461397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 561/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:14:57 2022] PUT /identity/v3/projects/01766d6380134193b8f8c77e1370b9d6/users/0f419079d27a44fd90060f60e6f626c8/roles/cbcda598469c41f19a1d3109e5d4c236 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:14:59.671610 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19819252-47d2-4871-ad87-e72f34c622f5 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:59.672186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19819252-47d2-4871-ad87-e72f34c622f5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:59.672186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19819252-47d2-4871-ad87-e72f34c622f5 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:59.673791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 563/1124] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:14:59.681244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7ae89-0106-474e-bd46-5850b9553bff None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:14:59.681847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7ae89-0106-474e-bd46-5850b9553bff None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:14:59.682207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7ae89-0106-474e-bd46-5850b9553bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:14:59.709550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-13a7ae89-0106-474e-bd46-5850b9553bff None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:14:59.711631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-13a7ae89-0106-474e-bd46-5850b9553bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:14:59.843794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 562/1125] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:14:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:14:59.872166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19819252-47d2-4871-ad87-e72f34c622f5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:00.002787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19819252-47d2-4871-ad87-e72f34c622f5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:00.042563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5c04c-ffe5-435d-a77e-d7b59d033509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:00.043456 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5c04c-ffe5-435d-a77e-d7b59d033509 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:00.043737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5c04c-ffe5-435d-a77e-d7b59d033509 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:00.044012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5c04c-ffe5-435d-a77e-d7b59d033509 None admin] PATH_INFO: `/v3/roles/cbcda598469c41f19a1d3109e5d4c236` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:00.045664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5c04c-ffe5-435d-a77e-d7b59d033509 None admin] RBAC: Authorizing `identity:get_role(role_id=cbcda598469c41f19a1d3109e5d4c236)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:00.047087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5c04c-ffe5-435d-a77e-d7b59d033509 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:00.048603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 564/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:14:59 2022] GET /identity/v3/roles/cbcda598469c41f19a1d3109e5d4c236 => generated 223 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:00.054916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7ae89-0106-474e-bd46-5850b9553bff None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:00.083691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:00.173535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7ae89-0106-474e-bd46-5850b9553bff None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:00.213142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54767091-c59d-40d7-8657-c9b79ac4752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:00.214103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54767091-c59d-40d7-8657-c9b79ac4752d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:00.214426 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54767091-c59d-40d7-8657-c9b79ac4752d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:00.214745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54767091-c59d-40d7-8657-c9b79ac4752d None admin] PATH_INFO: `/v3/users/0f419079d27a44fd90060f60e6f626c8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:00.216123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54767091-c59d-40d7-8657-c9b79ac4752d None admin] RBAC: Authorizing `identity:get_user(user_id=0f419079d27a44fd90060f60e6f626c8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:00.217726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54767091-c59d-40d7-8657-c9b79ac4752d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:00.219536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 563/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:15:00 2022] GET /identity/v3/users/0f419079d27a44fd90060f60e6f626c8 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:00.227020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5c04c-ffe5-435d-a77e-d7b59d033509 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:00.258228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:00.362290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5c04c-ffe5-435d-a77e-d7b59d033509 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:00.402547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4eb93-372a-4481-9f17-1d0025d54fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:00.403256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4eb93-372a-4481-9f17-1d0025d54fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:00.403556 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4eb93-372a-4481-9f17-1d0025d54fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:00.403829 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4eb93-372a-4481-9f17-1d0025d54fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:00.480727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4eb93-372a-4481-9f17-1d0025d54fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:00.482226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4eb93-372a-4481-9f17-1d0025d54fa4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:00.502895 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:00.599142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 565/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:15:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:15:00.605568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54767091-c59d-40d7-8657-c9b79ac4752d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:00.710379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:00.720035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54767091-c59d-40d7-8657-c9b79ac4752d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:00.758535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4890f2-a4db-42ca-b4c3-877258e957e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:00.759413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4890f2-a4db-42ca-b4c3-877258e957e8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:00.759675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4890f2-a4db-42ca-b4c3-877258e957e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:00.759941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4890f2-a4db-42ca-b4c3-877258e957e8 None admin] PATH_INFO: `/v3/projects/01766d6380134193b8f8c77e1370b9d6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:00.761168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4890f2-a4db-42ca-b4c3-877258e957e8 None admin] RBAC: Authorizing `identity:get_project(project_id=01766d6380134193b8f8c77e1370b9d6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:00.762633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4890f2-a4db-42ca-b4c3-877258e957e8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:00.764398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 564/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:15:00 2022] GET /identity/v3/projects/01766d6380134193b8f8c77e1370b9d6 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:15:00.771533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4eb93-372a-4481-9f17-1d0025d54fa4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:00.884634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4eb93-372a-4481-9f17-1d0025d54fa4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:00.904837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:00.926344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9bdc7-1885-4afd-9101-612e9043382b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:00.927020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9bdc7-1885-4afd-9101-612e9043382b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:00.927303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9bdc7-1885-4afd-9101-612e9043382b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:00.927579 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9bdc7-1885-4afd-9101-612e9043382b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:00.928429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9bdc7-1885-4afd-9101-612e9043382b None admin] RBAC: Adding query filter params (role.id=cbcda598469c41f19a1d3109e5d4c236, scope.project.id=01766d6380134193b8f8c77e1370b9d6, user.id=0f419079d27a44fd90060f60e6f626c8) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:00.928777 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9bdc7-1885-4afd-9101-612e9043382b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:00.930256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9bdc7-1885-4afd-9101-612e9043382b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:00.937432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 566/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:15:00 2022] GET /identity/v3/role_assignments?user.id=0f419079d27a44fd90060f60e6f626c8&scope.project.id=01766d6380134193b8f8c77e1370b9d6&role.id=cbcda598469c41f19a1d3109e5d4c236 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:15:03.100211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0c4b1-967b-4be4-860d-ced751e0b3c3 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:03.100886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0c4b1-967b-4be4-860d-ced751e0b3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:03.100886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0c4b1-967b-4be4-860d-ced751e0b3c3 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:03.102244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 565/1131] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:03.109878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a221f66-9379-41d9-9f3a-5700994c8894 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:03.110486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a221f66-9379-41d9-9f3a-5700994c8894 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:03.110898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a221f66-9379-41d9-9f3a-5700994c8894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:03.139747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6a221f66-9379-41d9-9f3a-5700994c8894 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:03.141975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6a221f66-9379-41d9-9f3a-5700994c8894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:03.266816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 567/1132] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:15:03.309573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0c4b1-967b-4be4-860d-ced751e0b3c3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:03.433906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0c4b1-967b-4be4-860d-ced751e0b3c3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:03.472332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41946b3a-1be5-479c-86c6-2f6d2cf66553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:03.473152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41946b3a-1be5-479c-86c6-2f6d2cf66553 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:03.473425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41946b3a-1be5-479c-86c6-2f6d2cf66553 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:03.473696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41946b3a-1be5-479c-86c6-2f6d2cf66553 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:03.474936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41946b3a-1be5-479c-86c6-2f6d2cf66553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:03.476423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41946b3a-1be5-479c-86c6-2f6d2cf66553 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:03.478155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 566/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:03.484552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a221f66-9379-41d9-9f3a-5700994c8894 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:03.601862 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a221f66-9379-41d9-9f3a-5700994c8894 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:03.615411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:03.645085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064160a-f669-41e1-b80d-73f90d4e2c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:03.645777 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064160a-f669-41e1-b80d-73f90d4e2c1d None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:03.646065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064160a-f669-41e1-b80d-73f90d4e2c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:03.646487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064160a-f669-41e1-b80d-73f90d4e2c1d None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:03.647224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064160a-f669-41e1-b80d-73f90d4e2c1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:03.648753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064160a-f669-41e1-b80d-73f90d4e2c1d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:03.678803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 568/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:15:03 2022] POST /identity/v3/projects => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:15:05.849283 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5917e2-38e5-45ea-90c4-2e5c3b13ab92 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:05.849972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5917e2-38e5-45ea-90c4-2e5c3b13ab92 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:05.849972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5917e2-38e5-45ea-90c4-2e5c3b13ab92 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:05.851228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 567/1135] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:05.857648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57165484-033b-4145-adb0-8f42897748cc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:05.858289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57165484-033b-4145-adb0-8f42897748cc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:05.858289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57165484-033b-4145-adb0-8f42897748cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:05.878922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-57165484-033b-4145-adb0-8f42897748cc None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:05.880170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-57165484-033b-4145-adb0-8f42897748cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:05.957845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 569/1136] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:15:05.983639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5917e2-38e5-45ea-90c4-2e5c3b13ab92 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:06.016726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:06.107320 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5917e2-38e5-45ea-90c4-2e5c3b13ab92 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:06.154649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f101c7f-f731-4431-a164-5371b3d6d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:06.155979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f101c7f-f731-4431-a164-5371b3d6d250 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:06.156607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f101c7f-f731-4431-a164-5371b3d6d250 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:06.157122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f101c7f-f731-4431-a164-5371b3d6d250 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:06.159337 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f101c7f-f731-4431-a164-5371b3d6d250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:06.162007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f101c7f-f731-4431-a164-5371b3d6d250 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:06.165057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 568/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:15:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:06.174510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57165484-033b-4145-adb0-8f42897748cc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:06.338763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:06.350353 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57165484-033b-4145-adb0-8f42897748cc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:06.392175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b525c3b-0951-4d42-8f29-592adf84729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:06.392832 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b525c3b-0951-4d42-8f29-592adf84729a None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:06.393109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b525c3b-0951-4d42-8f29-592adf84729a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:06.393377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b525c3b-0951-4d42-8f29-592adf84729a None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:06.394481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b525c3b-0951-4d42-8f29-592adf84729a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:06.395986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b525c3b-0951-4d42-8f29-592adf84729a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:06.419518 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 570/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:15:06 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:15:08.606515 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916c64-49fb-41ee-8acf-4d9894e9164a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:08.607104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916c64-49fb-41ee-8acf-4d9894e9164a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:08.607104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916c64-49fb-41ee-8acf-4d9894e9164a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:08.608369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 569/1139] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:08.614627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adab043-51ca-4775-b06e-c65d9f32e31f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:08.615445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adab043-51ca-4775-b06e-c65d9f32e31f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:08.615445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adab043-51ca-4775-b06e-c65d9f32e31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:08.634312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4adab043-51ca-4775-b06e-c65d9f32e31f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:08.635606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4adab043-51ca-4775-b06e-c65d9f32e31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:08.715345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 571/1140] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:15:08.738846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916c64-49fb-41ee-8acf-4d9894e9164a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:08.853026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:08.861868 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916c64-49fb-41ee-8acf-4d9894e9164a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:08.900158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67275-4d9c-4214-b9a8-438e5e8156d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:08.901029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67275-4d9c-4214-b9a8-438e5e8156d5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:08.901306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67275-4d9c-4214-b9a8-438e5e8156d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:08.901576 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67275-4d9c-4214-b9a8-438e5e8156d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:08.913490 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db67275-4d9c-4214-b9a8-438e5e8156d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1db67275-4d9c-4214-b9a8-438e5e8156d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:15:08.921195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:15:08.922478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:15:08.924541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:15:08.924541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:15:08.924541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:15:08.924541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:15:08.924541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:15:08.924541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:15:08.924541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:15:08.924541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:15:08.924541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:15:08.924541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:15:08.924541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:08.924541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:15:08.927905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 570/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:15:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:15:08.929195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adab043-51ca-4775-b06e-c65d9f32e31f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:09.013058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:09.039425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adab043-51ca-4775-b06e-c65d9f32e31f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:09.081465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fc186-4416-49d7-a7f8-07afe8cd1c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:09.082151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fc186-4416-49d7-a7f8-07afe8cd1c75 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:09.082428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fc186-4416-49d7-a7f8-07afe8cd1c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:09.082696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fc186-4416-49d7-a7f8-07afe8cd1c75 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:09.083464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fc186-4416-49d7-a7f8-07afe8cd1c75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:09.083767 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fc186-4416-49d7-a7f8-07afe8cd1c75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:09.085267 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fc186-4416-49d7-a7f8-07afe8cd1c75 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:09.095596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 572/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:15:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:09.101723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67275-4d9c-4214-b9a8-438e5e8156d5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:09.217952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67275-4d9c-4214-b9a8-438e5e8156d5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:09.255801 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c4c59-af40-4d36-a703-0148cba9b2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:09.256726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c4c59-af40-4d36-a703-0148cba9b2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:09.257004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c4c59-af40-4d36-a703-0148cba9b2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:09.257275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c4c59-af40-4d36-a703-0148cba9b2f8 None admin] PATH_INFO: `/v3/users/d99c5fe2bd45437480b258a5ee157c5b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:09.274339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c4c59-af40-4d36-a703-0148cba9b2f8 None admin] RBAC: Authorizing `identity:get_user(user_id=d99c5fe2bd45437480b258a5ee157c5b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:09.275826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c4c59-af40-4d36-a703-0148cba9b2f8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:09.277669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 571/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:15:09 2022] GET /identity/v3/users/d99c5fe2bd45437480b258a5ee157c5b => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:09.284338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fc186-4416-49d7-a7f8-07afe8cd1c75 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:09.412075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fc186-4416-49d7-a7f8-07afe8cd1c75 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:09.452861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1706db-583d-4d76-b680-77470fb310dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:09.453562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1706db-583d-4d76-b680-77470fb310dd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:09.453839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1706db-583d-4d76-b680-77470fb310dd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:09.454119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1706db-583d-4d76-b680-77470fb310dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:09.466811 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:09.541546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1706db-583d-4d76-b680-77470fb310dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:09.543010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1706db-583d-4d76-b680-77470fb310dd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:09.659295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 573/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:15:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:15:09.665589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c4c59-af40-4d36-a703-0148cba9b2f8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:09.684014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:09.782842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c4c59-af40-4d36-a703-0148cba9b2f8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:09.822393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab4887-2359-4c60-93c2-ef09b7c62c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:09.823817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab4887-2359-4c60-93c2-ef09b7c62c72 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:09.824137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab4887-2359-4c60-93c2-ef09b7c62c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:09.824408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab4887-2359-4c60-93c2-ef09b7c62c72 None admin] PATH_INFO: `/v3/projects/cbde8f5dca874ecaa972ca3932e6f66e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:09.825835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab4887-2359-4c60-93c2-ef09b7c62c72 None admin] RBAC: Authorizing `identity:get_project(project_id=cbde8f5dca874ecaa972ca3932e6f66e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:09.827324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab4887-2359-4c60-93c2-ef09b7c62c72 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:09.830349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 572/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:15:09 2022] GET /identity/v3/projects/cbde8f5dca874ecaa972ca3932e6f66e => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:09.839087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1706db-583d-4d76-b680-77470fb310dd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:09.889965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:09.958482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1706db-583d-4d76-b680-77470fb310dd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:09.997984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d5d3c-db87-4707-9a8b-0f0e7621bcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:09.998663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5d3c-db87-4707-9a8b-0f0e7621bcee None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:09.998944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5d3c-db87-4707-9a8b-0f0e7621bcee None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:09.999197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5d3c-db87-4707-9a8b-0f0e7621bcee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:10.000079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5d3c-db87-4707-9a8b-0f0e7621bcee None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=cbde8f5dca874ecaa972ca3932e6f66e, user.id=d99c5fe2bd45437480b258a5ee157c5b) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:10.000386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5d3c-db87-4707-9a8b-0f0e7621bcee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:10.001912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5d3c-db87-4707-9a8b-0f0e7621bcee None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:10.008602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 574/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:15:09 2022] GET /identity/v3/role_assignments?user.id=d99c5fe2bd45437480b258a5ee157c5b&scope.project.id=cbde8f5dca874ecaa972ca3932e6f66e&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:12.108127 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f2805-ec8a-49eb-aef4-eb6fbf5a4ddb None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:12.108795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f2805-ec8a-49eb-aef4-eb6fbf5a4ddb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:12.108795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f2805-ec8a-49eb-aef4-eb6fbf5a4ddb None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:12.110563 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 573/1147] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:12.116701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71172a6-6a2b-4697-bfc1-91290c87494a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:12.117311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71172a6-6a2b-4697-bfc1-91290c87494a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:12.117311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71172a6-6a2b-4697-bfc1-91290c87494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:12.144641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f71172a6-6a2b-4697-bfc1-91290c87494a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:12.145973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f71172a6-6a2b-4697-bfc1-91290c87494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:12.224818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 575/1148] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:15:12.248641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f2805-ec8a-49eb-aef4-eb6fbf5a4ddb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:12.357823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:12.381211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f2805-ec8a-49eb-aef4-eb6fbf5a4ddb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:12.423449 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cbc53-b94b-48fa-b99d-0e44dcedaeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:12.424419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cbc53-b94b-48fa-b99d-0e44dcedaeef None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:12.424855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cbc53-b94b-48fa-b99d-0e44dcedaeef None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:12.425228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cbc53-b94b-48fa-b99d-0e44dcedaeef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:12.438377 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cbc53-b94b-48fa-b99d-0e44dcedaeef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-bd5cbc53-b94b-48fa-b99d-0e44dcedaeef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:15:12.446748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:15:12.447958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:15:12.448928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 574/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:15:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:15:12.457937 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71172a6-6a2b-4697-bfc1-91290c87494a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:12.499058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:12.574759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71172a6-6a2b-4697-bfc1-91290c87494a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:12.615335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a49cf-9f18-41fa-96d6-588c6243a52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:12.616037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a49cf-9f18-41fa-96d6-588c6243a52b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:12.616323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a49cf-9f18-41fa-96d6-588c6243a52b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:12.616632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a49cf-9f18-41fa-96d6-588c6243a52b None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:12.617412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a49cf-9f18-41fa-96d6-588c6243a52b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:12.617723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a49cf-9f18-41fa-96d6-588c6243a52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:12.619152 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a49cf-9f18-41fa-96d6-588c6243a52b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:12.629626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 576/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:15:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:12.636263 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cbc53-b94b-48fa-b99d-0e44dcedaeef None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:12.750261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cbc53-b94b-48fa-b99d-0e44dcedaeef None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:12.787750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43b6aa-5872-4dd9-836d-e4d57e3a637a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:12.788675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b6aa-5872-4dd9-836d-e4d57e3a637a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:12.788950 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b6aa-5872-4dd9-836d-e4d57e3a637a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:12.789215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b6aa-5872-4dd9-836d-e4d57e3a637a None admin] PATH_INFO: `/v3/users/d99c5fe2bd45437480b258a5ee157c5b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:12.790491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43b6aa-5872-4dd9-836d-e4d57e3a637a None admin] RBAC: Authorizing `identity:get_user(user_id=d99c5fe2bd45437480b258a5ee157c5b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:12.791963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43b6aa-5872-4dd9-836d-e4d57e3a637a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:12.793730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 575/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:15:12 2022] GET /identity/v3/users/d99c5fe2bd45437480b258a5ee157c5b => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:12.800053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a49cf-9f18-41fa-96d6-588c6243a52b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:12.908470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:12.914819 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a49cf-9f18-41fa-96d6-588c6243a52b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:12.952404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27284cda-fda0-4a13-96f4-ba37b8beddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:12.953454 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27284cda-fda0-4a13-96f4-ba37b8beddee None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:12.953728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27284cda-fda0-4a13-96f4-ba37b8beddee None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:12.953995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27284cda-fda0-4a13-96f4-ba37b8beddee None admin] PATH_INFO: `/v3/projects/cbde8f5dca874ecaa972ca3932e6f66e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:12.955323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27284cda-fda0-4a13-96f4-ba37b8beddee None admin] RBAC: Authorizing `identity:get_project(project_id=cbde8f5dca874ecaa972ca3932e6f66e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:12.956851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27284cda-fda0-4a13-96f4-ba37b8beddee None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:12.958672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 577/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:15:12 2022] GET /identity/v3/projects/cbde8f5dca874ecaa972ca3932e6f66e => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:12.965647 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43b6aa-5872-4dd9-836d-e4d57e3a637a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:12.980836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:13.084694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43b6aa-5872-4dd9-836d-e4d57e3a637a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:13.123540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86591c63-70c0-44ab-b1ee-f19c43083974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:13.124531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86591c63-70c0-44ab-b1ee-f19c43083974 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:13.124869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86591c63-70c0-44ab-b1ee-f19c43083974 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:13.125148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86591c63-70c0-44ab-b1ee-f19c43083974 None admin] PATH_INFO: `/v3/projects/cbde8f5dca874ecaa972ca3932e6f66e/users/d99c5fe2bd45437480b258a5ee157c5b/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:13.127246 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86591c63-70c0-44ab-b1ee-f19c43083974 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbde8f5dca874ecaa972ca3932e6f66e, user_id=d99c5fe2bd45437480b258a5ee157c5b, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:13.128783 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86591c63-70c0-44ab-b1ee-f19c43083974 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:13.149166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 576/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:15:12 2022] PUT /identity/v3/projects/cbde8f5dca874ecaa972ca3932e6f66e/users/d99c5fe2bd45437480b258a5ee157c5b/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:15:15.242133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26e06-40a5-4822-9b94-a9386728719d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:15.242838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26e06-40a5-4822-9b94-a9386728719d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:15.242838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26e06-40a5-4822-9b94-a9386728719d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:15.244065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 578/1154] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:15.251171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d1d09-63dc-4000-93b9-17f0239e0cee None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:15.251892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d1d09-63dc-4000-93b9-17f0239e0cee None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:15.251892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d1d09-63dc-4000-93b9-17f0239e0cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:15.279569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-436d1d09-63dc-4000-93b9-17f0239e0cee None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:15.281139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-436d1d09-63dc-4000-93b9-17f0239e0cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:15.359277 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:15.367578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 577/1155] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:15:15.391667 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26e06-40a5-4822-9b94-a9386728719d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:15.508727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26e06-40a5-4822-9b94-a9386728719d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:15.547532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8912b8-70f4-49bd-97a3-1095d2883c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:15.548648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8912b8-70f4-49bd-97a3-1095d2883c43 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:15.548930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8912b8-70f4-49bd-97a3-1095d2883c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:15.549202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8912b8-70f4-49bd-97a3-1095d2883c43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:15.563893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8912b8-70f4-49bd-97a3-1095d2883c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0d8912b8-70f4-49bd-97a3-1095d2883c43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:15:15.571839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:15:15.573728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:15:15.575319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:15:15.575319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:15:15.575319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:15:15.575319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:15:15.575319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:15:15.575319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:15:15.575319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:15:15.575319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:15:15.575319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:15:15.575319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:15:15.575319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:15.575319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:15:15.578398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 579/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:15:15.579564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d1d09-63dc-4000-93b9-17f0239e0cee None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:15.704736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d1d09-63dc-4000-93b9-17f0239e0cee None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:15.744164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4b8ab-35c3-40fc-97f4-7c8d33e27fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:15.744885 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4b8ab-35c3-40fc-97f4-7c8d33e27fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:15.745168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4b8ab-35c3-40fc-97f4-7c8d33e27fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:15.745443 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4b8ab-35c3-40fc-97f4-7c8d33e27fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:15.746223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4b8ab-35c3-40fc-97f4-7c8d33e27fb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:15.746533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4b8ab-35c3-40fc-97f4-7c8d33e27fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:15.747945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4b8ab-35c3-40fc-97f4-7c8d33e27fb4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:15.758378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 578/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:15.764924 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8912b8-70f4-49bd-97a3-1095d2883c43 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:15.794585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:15.881011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8912b8-70f4-49bd-97a3-1095d2883c43 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:15.922730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95ff62-8cd8-4ce3-9f25-87b37495430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:15.923629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95ff62-8cd8-4ce3-9f25-87b37495430d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:15.923906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95ff62-8cd8-4ce3-9f25-87b37495430d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:15.924179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95ff62-8cd8-4ce3-9f25-87b37495430d None admin] PATH_INFO: `/v3/users/d99c5fe2bd45437480b258a5ee157c5b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:15.925506 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95ff62-8cd8-4ce3-9f25-87b37495430d None admin] RBAC: Authorizing `identity:get_user(user_id=d99c5fe2bd45437480b258a5ee157c5b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:15.926985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95ff62-8cd8-4ce3-9f25-87b37495430d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:15.928761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 580/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:15:15 2022] GET /identity/v3/users/d99c5fe2bd45437480b258a5ee157c5b => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:15.935257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4b8ab-35c3-40fc-97f4-7c8d33e27fb4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:16.008701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:16.056001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4b8ab-35c3-40fc-97f4-7c8d33e27fb4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:16.095065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b89d1d-aae0-445e-93ff-434385fe3eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:16.095742 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b89d1d-aae0-445e-93ff-434385fe3eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:16.096022 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b89d1d-aae0-445e-93ff-434385fe3eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:16.096295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b89d1d-aae0-445e-93ff-434385fe3eb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:16.179811 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b89d1d-aae0-445e-93ff-434385fe3eb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:16.182649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b89d1d-aae0-445e-93ff-434385fe3eb0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:16.272192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:16.324308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 579/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:15:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:15:16.330916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95ff62-8cd8-4ce3-9f25-87b37495430d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:16.441620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:16.453424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95ff62-8cd8-4ce3-9f25-87b37495430d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:16.492421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c0d57-fb09-4c05-a543-ed546019f1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:16.493415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c0d57-fb09-4c05-a543-ed546019f1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:16.493735 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c0d57-fb09-4c05-a543-ed546019f1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:16.494041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c0d57-fb09-4c05-a543-ed546019f1e7 None admin] PATH_INFO: `/v3/projects/cbde8f5dca874ecaa972ca3932e6f66e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:16.495362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c0d57-fb09-4c05-a543-ed546019f1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=cbde8f5dca874ecaa972ca3932e6f66e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:16.496992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c0d57-fb09-4c05-a543-ed546019f1e7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:16.498871 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 581/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:15:16 2022] GET /identity/v3/projects/cbde8f5dca874ecaa972ca3932e6f66e => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:16.505673 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b89d1d-aae0-445e-93ff-434385fe3eb0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:16.615701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b89d1d-aae0-445e-93ff-434385fe3eb0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:16.651595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af0ee8-d41a-4901-a98d-298c09334226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:16.652267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af0ee8-d41a-4901-a98d-298c09334226 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:16.652569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af0ee8-d41a-4901-a98d-298c09334226 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:16.652839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af0ee8-d41a-4901-a98d-298c09334226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:16.653683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af0ee8-d41a-4901-a98d-298c09334226 None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=cbde8f5dca874ecaa972ca3932e6f66e, user.id=d99c5fe2bd45437480b258a5ee157c5b) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:16.653998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af0ee8-d41a-4901-a98d-298c09334226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:16.655475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af0ee8-d41a-4901-a98d-298c09334226 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:16.662268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 580/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:15:16 2022] GET /identity/v3/role_assignments?user.id=d99c5fe2bd45437480b258a5ee157c5b&scope.project.id=cbde8f5dca874ecaa972ca3932e6f66e&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:18.864282 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cdcab-0e14-4244-9ae2-456e1683640a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:18.864987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cdcab-0e14-4244-9ae2-456e1683640a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:18.865134 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cdcab-0e14-4244-9ae2-456e1683640a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:18.866580 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 582/1162] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:18.872825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb843750-f3d4-42b2-97d3-ef35013d048d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:18.873500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb843750-f3d4-42b2-97d3-ef35013d048d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:18.873500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb843750-f3d4-42b2-97d3-ef35013d048d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:18.892696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bb843750-f3d4-42b2-97d3-ef35013d048d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:18.894300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bb843750-f3d4-42b2-97d3-ef35013d048d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:18.917616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:18.986952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 581/1163] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:15:19.010682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cdcab-0e14-4244-9ae2-456e1683640a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:19.209979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cdcab-0e14-4244-9ae2-456e1683640a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:19.272799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdccdec-e2ec-47af-ada0-4c3cc45ea1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:19.273936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdccdec-e2ec-47af-ada0-4c3cc45ea1bc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:19.274449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdccdec-e2ec-47af-ada0-4c3cc45ea1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:19.274960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdccdec-e2ec-47af-ada0-4c3cc45ea1bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:19.327418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:19.373095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdccdec-e2ec-47af-ada0-4c3cc45ea1bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:19.374814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdccdec-e2ec-47af-ada0-4c3cc45ea1bc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:19.492933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 583/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:15:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:15:19.499233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb843750-f3d4-42b2-97d3-ef35013d048d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:19.621954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb843750-f3d4-42b2-97d3-ef35013d048d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:19.660891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabe7cf-85fb-4879-9312-36d239e41840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:19.661727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabe7cf-85fb-4879-9312-36d239e41840 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:19.662006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabe7cf-85fb-4879-9312-36d239e41840 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:19.662279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabe7cf-85fb-4879-9312-36d239e41840 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:19.670202 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabe7cf-85fb-4879-9312-36d239e41840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:19.671753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabe7cf-85fb-4879-9312-36d239e41840 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-9fabe7cf-85fb-4879-9312-36d239e41840 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:15:19.687091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:15:19.688389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:15:19.689383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 582/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 21 08:15:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:15:19.698459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdccdec-e2ec-47af-ada0-4c3cc45ea1bc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:19.790203 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:19.842854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdccdec-e2ec-47af-ada0-4c3cc45ea1bc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:19.880038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dff26-5827-4b74-8eb4-1f62c2291db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:19.880769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dff26-5827-4b74-8eb4-1f62c2291db1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:19.881162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dff26-5827-4b74-8eb4-1f62c2291db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:19.881486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dff26-5827-4b74-8eb4-1f62c2291db1 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:19.882268 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8dff26-5827-4b74-8eb4-1f62c2291db1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:19.882606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8dff26-5827-4b74-8eb4-1f62c2291db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:19.884047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8dff26-5827-4b74-8eb4-1f62c2291db1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:19.892533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 584/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 21 08:15:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:22.039341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26cd8c-e014-4d0c-acd2-e07bdf4ba9ac None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:22.039965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26cd8c-e014-4d0c-acd2-e07bdf4ba9ac None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:22.039965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26cd8c-e014-4d0c-acd2-e07bdf4ba9ac None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:22.041542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 583/1167] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:22.047969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573a7ab-b23d-4e47-bac2-0d4ac2bce9f5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:22.048597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573a7ab-b23d-4e47-bac2-0d4ac2bce9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:22.048597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573a7ab-b23d-4e47-bac2-0d4ac2bce9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:22.067392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5573a7ab-b23d-4e47-bac2-0d4ac2bce9f5 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:22.068683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5573a7ab-b23d-4e47-bac2-0d4ac2bce9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:22.149237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 585/1168] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:15:22.173274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26cd8c-e014-4d0c-acd2-e07bdf4ba9ac None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:22.194873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:22.300037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26cd8c-e014-4d0c-acd2-e07bdf4ba9ac None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:22.340824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7f108-6dec-40ba-a0f2-f80247f71d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:22.341539 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7f108-6dec-40ba-a0f2-f80247f71d5a None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:22.341819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7f108-6dec-40ba-a0f2-f80247f71d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:22.342092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7f108-6dec-40ba-a0f2-f80247f71d5a None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:22.342848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7f108-6dec-40ba-a0f2-f80247f71d5a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:22.344436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7f108-6dec-40ba-a0f2-f80247f71d5a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:22.362987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 584/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Thu Jul 21 08:15:22 2022] POST /identity/v3/domains => generated 267 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:15:24.493683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c65faa-b08b-4700-af1c-05037bd261e2 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:24.494313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c65faa-b08b-4700-af1c-05037bd261e2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:24.494436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c65faa-b08b-4700-af1c-05037bd261e2 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:24.496040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 586/1170] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:24.507026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f805e6-ec65-470a-bd16-9e284ea3940c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:24.507574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f805e6-ec65-470a-bd16-9e284ea3940c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:24.507574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f805e6-ec65-470a-bd16-9e284ea3940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:24.526102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-01f805e6-ec65-470a-bd16-9e284ea3940c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:24.527404 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-01f805e6-ec65-470a-bd16-9e284ea3940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:24.602693 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 585/1171] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:15:24.626813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c65faa-b08b-4700-af1c-05037bd261e2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:24.695189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:24.744011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c65faa-b08b-4700-af1c-05037bd261e2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:24.783165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b889c-d03e-45e7-92b7-386d68f5831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:24.784067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b889c-d03e-45e7-92b7-386d68f5831d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:24.784346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b889c-d03e-45e7-92b7-386d68f5831d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:24.784649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b889c-d03e-45e7-92b7-386d68f5831d None admin] PATH_INFO: `/v3/domains/6a2d932e3d3743b79732bfa96962799c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:24.797214 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b889c-d03e-45e7-92b7-386d68f5831d None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a2d932e3d3743b79732bfa96962799c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:24.798717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b889c-d03e-45e7-92b7-386d68f5831d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:24.800529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 587/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Thu Jul 21 08:15:24 2022] GET /identity/v3/domains/6a2d932e3d3743b79732bfa96962799c => generated 267 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:24.806937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f805e6-ec65-470a-bd16-9e284ea3940c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:24.815800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:24.914333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f805e6-ec65-470a-bd16-9e284ea3940c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:24.951031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a88ea4-0d5c-4b8d-9565-6ba9b76ccebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:24.951703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a88ea4-0d5c-4b8d-9565-6ba9b76ccebc None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:24.951975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a88ea4-0d5c-4b8d-9565-6ba9b76ccebc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:24.952241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a88ea4-0d5c-4b8d-9565-6ba9b76ccebc None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:24.953051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a88ea4-0d5c-4b8d-9565-6ba9b76ccebc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:24.954503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a88ea4-0d5c-4b8d-9565-6ba9b76ccebc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:24.983433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 586/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:15:24 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:15:27.093387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27ea06-1359-488c-8dc5-266a20a0b81e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:27.094215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27ea06-1359-488c-8dc5-266a20a0b81e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:27.094215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27ea06-1359-488c-8dc5-266a20a0b81e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:27.095396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 588/1174] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:27.101622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcec842-9bff-4be1-a0c7-2fa0d88fc114 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:27.102210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcec842-9bff-4be1-a0c7-2fa0d88fc114 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:27.102210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcec842-9bff-4be1-a0c7-2fa0d88fc114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:27.121541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3bcec842-9bff-4be1-a0c7-2fa0d88fc114 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:27.122889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3bcec842-9bff-4be1-a0c7-2fa0d88fc114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:27.186227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:27.202873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 587/1175] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:15:27.228950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27ea06-1359-488c-8dc5-266a20a0b81e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:27.353140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27ea06-1359-488c-8dc5-266a20a0b81e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:27.369987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:27.392668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc26964-af30-4b52-a02b-02b448d6c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:27.394101 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc26964-af30-4b52-a02b-02b448d6c3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:27.394387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc26964-af30-4b52-a02b-02b448d6c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:27.394665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc26964-af30-4b52-a02b-02b448d6c3f4 None admin] PATH_INFO: `/v3/domains/6a2d932e3d3743b79732bfa96962799c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:27.396019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc26964-af30-4b52-a02b-02b448d6c3f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a2d932e3d3743b79732bfa96962799c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:27.397533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc26964-af30-4b52-a02b-02b448d6c3f4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:27.399259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 589/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Thu Jul 21 08:15:27 2022] GET /identity/v3/domains/6a2d932e3d3743b79732bfa96962799c => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:27.405665 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcec842-9bff-4be1-a0c7-2fa0d88fc114 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:27.515497 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcec842-9bff-4be1-a0c7-2fa0d88fc114 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:27.554497 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f58f2-b3ab-4f44-9e65-40d6c3b69d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:27.555556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f58f2-b3ab-4f44-9e65-40d6c3b69d45 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:27.555896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f58f2-b3ab-4f44-9e65-40d6c3b69d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:27.556261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f58f2-b3ab-4f44-9e65-40d6c3b69d45 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:27.557387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f58f2-b3ab-4f44-9e65-40d6c3b69d45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:27.559220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f58f2-b3ab-4f44-9e65-40d6c3b69d45 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:27.584909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 588/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:15:27 2022] POST /identity/v3/users => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:15:29.759771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a207e-86fe-4fc9-8315-5c0b2a77d1ec None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:29.760371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a207e-86fe-4fc9-8315-5c0b2a77d1ec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:29.760371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a207e-86fe-4fc9-8315-5c0b2a77d1ec None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:29.761913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 590/1178] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:15:29.771075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8b131-f7ec-4485-85c7-b43917808d10 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:29.771713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8b131-f7ec-4485-85c7-b43917808d10 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:29.771713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8b131-f7ec-4485-85c7-b43917808d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:29.791665 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-44d8b131-f7ec-4485-85c7-b43917808d10 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:29.792985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-44d8b131-f7ec-4485-85c7-b43917808d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:29.847846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:29.882228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 589/1179] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:15:29.906884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a207e-86fe-4fc9-8315-5c0b2a77d1ec None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:30.033972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a207e-86fe-4fc9-8315-5c0b2a77d1ec None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:30.079411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52f361-93a0-4168-bc83-41f5bbe717d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:30.080799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52f361-93a0-4168-bc83-41f5bbe717d5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:30.081285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52f361-93a0-4168-bc83-41f5bbe717d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:30.081779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52f361-93a0-4168-bc83-41f5bbe717d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:30.102837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52f361-93a0-4168-bc83-41f5bbe717d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4a52f361-93a0-4168-bc83-41f5bbe717d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:15:30.118338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:15:30.119609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:15:30.120943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 591/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:15:30.127585 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8b131-f7ec-4485-85c7-b43917808d10 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:30.247375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8b131-f7ec-4485-85c7-b43917808d10 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:30.291812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0c163-d3de-41c1-badb-29ec77e36ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:30.292795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0c163-d3de-41c1-badb-29ec77e36ccd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:30.293115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0c163-d3de-41c1-badb-29ec77e36ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:30.293374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0c163-d3de-41c1-badb-29ec77e36ccd None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:30.294243 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0c163-d3de-41c1-badb-29ec77e36ccd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:30.294654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0c163-d3de-41c1-badb-29ec77e36ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:30.296129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0c163-d3de-41c1-badb-29ec77e36ccd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:30.306445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 590/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:15:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:30.312976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52f361-93a0-4168-bc83-41f5bbe717d5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:30.370715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:30.438841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52f361-93a0-4168-bc83-41f5bbe717d5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:30.477062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3ce41-0651-4fec-abb6-54b7644a789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:30.478041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3ce41-0651-4fec-abb6-54b7644a789e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:30.478375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3ce41-0651-4fec-abb6-54b7644a789e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:30.478700 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3ce41-0651-4fec-abb6-54b7644a789e None admin] PATH_INFO: `/v3/users/1d8ab15551ee4b19bd4197c9744afd59` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:30.494614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3ce41-0651-4fec-abb6-54b7644a789e None admin] RBAC: Authorizing `identity:get_user(user_id=1d8ab15551ee4b19bd4197c9744afd59)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:30.496198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3ce41-0651-4fec-abb6-54b7644a789e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:30.498200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 592/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:15:30 2022] GET /identity/v3/users/1d8ab15551ee4b19bd4197c9744afd59 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:30.504828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0c163-d3de-41c1-badb-29ec77e36ccd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:30.549849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:30.662272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0c163-d3de-41c1-badb-29ec77e36ccd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:30.714360 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6898ac7-2f3b-4933-8fb1-8f5f1775f2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:30.715044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6898ac7-2f3b-4933-8fb1-8f5f1775f2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:30.715318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6898ac7-2f3b-4933-8fb1-8f5f1775f2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:30.715589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6898ac7-2f3b-4933-8fb1-8f5f1775f2d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:30.799743 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6898ac7-2f3b-4933-8fb1-8f5f1775f2d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:30.801382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6898ac7-2f3b-4933-8fb1-8f5f1775f2d3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:30.840645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:30.918605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 591/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:15:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:15:30.928094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3ce41-0651-4fec-abb6-54b7644a789e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:31.039054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:31.042127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3ce41-0651-4fec-abb6-54b7644a789e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:31.080964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867c7e7-5a4b-425a-aecc-b19fae644376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:31.081757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c7e7-5a4b-425a-aecc-b19fae644376 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:31.082030 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c7e7-5a4b-425a-aecc-b19fae644376 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:31.082300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c7e7-5a4b-425a-aecc-b19fae644376 None admin] PATH_INFO: `/v3/projects/2c7a60385bd843b78ce37b8c126e392b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:31.083614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c7e7-5a4b-425a-aecc-b19fae644376 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7a60385bd843b78ce37b8c126e392b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:31.085141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c7e7-5a4b-425a-aecc-b19fae644376 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:31.086904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 593/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:15:30 2022] GET /identity/v3/projects/2c7a60385bd843b78ce37b8c126e392b => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:31.093653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6898ac7-2f3b-4933-8fb1-8f5f1775f2d3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:31.215900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6898ac7-2f3b-4933-8fb1-8f5f1775f2d3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:31.256960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a65f47-4bbb-43e4-af3c-d594bb0bef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:31.257685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65f47-4bbb-43e4-af3c-d594bb0bef8f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:31.257968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65f47-4bbb-43e4-af3c-d594bb0bef8f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:31.258381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65f47-4bbb-43e4-af3c-d594bb0bef8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:31.259256 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65f47-4bbb-43e4-af3c-d594bb0bef8f None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=2c7a60385bd843b78ce37b8c126e392b, user.id=1d8ab15551ee4b19bd4197c9744afd59) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:31.259571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65f47-4bbb-43e4-af3c-d594bb0bef8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:31.261157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65f47-4bbb-43e4-af3c-d594bb0bef8f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:31.264774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:31.269613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 592/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:15:31 2022] GET /identity/v3/role_assignments?user.id=1d8ab15551ee4b19bd4197c9744afd59&scope.project.id=2c7a60385bd843b78ce37b8c126e392b&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:33.457203 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580953d6-9a77-4e18-a104-ddd88ab381d8 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:33.458120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580953d6-9a77-4e18-a104-ddd88ab381d8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:33.458120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580953d6-9a77-4e18-a104-ddd88ab381d8 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:33.459869 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 594/1186] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:33.466712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54fa0-f41b-41e9-ab15-a33508109577 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:33.467609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54fa0-f41b-41e9-ab15-a33508109577 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:33.467609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54fa0-f41b-41e9-ab15-a33508109577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:33.487775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c3c54fa0-f41b-41e9-ab15-a33508109577 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:33.489092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c3c54fa0-f41b-41e9-ab15-a33508109577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:33.579095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 593/1187] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:15:33.602565 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580953d6-9a77-4e18-a104-ddd88ab381d8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:33.729562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580953d6-9a77-4e18-a104-ddd88ab381d8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:33.773497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6011de-db6a-4035-8a73-cd164f4e6dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:33.774323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6011de-db6a-4035-8a73-cd164f4e6dfc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:33.774597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6011de-db6a-4035-8a73-cd164f4e6dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:33.774874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6011de-db6a-4035-8a73-cd164f4e6dfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:33.788383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6011de-db6a-4035-8a73-cd164f4e6dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6c6011de-db6a-4035-8a73-cd164f4e6dfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:15:33.796463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:15:33.798382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:15:33.800362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 595/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:15:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:15:33.806651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c54fa0-f41b-41e9-ab15-a33508109577 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:33.961605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c54fa0-f41b-41e9-ab15-a33508109577 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:34.010076 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:34.016957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316e86f-6f62-45c4-a111-6829b1de371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:34.017675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316e86f-6f62-45c4-a111-6829b1de371e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:34.018308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316e86f-6f62-45c4-a111-6829b1de371e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:34.018593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316e86f-6f62-45c4-a111-6829b1de371e None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:34.019392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316e86f-6f62-45c4-a111-6829b1de371e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:34.019695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316e86f-6f62-45c4-a111-6829b1de371e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:34.021197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316e86f-6f62-45c4-a111-6829b1de371e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:34.032688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 594/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:15:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:34.039574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6011de-db6a-4035-8a73-cd164f4e6dfc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:34.077698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:34.162967 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6011de-db6a-4035-8a73-cd164f4e6dfc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:34.202370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3296c64-fffb-49d7-9082-dd04c5e7daaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:34.203272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3296c64-fffb-49d7-9082-dd04c5e7daaf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:34.203550 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3296c64-fffb-49d7-9082-dd04c5e7daaf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:34.203819 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3296c64-fffb-49d7-9082-dd04c5e7daaf None admin] PATH_INFO: `/v3/users/1d8ab15551ee4b19bd4197c9744afd59` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:34.205169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3296c64-fffb-49d7-9082-dd04c5e7daaf None admin] RBAC: Authorizing `identity:get_user(user_id=1d8ab15551ee4b19bd4197c9744afd59)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:34.206666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3296c64-fffb-49d7-9082-dd04c5e7daaf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:34.208414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 596/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:15:34 2022] GET /identity/v3/users/1d8ab15551ee4b19bd4197c9744afd59 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:34.214915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316e86f-6f62-45c4-a111-6829b1de371e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:34.336543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316e86f-6f62-45c4-a111-6829b1de371e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:34.375776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cb5e4-64dc-4e09-ba2a-0ebb00bfc774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:34.376702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cb5e4-64dc-4e09-ba2a-0ebb00bfc774 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:34.376980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cb5e4-64dc-4e09-ba2a-0ebb00bfc774 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:34.377251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cb5e4-64dc-4e09-ba2a-0ebb00bfc774 None admin] PATH_INFO: `/v3/projects/2c7a60385bd843b78ce37b8c126e392b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:34.378569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cb5e4-64dc-4e09-ba2a-0ebb00bfc774 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7a60385bd843b78ce37b8c126e392b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:34.380050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cb5e4-64dc-4e09-ba2a-0ebb00bfc774 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:34.381909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 595/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:15:34 2022] GET /identity/v3/projects/2c7a60385bd843b78ce37b8c126e392b => generated 361 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:34.388598 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3296c64-fffb-49d7-9082-dd04c5e7daaf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:34.503553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:34.511562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3296c64-fffb-49d7-9082-dd04c5e7daaf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:34.553316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a9d01-43fb-4dcd-95ed-c29d92f3e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:34.554240 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a9d01-43fb-4dcd-95ed-c29d92f3e615 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:34.554520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a9d01-43fb-4dcd-95ed-c29d92f3e615 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:34.554801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a9d01-43fb-4dcd-95ed-c29d92f3e615 None admin] PATH_INFO: `/v3/projects/2c7a60385bd843b78ce37b8c126e392b/users/1d8ab15551ee4b19bd4197c9744afd59/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:34.557047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a9d01-43fb-4dcd-95ed-c29d92f3e615 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c7a60385bd843b78ce37b8c126e392b, user_id=1d8ab15551ee4b19bd4197c9744afd59, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:34.558633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a9d01-43fb-4dcd-95ed-c29d92f3e615 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:34.574841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 597/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:15:34 2022] PUT /identity/v3/projects/2c7a60385bd843b78ce37b8c126e392b/users/1d8ab15551ee4b19bd4197c9744afd59/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:15:36.645629 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13456113-e646-42f7-9909-aa4ce87dd649 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:36.646212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13456113-e646-42f7-9909-aa4ce87dd649 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:36.646212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13456113-e646-42f7-9909-aa4ce87dd649 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:36.647497 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 596/1193] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:15:36.653618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1b284-8c54-423a-9c33-e1b55b491d72 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:36.654348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1b284-8c54-423a-9c33-e1b55b491d72 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:36.654348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1b284-8c54-423a-9c33-e1b55b491d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:36.672726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a7e1b284-8c54-423a-9c33-e1b55b491d72 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:15:36.673944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a7e1b284-8c54-423a-9c33-e1b55b491d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:15:36.747186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 598/1194] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:15:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:15:36.771860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13456113-e646-42f7-9909-aa4ce87dd649 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:36.836030 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:36.879692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13456113-e646-42f7-9909-aa4ce87dd649 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:36.917189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd1ae-94bf-4c77-be5e-065c7b6fd313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:36.917893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd1ae-94bf-4c77-be5e-065c7b6fd313 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:36.918165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd1ae-94bf-4c77-be5e-065c7b6fd313 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:36.918432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd1ae-94bf-4c77-be5e-065c7b6fd313 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:36.930858 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dd1ae-94bf-4c77-be5e-065c7b6fd313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-264dd1ae-94bf-4c77-be5e-065c7b6fd313 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:15:36.938685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:15:36.939996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:15:36.941349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 597/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:15:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:15:36.946304 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1b284-8c54-423a-9c33-e1b55b491d72 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:37.043617 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:37.069011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1b284-8c54-423a-9c33-e1b55b491d72 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:37.107497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0fbda-9315-4fe3-8fd1-37dfaf760b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:37.108281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0fbda-9315-4fe3-8fd1-37dfaf760b97 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:37.108600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0fbda-9315-4fe3-8fd1-37dfaf760b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:37.108870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0fbda-9315-4fe3-8fd1-37dfaf760b97 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:37.109993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0fbda-9315-4fe3-8fd1-37dfaf760b97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:37.110310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0fbda-9315-4fe3-8fd1-37dfaf760b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:37.111722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0fbda-9315-4fe3-8fd1-37dfaf760b97 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:37.123425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 599/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:15:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:37.129626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd1ae-94bf-4c77-be5e-065c7b6fd313 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:37.237901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd1ae-94bf-4c77-be5e-065c7b6fd313 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:37.258969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:37.273996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee1c4d-4ef4-4ae7-84dc-9865e45c8ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:37.274881 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1c4d-4ef4-4ae7-84dc-9865e45c8ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:37.275158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1c4d-4ef4-4ae7-84dc-9865e45c8ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:37.275427 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1c4d-4ef4-4ae7-84dc-9865e45c8ff2 None admin] PATH_INFO: `/v3/users/1d8ab15551ee4b19bd4197c9744afd59` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:37.276658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee1c4d-4ef4-4ae7-84dc-9865e45c8ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=1d8ab15551ee4b19bd4197c9744afd59)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:37.278113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee1c4d-4ef4-4ae7-84dc-9865e45c8ff2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:37.279777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 598/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 21 08:15:37 2022] GET /identity/v3/users/1d8ab15551ee4b19bd4197c9744afd59 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:37.286149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0fbda-9315-4fe3-8fd1-37dfaf760b97 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:37.397896 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0fbda-9315-4fe3-8fd1-37dfaf760b97 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:37.433989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53be7f-fa6e-46d1-ac1d-8027d9e946aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:37.434643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53be7f-fa6e-46d1-ac1d-8027d9e946aa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:37.434924 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53be7f-fa6e-46d1-ac1d-8027d9e946aa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:37.435198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53be7f-fa6e-46d1-ac1d-8027d9e946aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:37.454146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:37.512188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53be7f-fa6e-46d1-ac1d-8027d9e946aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:37.513607 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53be7f-fa6e-46d1-ac1d-8027d9e946aa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:37.624314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 600/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:15:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:15:37.630590 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee1c4d-4ef4-4ae7-84dc-9865e45c8ff2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:37.740434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee1c4d-4ef4-4ae7-84dc-9865e45c8ff2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:37.777912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4edfb0-b3ab-46f0-9c52-99d71842940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:37.778716 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4edfb0-b3ab-46f0-9c52-99d71842940f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:37.778993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4edfb0-b3ab-46f0-9c52-99d71842940f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:37.779266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4edfb0-b3ab-46f0-9c52-99d71842940f None admin] PATH_INFO: `/v3/projects/2c7a60385bd843b78ce37b8c126e392b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:37.780753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4edfb0-b3ab-46f0-9c52-99d71842940f None admin] RBAC: Authorizing `identity:get_project(project_id=2c7a60385bd843b78ce37b8c126e392b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:37.782262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4edfb0-b3ab-46f0-9c52-99d71842940f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:37.784109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 599/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 21 08:15:37 2022] GET /identity/v3/projects/2c7a60385bd843b78ce37b8c126e392b => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:37.791386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53be7f-fa6e-46d1-ac1d-8027d9e946aa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:15:37.844847 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:37.905959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53be7f-fa6e-46d1-ac1d-8027d9e946aa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:15:37.943965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e869f-27dd-40f9-b22b-5f50db4f63af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:15:37.944671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e869f-27dd-40f9-b22b-5f50db4f63af None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:15:37.944963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e869f-27dd-40f9-b22b-5f50db4f63af None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:15:37.945241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e869f-27dd-40f9-b22b-5f50db4f63af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:15:37.946092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e869f-27dd-40f9-b22b-5f50db4f63af None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=2c7a60385bd843b78ce37b8c126e392b, user.id=1d8ab15551ee4b19bd4197c9744afd59) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:15:37.946409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e869f-27dd-40f9-b22b-5f50db4f63af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:15:37.947871 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e869f-27dd-40f9-b22b-5f50db4f63af None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:15:37.954947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 601/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:15:37 2022] GET /identity/v3/role_assignments?user.id=1d8ab15551ee4b19bd4197c9744afd59&scope.project.id=2c7a60385bd843b78ce37b8c126e392b&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:15:47.773513 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=72 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:15:47.951645 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=44 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:34.083832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd3b94-29bf-4c61-8fcb-c044d0a92e4b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.084456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd3b94-29bf-4c61-8fcb-c044d0a92e4b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.084456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd3b94-29bf-4c61-8fcb-c044d0a92e4b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.086201 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 600/1201] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:34.092162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720e398-2dd2-438a-a8cb-ac17318c2983 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.093109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720e398-2dd2-438a-a8cb-ac17318c2983 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.093109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720e398-2dd2-438a-a8cb-ac17318c2983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.112241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0720e398-2dd2-438a-a8cb-ac17318c2983 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:34.113680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0720e398-2dd2-438a-a8cb-ac17318c2983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:34.201085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 602/1202] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:16:34.227856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd3b94-29bf-4c61-8fcb-c044d0a92e4b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:34.365559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd3b94-29bf-4c61-8fcb-c044d0a92e4b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:34.414295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341e2f9-9997-4972-bdd2-7d8e46ce54f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:34.415558 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341e2f9-9997-4972-bdd2-7d8e46ce54f6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.415972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341e2f9-9997-4972-bdd2-7d8e46ce54f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.416382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341e2f9-9997-4972-bdd2-7d8e46ce54f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.444933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341e2f9-9997-4972-bdd2-7d8e46ce54f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:34.447237 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341e2f9-9997-4972-bdd2-7d8e46ce54f6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b341e2f9-9997-4972-bdd2-7d8e46ce54f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:34.478109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:34.480507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:34.483380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:34.483380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:34.483380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:34.483380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:34.483380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 601/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:34.489454 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720e398-2dd2-438a-a8cb-ac17318c2983 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:34.669943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720e398-2dd2-438a-a8cb-ac17318c2983 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:34.709179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:34.717327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3a004-545d-4133-a625-902e60dcaa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:34.718255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3a004-545d-4133-a625-902e60dcaa6f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.718627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3a004-545d-4133-a625-902e60dcaa6f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.718974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3a004-545d-4133-a625-902e60dcaa6f None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.719927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3a004-545d-4133-a625-902e60dcaa6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:34.720242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3a004-545d-4133-a625-902e60dcaa6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:34.721834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3a004-545d-4133-a625-902e60dcaa6f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:34.737843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 603/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:34.744019 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341e2f9-9997-4972-bdd2-7d8e46ce54f6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:34.817191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:34.907501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341e2f9-9997-4972-bdd2-7d8e46ce54f6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:34.973943 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb186bd-d925-4df7-b0a3-bba6c95f3ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:34.974769 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb186bd-d925-4df7-b0a3-bba6c95f3ba5 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:34.975135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb186bd-d925-4df7-b0a3-bba6c95f3ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:34.975549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb186bd-d925-4df7-b0a3-bba6c95f3ba5 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:34.976400 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb186bd-d925-4df7-b0a3-bba6c95f3ba5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:34.978077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb186bd-d925-4df7-b0a3-bba6c95f3ba5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:35.013710 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 602/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 21 08:16:34 2022] POST /identity/v3/users => generated 251 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:16:37.294223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46613d-93d7-4249-a268-ce1654f99749 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.295326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46613d-93d7-4249-a268-ce1654f99749 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.295326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46613d-93d7-4249-a268-ce1654f99749 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.296356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 604/1206] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:16:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:37.303312 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15b08-97a8-49e3-931f-dca8971c66fb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.303813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15b08-97a8-49e3-931f-dca8971c66fb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.303913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15b08-97a8-49e3-931f-dca8971c66fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.334272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5bd15b08-97a8-49e3-931f-dca8971c66fb None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:37.335915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5bd15b08-97a8-49e3-931f-dca8971c66fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:37.446060 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 603/1207] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:16:37.469928 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46613d-93d7-4249-a268-ce1654f99749 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.628884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46613d-93d7-4249-a268-ce1654f99749 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:37.681156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41d6a4-0539-47ea-9bf2-272b6c1ab92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:37.682011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41d6a4-0539-47ea-9bf2-272b6c1ab92c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.682290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41d6a4-0539-47ea-9bf2-272b6c1ab92c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.682563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41d6a4-0539-47ea-9bf2-272b6c1ab92c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.697438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41d6a4-0539-47ea-9bf2-272b6c1ab92c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2f41d6a4-0539-47ea-9bf2-272b6c1ab92c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:37.705493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:37.707577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:37.708578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:37.708578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:37.708578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:37.708578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:37.708578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:37.708578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:37.708578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:37.708578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:37.708578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:37.708578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:37.708578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:16:37.708578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:16:37.711939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 605/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:16:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:37.713988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd15b08-97a8-49e3-931f-dca8971c66fb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.770584 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:37.844161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd15b08-97a8-49e3-931f-dca8971c66fb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:37.887952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8f013-c499-4338-b4ba-241f32da3e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:37.888865 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8f013-c499-4338-b4ba-241f32da3e3d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:37.889338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8f013-c499-4338-b4ba-241f32da3e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:37.889822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8f013-c499-4338-b4ba-241f32da3e3d None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:37.890847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8f013-c499-4338-b4ba-241f32da3e3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:37.891248 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8f013-c499-4338-b4ba-241f32da3e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:37.894143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8f013-c499-4338-b4ba-241f32da3e3d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:37.908586 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 604/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:16:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:37.914817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41d6a4-0539-47ea-9bf2-272b6c1ab92c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:37.979605 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:38.040826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41d6a4-0539-47ea-9bf2-272b6c1ab92c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:38.093615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572053c7-028b-4ffd-be08-da18faa93d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:38.094643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572053c7-028b-4ffd-be08-da18faa93d1e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:38.094996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572053c7-028b-4ffd-be08-da18faa93d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:38.095461 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572053c7-028b-4ffd-be08-da18faa93d1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:38.110515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572053c7-028b-4ffd-be08-da18faa93d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:38.112778 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572053c7-028b-4ffd-be08-da18faa93d1e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-572053c7-028b-4ffd-be08-da18faa93d1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:38.145169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:38.146138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:38.147088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:38.147088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:38.147088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:38.147088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:16:38.152878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 606/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:38.156737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8f013-c499-4338-b4ba-241f32da3e3d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:38.305701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:38.309182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8f013-c499-4338-b4ba-241f32da3e3d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:38.356047 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b407101-4252-43e8-9408-7a31a94e5eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:38.357740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b407101-4252-43e8-9408-7a31a94e5eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:38.358536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b407101-4252-43e8-9408-7a31a94e5eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:38.359090 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b407101-4252-43e8-9408-7a31a94e5eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:38.360395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b407101-4252-43e8-9408-7a31a94e5eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:38.360914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b407101-4252-43e8-9408-7a31a94e5eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:38.363477 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b407101-4252-43e8-9408-7a31a94e5eb6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:38.400668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 605/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:38.406799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572053c7-028b-4ffd-be08-da18faa93d1e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:38.544879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572053c7-028b-4ffd-be08-da18faa93d1e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:38.546984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:38.603604 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9feca-99cd-4c2a-87e8-b5c564d0c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:38.604638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9feca-99cd-4c2a-87e8-b5c564d0c114 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:38.605026 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9feca-99cd-4c2a-87e8-b5c564d0c114 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:38.605311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9feca-99cd-4c2a-87e8-b5c564d0c114 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:38.617723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9feca-99cd-4c2a-87e8-b5c564d0c114 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:38.620786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9feca-99cd-4c2a-87e8-b5c564d0c114 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d4a9feca-99cd-4c2a-87e8-b5c564d0c114 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:16:38.643372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:38.644699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:38.645881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:38.645881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:38.645881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:16:38.645881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:16:38.645881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:16:38.645881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:16:38.645881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:16:38.645881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:16:38.645881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:16:38.645881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:16:38.648769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 607/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:38.651197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b407101-4252-43e8-9408-7a31a94e5eb6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:38.775255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b407101-4252-43e8-9408-7a31a94e5eb6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:38.827514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9900-7867-4cea-8b19-36fe443f7dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:38.828691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9900-7867-4cea-8b19-36fe443f7dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:38.829155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9900-7867-4cea-8b19-36fe443f7dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:38.829576 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9900-7867-4cea-8b19-36fe443f7dd2 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:38.831137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9900-7867-4cea-8b19-36fe443f7dd2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:38.831698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9900-7867-4cea-8b19-36fe443f7dd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:38.834426 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9900-7867-4cea-8b19-36fe443f7dd2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:38.860543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 606/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 21 08:16:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:38.868159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9feca-99cd-4c2a-87e8-b5c564d0c114 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:38.989757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9feca-99cd-4c2a-87e8-b5c564d0c114 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:39.043862 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d7120-103c-4aa9-9e0f-488064f75b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:39.044763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d7120-103c-4aa9-9e0f-488064f75b02 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:39.045049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d7120-103c-4aa9-9e0f-488064f75b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:39.045313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d7120-103c-4aa9-9e0f-488064f75b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:39.082787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:39.144907 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d7120-103c-4aa9-9e0f-488064f75b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:39.146892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d7120-103c-4aa9-9e0f-488064f75b02 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:39.288905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 608/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:16:39.295066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9900-7867-4cea-8b19-36fe443f7dd2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:39.323107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:39.465033 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9900-7867-4cea-8b19-36fe443f7dd2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:39.513102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33946c7e-4674-4576-9da4-35b1caafbe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:39.514308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33946c7e-4674-4576-9da4-35b1caafbe40 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:39.514597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33946c7e-4674-4576-9da4-35b1caafbe40 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:39.514853 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33946c7e-4674-4576-9da4-35b1caafbe40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:39.527734 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33946c7e-4674-4576-9da4-35b1caafbe40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:39.529341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33946c7e-4674-4576-9da4-35b1caafbe40 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-33946c7e-4674-4576-9da4-35b1caafbe40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:39.558338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:39.559872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:39.561321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:39.561321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:39.561321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:39.561321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:39.562325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 607/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:39.573157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d7120-103c-4aa9-9e0f-488064f75b02 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:39.681786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:39.739601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d7120-103c-4aa9-9e0f-488064f75b02 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:39.783548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f05d2-697e-45e4-bc57-99b3b9908311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:39.784224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f05d2-697e-45e4-bc57-99b3b9908311 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:39.784651 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f05d2-697e-45e4-bc57-99b3b9908311 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:39.784962 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f05d2-697e-45e4-bc57-99b3b9908311 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:39.785808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f05d2-697e-45e4-bc57-99b3b9908311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:39.786235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f05d2-697e-45e4-bc57-99b3b9908311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:39.787954 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f05d2-697e-45e4-bc57-99b3b9908311 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:39.802257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 609/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:39.810230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33946c7e-4674-4576-9da4-35b1caafbe40 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:39.904949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:39.957102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33946c7e-4674-4576-9da4-35b1caafbe40 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:40.013388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f57ad-5415-49ea-bcb0-5f62f63cc6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:40.014509 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f57ad-5415-49ea-bcb0-5f62f63cc6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:40.014815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f57ad-5415-49ea-bcb0-5f62f63cc6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:40.015072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f57ad-5415-49ea-bcb0-5f62f63cc6e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.025377 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f57ad-5415-49ea-bcb0-5f62f63cc6e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:40.028629 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f57ad-5415-49ea-bcb0-5f62f63cc6e7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-605f57ad-5415-49ea-bcb0-5f62f63cc6e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:16:40.049911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:40.051325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:40.052636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:16:40.052636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:16:40.052636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:16:40.052636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:16:40.052636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:16:40.052636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:16:40.052636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:16:40.052636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:40.054126 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 608/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:16:40.060815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f05d2-697e-45e4-bc57-99b3b9908311 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:40.207067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f05d2-697e-45e4-bc57-99b3b9908311 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:40.245390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:40.263294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413c50b-3bca-4051-97df-53bbb25007ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:40.264025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413c50b-3bca-4051-97df-53bbb25007ed None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:40.264312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413c50b-3bca-4051-97df-53bbb25007ed None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:40.264643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413c50b-3bca-4051-97df-53bbb25007ed None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.265437 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413c50b-3bca-4051-97df-53bbb25007ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:40.265790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413c50b-3bca-4051-97df-53bbb25007ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:40.267623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413c50b-3bca-4051-97df-53bbb25007ed None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:40.287037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 610/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:40.288283 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f57ad-5415-49ea-bcb0-5f62f63cc6e7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:40.461139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f57ad-5415-49ea-bcb0-5f62f63cc6e7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:40.514171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:40.531378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5a4eb-cce0-4b6c-aee8-3c6d1446a3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:40.532871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5a4eb-cce0-4b6c-aee8-3c6d1446a3ba None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:40.533349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5a4eb-cce0-4b6c-aee8-3c6d1446a3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:40.533836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5a4eb-cce0-4b6c-aee8-3c6d1446a3ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:40.535058 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5a4eb-cce0-4b6c-aee8-3c6d1446a3ba None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=1fd9ea435d7b48cb8b1b2a27d79cfa91) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:40.535721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5a4eb-cce0-4b6c-aee8-3c6d1446a3ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:40.538194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5a4eb-cce0-4b6c-aee8-3c6d1446a3ba None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:40.548376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 609/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:40 2022] GET /identity/v3/role_assignments?user.id=1fd9ea435d7b48cb8b1b2a27d79cfa91&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:42.714212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e773ed5-7496-4713-ba22-d024e6760158 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:42.714952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e773ed5-7496-4713-ba22-d024e6760158 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:42.714952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e773ed5-7496-4713-ba22-d024e6760158 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:42.716349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 611/1220] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:16:42.721776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d98a5-59e3-4053-b8e2-a078e08703ec None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:42.722273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d98a5-59e3-4053-b8e2-a078e08703ec None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:42.722387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d98a5-59e3-4053-b8e2-a078e08703ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:42.741580 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fc7d98a5-59e3-4053-b8e2-a078e08703ec None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:42.742807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fc7d98a5-59e3-4053-b8e2-a078e08703ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:42.831279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 610/1221] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:16:42.858822 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e773ed5-7496-4713-ba22-d024e6760158 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:42.980066 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e773ed5-7496-4713-ba22-d024e6760158 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:43.019235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08002f3e-8ef8-4547-be21-a6fd3635bbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:43.020146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002f3e-8ef8-4547-be21-a6fd3635bbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:43.020600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002f3e-8ef8-4547-be21-a6fd3635bbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:43.020880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002f3e-8ef8-4547-be21-a6fd3635bbc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:43.033244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08002f3e-8ef8-4547-be21-a6fd3635bbc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-08002f3e-8ef8-4547-be21-a6fd3635bbc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:43.043889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:43.045031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:16:43.045874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 612/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:16:43.052974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d98a5-59e3-4053-b8e2-a078e08703ec None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:43.175337 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d98a5-59e3-4053-b8e2-a078e08703ec None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:43.209941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:43.222916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82218a55-5566-4e84-88f7-9dc53edffe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:43.223603 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82218a55-5566-4e84-88f7-9dc53edffe2b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:43.223862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82218a55-5566-4e84-88f7-9dc53edffe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:43.224131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82218a55-5566-4e84-88f7-9dc53edffe2b None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:43.225012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82218a55-5566-4e84-88f7-9dc53edffe2b None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:43.225231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82218a55-5566-4e84-88f7-9dc53edffe2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:43.226667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82218a55-5566-4e84-88f7-9dc53edffe2b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:43.236256 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 611/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:16:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:43.242878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08002f3e-8ef8-4547-be21-a6fd3635bbc5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:43.304456 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:43.378922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08002f3e-8ef8-4547-be21-a6fd3635bbc5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:43.417623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c20ec4-1bf2-4638-8e07-eaf7d86cbc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:43.418805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c20ec4-1bf2-4638-8e07-eaf7d86cbc48 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:43.419105 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c20ec4-1bf2-4638-8e07-eaf7d86cbc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:43.419459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c20ec4-1bf2-4638-8e07-eaf7d86cbc48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:43.433979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c20ec4-1bf2-4638-8e07-eaf7d86cbc48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:43.435850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c20ec4-1bf2-4638-8e07-eaf7d86cbc48 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-89c20ec4-1bf2-4638-8e07-eaf7d86cbc48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:43.458649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:43.459818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:43.460784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:43.460784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:43.460784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:43.460784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:16:43.460784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 613/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:43.468181 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82218a55-5566-4e84-88f7-9dc53edffe2b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:43.599116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82218a55-5566-4e84-88f7-9dc53edffe2b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:43.640002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf85903-cc2b-4345-bb3a-1d7a110b3169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:43.640775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf85903-cc2b-4345-bb3a-1d7a110b3169 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:43.641052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf85903-cc2b-4345-bb3a-1d7a110b3169 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:43.641345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf85903-cc2b-4345-bb3a-1d7a110b3169 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:43.642520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf85903-cc2b-4345-bb3a-1d7a110b3169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:43.642955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf85903-cc2b-4345-bb3a-1d7a110b3169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:43.644378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf85903-cc2b-4345-bb3a-1d7a110b3169 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:43.659042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 612/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:43.667378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c20ec4-1bf2-4638-8e07-eaf7d86cbc48 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:43.788324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:43.798226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c20ec4-1bf2-4638-8e07-eaf7d86cbc48 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:43.840432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c868b3-4ff6-490a-b4e4-0746f87bcc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:43.841376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c868b3-4ff6-490a-b4e4-0746f87bcc82 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:43.841665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c868b3-4ff6-490a-b4e4-0746f87bcc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:43.842094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c868b3-4ff6-490a-b4e4-0746f87bcc82 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:43.851743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c868b3-4ff6-490a-b4e4-0746f87bcc82 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:43.853282 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c868b3-4ff6-490a-b4e4-0746f87bcc82 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e4c868b3-4ff6-490a-b4e4-0746f87bcc82 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:16:43.869497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:43.870659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:43.871633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:43.871633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:43.871633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:16:43.871633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:16:43.871633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:16:43.871633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:16:43.871633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:16:43.871633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:16:43.871633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:16:43.871633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:16:43.871633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 614/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:43.878075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf85903-cc2b-4345-bb3a-1d7a110b3169 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:43.928514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:44.002265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf85903-cc2b-4345-bb3a-1d7a110b3169 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:44.061374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f3b4a-7e99-43df-9298-666259267f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:44.062263 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3b4a-7e99-43df-9298-666259267f9e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.062541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3b4a-7e99-43df-9298-666259267f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.062762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3b4a-7e99-43df-9298-666259267f9e None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.063717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f3b4a-7e99-43df-9298-666259267f9e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:44.064122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f3b4a-7e99-43df-9298-666259267f9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:44.065800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f3b4a-7e99-43df-9298-666259267f9e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:44.088272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 613/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 21 08:16:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:44.094845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c868b3-4ff6-490a-b4e4-0746f87bcc82 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:44.222422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c868b3-4ff6-490a-b4e4-0746f87bcc82 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:44.264373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248557a5-8426-4693-9d86-e844e6b45df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:44.265261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248557a5-8426-4693-9d86-e844e6b45df3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.265552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248557a5-8426-4693-9d86-e844e6b45df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.265955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248557a5-8426-4693-9d86-e844e6b45df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.279632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248557a5-8426-4693-9d86-e844e6b45df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:44.281244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248557a5-8426-4693-9d86-e844e6b45df3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-248557a5-8426-4693-9d86-e844e6b45df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:44.301983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:44.303029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:44.303985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:44.303985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:44.303985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:44.303985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:16:44.303985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 615/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:44.309609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f3b4a-7e99-43df-9298-666259267f9e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:44.434545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f3b4a-7e99-43df-9298-666259267f9e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:44.437173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:44.476061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86236a03-6a90-4032-a870-793caac79648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:44.476672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236a03-6a90-4032-a870-793caac79648 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.476992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236a03-6a90-4032-a870-793caac79648 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.477219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236a03-6a90-4032-a870-793caac79648 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.478168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86236a03-6a90-4032-a870-793caac79648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:44.478554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86236a03-6a90-4032-a870-793caac79648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:44.480116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86236a03-6a90-4032-a870-793caac79648 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:44.493422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 614/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:44.499563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248557a5-8426-4693-9d86-e844e6b45df3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:44.511313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:44.632314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248557a5-8426-4693-9d86-e844e6b45df3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:44.669825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdb147-e347-4b70-9f3b-d63aa64dde02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:44.670633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdb147-e347-4b70-9f3b-d63aa64dde02 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.670912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdb147-e347-4b70-9f3b-d63aa64dde02 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.671181 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdb147-e347-4b70-9f3b-d63aa64dde02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.678056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdb147-e347-4b70-9f3b-d63aa64dde02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:44.679510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdb147-e347-4b70-9f3b-d63aa64dde02 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ebbdb147-e347-4b70-9f3b-d63aa64dde02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:16:44.694183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:44.695321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:44.701470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:16:44.701470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:16:44.701470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:16:44.701470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:16:44.701470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:16:44.701470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:16:44.701470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:16:44.701470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:16:44.701470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 616/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:44.702055 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86236a03-6a90-4032-a870-793caac79648 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:44.806021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86236a03-6a90-4032-a870-793caac79648 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:44.843263 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4db6ed-c03f-4f26-b28b-305e566c1d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:44.844058 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4db6ed-c03f-4f26-b28b-305e566c1d5c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:44.844475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4db6ed-c03f-4f26-b28b-305e566c1d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:44.844820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4db6ed-c03f-4f26-b28b-305e566c1d5c None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:44.845892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4db6ed-c03f-4f26-b28b-305e566c1d5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:44.846272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4db6ed-c03f-4f26-b28b-305e566c1d5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:44.848004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4db6ed-c03f-4f26-b28b-305e566c1d5c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:44.862651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 615/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:16:44.869283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdb147-e347-4b70-9f3b-d63aa64dde02 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:44.946039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:44.988711 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdb147-e347-4b70-9f3b-d63aa64dde02 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:45.027594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5117e-27fc-4e13-b1b3-afacbb0416c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:45.028811 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5117e-27fc-4e13-b1b3-afacbb0416c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:45.029056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5117e-27fc-4e13-b1b3-afacbb0416c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:45.029336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5117e-27fc-4e13-b1b3-afacbb0416c0 None admin] PATH_INFO: `/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/1fd9ea435d7b48cb8b1b2a27d79cfa91/roles/9e4aabf99fc8417596f726f0229d19a6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:45.046346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5117e-27fc-4e13-b1b3-afacbb0416c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c487ed72a15c45faa40f743ae752e48b, user_id=1fd9ea435d7b48cb8b1b2a27d79cfa91, role_id=9e4aabf99fc8417596f726f0229d19a6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:45.047863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5117e-27fc-4e13-b1b3-afacbb0416c0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:45.063315 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 617/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:16:44 2022] PUT /identity/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/1fd9ea435d7b48cb8b1b2a27d79cfa91/roles/9e4aabf99fc8417596f726f0229d19a6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:16:47.198270 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff5cf-7f5a-4639-ad8b-4bbbfe837fab None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.198918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff5cf-7f5a-4639-ad8b-4bbbfe837fab None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.198918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff5cf-7f5a-4639-ad8b-4bbbfe837fab None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.200382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 616/1233] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:47.205676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1a8c-73a8-4161-9513-7b87894df586 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.206106 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1a8c-73a8-4161-9513-7b87894df586 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.206213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1a8c-73a8-4161-9513-7b87894df586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.223613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a72a1a8c-73a8-4161-9513-7b87894df586 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:47.224965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a72a1a8c-73a8-4161-9513-7b87894df586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:47.300981 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 618/1234] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:16:47.327260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cff5cf-7f5a-4639-ad8b-4bbbfe837fab None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:47.356188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:47.444626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cff5cf-7f5a-4639-ad8b-4bbbfe837fab None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:47.484237 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356c67b-42c5-49c8-bd2b-143094d96486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:47.485083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356c67b-42c5-49c8-bd2b-143094d96486 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.485366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356c67b-42c5-49c8-bd2b-143094d96486 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.485639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356c67b-42c5-49c8-bd2b-143094d96486 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.495687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356c67b-42c5-49c8-bd2b-143094d96486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a356c67b-42c5-49c8-bd2b-143094d96486 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:47.504666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:47.505835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:47.506937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 617/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 21 08:16:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:47.512462 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a1a8c-73a8-4161-9513-7b87894df586 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:47.563990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:47.633490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a1a8c-73a8-4161-9513-7b87894df586 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:47.681232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00fc5b-9760-4439-9437-53a1c19078a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:47.681913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00fc5b-9760-4439-9437-53a1c19078a0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.682193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00fc5b-9760-4439-9437-53a1c19078a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.682468 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00fc5b-9760-4439-9437-53a1c19078a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.683229 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00fc5b-9760-4439-9437-53a1c19078a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:47.683530 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00fc5b-9760-4439-9437-53a1c19078a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:47.685076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00fc5b-9760-4439-9437-53a1c19078a0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:47.694550 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 619/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 21 08:16:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:47.701035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356c67b-42c5-49c8-bd2b-143094d96486 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:47.800738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:47.819997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356c67b-42c5-49c8-bd2b-143094d96486 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:47.860905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8cf23-3b2d-48a3-86a0-79418380494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:47.861991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8cf23-3b2d-48a3-86a0-79418380494a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:47.862296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8cf23-3b2d-48a3-86a0-79418380494a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:47.862596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8cf23-3b2d-48a3-86a0-79418380494a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:47.875378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8cf23-3b2d-48a3-86a0-79418380494a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:47.876900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8cf23-3b2d-48a3-86a0-79418380494a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-00a8cf23-3b2d-48a3-86a0-79418380494a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:47.898964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:47.900043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:47.901382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:47.901382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:47.901382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:47.901382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:47.901382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 618/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:47.906116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00fc5b-9760-4439-9437-53a1c19078a0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:48.032182 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00fc5b-9760-4439-9437-53a1c19078a0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:48.045414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:48.073685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6887f-496f-411b-865f-b0a0ed5e3d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:48.074685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6887f-496f-411b-865f-b0a0ed5e3d1e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:48.074997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6887f-496f-411b-865f-b0a0ed5e3d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:48.075282 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6887f-496f-411b-865f-b0a0ed5e3d1e None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:48.076275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6887f-496f-411b-865f-b0a0ed5e3d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:48.076516 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6887f-496f-411b-865f-b0a0ed5e3d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:48.077963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6887f-496f-411b-865f-b0a0ed5e3d1e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:48.092792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 620/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:48.098814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8cf23-3b2d-48a3-86a0-79418380494a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:48.209952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8cf23-3b2d-48a3-86a0-79418380494a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:48.249105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e453c-5d5f-4029-9afc-175347883f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:48.249980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e453c-5d5f-4029-9afc-175347883f7d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:48.250225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e453c-5d5f-4029-9afc-175347883f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:48.250494 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e453c-5d5f-4029-9afc-175347883f7d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:48.253913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:48.261788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e453c-5d5f-4029-9afc-175347883f7d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:48.263563 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e453c-5d5f-4029-9afc-175347883f7d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c88e453c-5d5f-4029-9afc-175347883f7d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:16:48.284001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:48.285178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:48.286157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:48.286157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:48.286157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:16:48.286157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:16:48.286157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:16:48.286157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:16:48.286157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:16:48.286157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:16:48.286157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:16:48.286157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:48.286157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 619/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:48.291575 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6887f-496f-411b-865f-b0a0ed5e3d1e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:48.401660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6887f-496f-411b-865f-b0a0ed5e3d1e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:48.439091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cd38a-e574-4867-8ab4-d725bb22db5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:48.439810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cd38a-e574-4867-8ab4-d725bb22db5c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:48.440086 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cd38a-e574-4867-8ab4-d725bb22db5c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:48.440358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cd38a-e574-4867-8ab4-d725bb22db5c None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:48.441306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cd38a-e574-4867-8ab4-d725bb22db5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:48.441613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cd38a-e574-4867-8ab4-d725bb22db5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:48.443073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cd38a-e574-4867-8ab4-d725bb22db5c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:48.461764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 621/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 21 08:16:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:48.468034 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e453c-5d5f-4029-9afc-175347883f7d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:48.584322 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e453c-5d5f-4029-9afc-175347883f7d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:48.625125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaa883-9415-438b-ac4b-9cb7d44a2f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:48.625784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaa883-9415-438b-ac4b-9cb7d44a2f93 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:48.626057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaa883-9415-438b-ac4b-9cb7d44a2f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:48.626325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaa883-9415-438b-ac4b-9cb7d44a2f93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:48.694180 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:48.701571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaaa883-9415-438b-ac4b-9cb7d44a2f93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:48.703061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaaa883-9415-438b-ac4b-9cb7d44a2f93 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:48.826352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 620/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:16:48.832752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cd38a-e574-4867-8ab4-d725bb22db5c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:48.865089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:48.948162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cd38a-e574-4867-8ab4-d725bb22db5c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:48.985774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2ac43-732a-403d-82a1-03812936fef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:48.986590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2ac43-732a-403d-82a1-03812936fef9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:48.986848 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2ac43-732a-403d-82a1-03812936fef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:48.987147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2ac43-732a-403d-82a1-03812936fef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:48.998059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2ac43-732a-403d-82a1-03812936fef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:49.000666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2ac43-732a-403d-82a1-03812936fef9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-dbe2ac43-732a-403d-82a1-03812936fef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:49.024680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:49.026038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:49.027136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:49.027136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:49.027136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:49.027136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:16:49.027136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 622/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:16:49.032950 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaa883-9415-438b-ac4b-9cb7d44a2f93 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:49.161149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:49.169416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaa883-9415-438b-ac4b-9cb7d44a2f93 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:49.207945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bb79e-0f7f-4b31-bab5-a12e07957143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:49.208603 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bb79e-0f7f-4b31-bab5-a12e07957143 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:49.208718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bb79e-0f7f-4b31-bab5-a12e07957143 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:49.208973 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bb79e-0f7f-4b31-bab5-a12e07957143 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:49.209780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bb79e-0f7f-4b31-bab5-a12e07957143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:49.210017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bb79e-0f7f-4b31-bab5-a12e07957143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:49.211421 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bb79e-0f7f-4b31-bab5-a12e07957143 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:49.225211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 621/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:49.231501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2ac43-732a-403d-82a1-03812936fef9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:49.321284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:49.351159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2ac43-732a-403d-82a1-03812936fef9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:49.397024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75133ad-08e1-4d42-9ed9-d76f9357a748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:49.397842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75133ad-08e1-4d42-9ed9-d76f9357a748 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:49.398128 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75133ad-08e1-4d42-9ed9-d76f9357a748 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:49.398412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75133ad-08e1-4d42-9ed9-d76f9357a748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:49.406538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75133ad-08e1-4d42-9ed9-d76f9357a748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:49.408058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75133ad-08e1-4d42-9ed9-d76f9357a748 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a75133ad-08e1-4d42-9ed9-d76f9357a748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:16:49.427643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:49.428827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:49.435190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:16:49.435190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:16:49.435190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:16:49.435190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:16:49.435190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:16:49.435190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:16:49.435190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:16:49.435190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:16:49.435190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 623/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:49.436444 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bb79e-0f7f-4b31-bab5-a12e07957143 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:49.566374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bb79e-0f7f-4b31-bab5-a12e07957143 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:49.614721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1b263-66a0-470e-a08d-a9b86df42843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:49.615383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b263-66a0-470e-a08d-a9b86df42843 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:49.615653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b263-66a0-470e-a08d-a9b86df42843 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:49.615932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b263-66a0-470e-a08d-a9b86df42843 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:49.616791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1b263-66a0-470e-a08d-a9b86df42843 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:49.617096 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1b263-66a0-470e-a08d-a9b86df42843 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:49.618556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1b263-66a0-470e-a08d-a9b86df42843 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:49.632598 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 622/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:49.639631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75133ad-08e1-4d42-9ed9-d76f9357a748 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:49.759348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75133ad-08e1-4d42-9ed9-d76f9357a748 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:49.803999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f587-d7a1-479b-9845-8e85d44d5dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:49.804920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f587-d7a1-479b-9845-8e85d44d5dcf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:49.805294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f587-d7a1-479b-9845-8e85d44d5dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:49.805659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f587-d7a1-479b-9845-8e85d44d5dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:49.806665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4f587-d7a1-479b-9845-8e85d44d5dcf None admin] RBAC: Adding query filter params (role.id=9e4aabf99fc8417596f726f0229d19a6, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=1fd9ea435d7b48cb8b1b2a27d79cfa91) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:49.807049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4f587-d7a1-479b-9845-8e85d44d5dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:49.808603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4f587-d7a1-479b-9845-8e85d44d5dcf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:49.815210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 624/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:49 2022] GET /identity/v3/role_assignments?user.id=1fd9ea435d7b48cb8b1b2a27d79cfa91&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=9e4aabf99fc8417596f726f0229d19a6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:52.195453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bbd84-2e17-4c45-a416-40e66df090de None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:52.196040 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bbd84-2e17-4c45-a416-40e66df090de None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:52.196218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bbd84-2e17-4c45-a416-40e66df090de None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:52.197866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 623/1247] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:16:52.203879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5637bce-84b0-4c16-aba9-cccc7151ca5a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:52.204421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5637bce-84b0-4c16-aba9-cccc7151ca5a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:52.204538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5637bce-84b0-4c16-aba9-cccc7151ca5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:52.211259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:52.228008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a5637bce-84b0-4c16-aba9-cccc7151ca5a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:52.229584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a5637bce-84b0-4c16-aba9-cccc7151ca5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:52.309754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 625/1248] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:16:52.336142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bbd84-2e17-4c45-a416-40e66df090de None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:52.357378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:52.465819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bbd84-2e17-4c45-a416-40e66df090de None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:52.505634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadc59f-2a43-4ad0-8007-fe4b25217474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:52.506480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadc59f-2a43-4ad0-8007-fe4b25217474 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:52.506756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadc59f-2a43-4ad0-8007-fe4b25217474 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:52.507025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadc59f-2a43-4ad0-8007-fe4b25217474 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:52.517672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadc59f-2a43-4ad0-8007-fe4b25217474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-cfadc59f-2a43-4ad0-8007-fe4b25217474 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:52.525232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:52.526480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:52.527460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 624/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:16:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:52.534735 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5637bce-84b0-4c16-aba9-cccc7151ca5a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:52.663217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5637bce-84b0-4c16-aba9-cccc7151ca5a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:52.699791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:52.705135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944039-19fb-4d5f-a788-c5daefcdd6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:52.705812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944039-19fb-4d5f-a788-c5daefcdd6ba None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:52.706089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944039-19fb-4d5f-a788-c5daefcdd6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:52.706362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944039-19fb-4d5f-a788-c5daefcdd6ba None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:52.707124 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5944039-19fb-4d5f-a788-c5daefcdd6ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:52.707421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5944039-19fb-4d5f-a788-c5daefcdd6ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:52.708824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5944039-19fb-4d5f-a788-c5daefcdd6ba None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:52.717362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 626/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:52.723510 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadc59f-2a43-4ad0-8007-fe4b25217474 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:52.817032 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:52.844125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadc59f-2a43-4ad0-8007-fe4b25217474 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:52.883193 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb4be-9d47-4ec2-af7c-64590de89e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:52.884008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb4be-9d47-4ec2-af7c-64590de89e9c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:52.884328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb4be-9d47-4ec2-af7c-64590de89e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:52.884731 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb4be-9d47-4ec2-af7c-64590de89e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:52.897533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bb4be-9d47-4ec2-af7c-64590de89e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:52.899173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bb4be-9d47-4ec2-af7c-64590de89e9c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ff7bb4be-9d47-4ec2-af7c-64590de89e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:52.918968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:52.920412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:52.922498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:52.922498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:52.922498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:52.922498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:52.922498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 625/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:16:52.926638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944039-19fb-4d5f-a788-c5daefcdd6ba None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:53.048298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944039-19fb-4d5f-a788-c5daefcdd6ba None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:53.086019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e4f16-e17b-4a82-86dd-4737fe6b5e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:53.087029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e4f16-e17b-4a82-86dd-4737fe6b5e9a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.087313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e4f16-e17b-4a82-86dd-4737fe6b5e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.087582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e4f16-e17b-4a82-86dd-4737fe6b5e9a None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.088321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e4f16-e17b-4a82-86dd-4737fe6b5e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:53.088666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e4f16-e17b-4a82-86dd-4737fe6b5e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:53.090645 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e4f16-e17b-4a82-86dd-4737fe6b5e9a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:53.104238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 627/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:53.110427 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb4be-9d47-4ec2-af7c-64590de89e9c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:53.224604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb4be-9d47-4ec2-af7c-64590de89e9c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:53.253215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:53.263105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e723b-3de1-47ed-bfa5-2d5115f4c8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:53.264360 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e723b-3de1-47ed-bfa5-2d5115f4c8eb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.264766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e723b-3de1-47ed-bfa5-2d5115f4c8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.265083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e723b-3de1-47ed-bfa5-2d5115f4c8eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.275638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e723b-3de1-47ed-bfa5-2d5115f4c8eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:53.277181 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e723b-3de1-47ed-bfa5-2d5115f4c8eb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1e8e723b-3de1-47ed-bfa5-2d5115f4c8eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:16:53.293796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:53.295432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:53.296703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:53.296703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:53.296703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:16:53.296703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:16:53.296703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:16:53.296703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:16:53.296703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:16:53.296703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:16:53.296703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:16:53.296703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:53.296703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 626/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:16:53.301960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e4f16-e17b-4a82-86dd-4737fe6b5e9a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:53.376014 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:53.432145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e4f16-e17b-4a82-86dd-4737fe6b5e9a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:53.479561 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55e225-5d24-416a-916c-0cf71b32172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:53.480242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55e225-5d24-416a-916c-0cf71b32172e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.480589 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55e225-5d24-416a-916c-0cf71b32172e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.480891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55e225-5d24-416a-916c-0cf71b32172e None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.481752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55e225-5d24-416a-916c-0cf71b32172e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:53.482043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55e225-5d24-416a-916c-0cf71b32172e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:53.483576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55e225-5d24-416a-916c-0cf71b32172e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:53.513385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 628/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 21 08:16:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:53.520058 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e723b-3de1-47ed-bfa5-2d5115f4c8eb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:53.665535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e723b-3de1-47ed-bfa5-2d5115f4c8eb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:53.707257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8ab8b-15c0-4d24-acee-28412f5cf944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:53.707923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8ab8b-15c0-4d24-acee-28412f5cf944 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:53.708204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8ab8b-15c0-4d24-acee-28412f5cf944 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:53.708478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8ab8b-15c0-4d24-acee-28412f5cf944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:53.787669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:53.805195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8ab8b-15c0-4d24-acee-28412f5cf944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:53.806750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8ab8b-15c0-4d24-acee-28412f5cf944 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:53.928408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 627/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:16:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:16:53.938074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55e225-5d24-416a-916c-0cf71b32172e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.091328 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55e225-5d24-416a-916c-0cf71b32172e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.108922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:54.143078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe9f64-55c1-4562-83b7-d94b5d7bb1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.144210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe9f64-55c1-4562-83b7-d94b5d7bb1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.144671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe9f64-55c1-4562-83b7-d94b5d7bb1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.145133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe9f64-55c1-4562-83b7-d94b5d7bb1a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.161783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe9f64-55c1-4562-83b7-d94b5d7bb1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:54.164106 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe9f64-55c1-4562-83b7-d94b5d7bb1a3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5bbe9f64-55c1-4562-83b7-d94b5d7bb1a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:54.186909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:54.189935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:54.191639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:54.191639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:54.191639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:54.191639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:16:54.191639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 629/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:54.195397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8ab8b-15c0-4d24-acee-28412f5cf944 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.320049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:54.333949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8ab8b-15c0-4d24-acee-28412f5cf944 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.372426 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f9187-fa2b-41f8-9d5a-0d56ecf37d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.373153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f9187-fa2b-41f8-9d5a-0d56ecf37d74 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.373518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f9187-fa2b-41f8-9d5a-0d56ecf37d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.373868 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f9187-fa2b-41f8-9d5a-0d56ecf37d74 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.374846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f9187-fa2b-41f8-9d5a-0d56ecf37d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:54.375238 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f9187-fa2b-41f8-9d5a-0d56ecf37d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:54.377092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f9187-fa2b-41f8-9d5a-0d56ecf37d74 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:54.391353 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 628/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:54.398361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe9f64-55c1-4562-83b7-d94b5d7bb1a3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.540142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe9f64-55c1-4562-83b7-d94b5d7bb1a3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.602933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3484114-c466-45d1-8a52-26a6ed3fe9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.603888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3484114-c466-45d1-8a52-26a6ed3fe9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.604107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3484114-c466-45d1-8a52-26a6ed3fe9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.604410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3484114-c466-45d1-8a52-26a6ed3fe9a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.612658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3484114-c466-45d1-8a52-26a6ed3fe9a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:54.614221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3484114-c466-45d1-8a52-26a6ed3fe9a1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f3484114-c466-45d1-8a52-26a6ed3fe9a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:16:54.630724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:54.632263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:54.634153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:16:54.634153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:16:54.634153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:16:54.634153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:16:54.634153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:16:54.634153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:16:54.634153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:16:54.634153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:16:54.637418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 630/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:54.638364 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f9187-fa2b-41f8-9d5a-0d56ecf37d74 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.780212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f9187-fa2b-41f8-9d5a-0d56ecf37d74 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:54.821917 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2167c-51ec-466e-85a2-f6a5e01717e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:54.822828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2167c-51ec-466e-85a2-f6a5e01717e9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:54.822965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2167c-51ec-466e-85a2-f6a5e01717e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:54.823235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2167c-51ec-466e-85a2-f6a5e01717e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:54.824200 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2167c-51ec-466e-85a2-f6a5e01717e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:54.824567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2167c-51ec-466e-85a2-f6a5e01717e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:54.826349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2167c-51ec-466e-85a2-f6a5e01717e9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:54.841702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 629/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:54.849156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3484114-c466-45d1-8a52-26a6ed3fe9a1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:54.879320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:54.973381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3484114-c466-45d1-8a52-26a6ed3fe9a1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:55.015305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4fd30-b0f1-4dee-abf0-d037506524cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:55.015969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4fd30-b0f1-4dee-abf0-d037506524cd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:55.016247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4fd30-b0f1-4dee-abf0-d037506524cd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:55.016911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4fd30-b0f1-4dee-abf0-d037506524cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:55.017764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4fd30-b0f1-4dee-abf0-d037506524cd None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=1fd9ea435d7b48cb8b1b2a27d79cfa91) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:55.018068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4fd30-b0f1-4dee-abf0-d037506524cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:55.019535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4fd30-b0f1-4dee-abf0-d037506524cd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:55.025837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 631/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:16:54 2022] GET /identity/v3/role_assignments?user.id=1fd9ea435d7b48cb8b1b2a27d79cfa91&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:57.128812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de05ce-7214-45d1-9563-facb8033858b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:57.129391 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de05ce-7214-45d1-9563-facb8033858b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:57.129391 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de05ce-7214-45d1-9563-facb8033858b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:57.130794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 630/1261] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:16:57.137576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85671f38-f7e4-4c3e-afdc-6c0f68af03dc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:57.138117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85671f38-f7e4-4c3e-afdc-6c0f68af03dc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:57.138117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85671f38-f7e4-4c3e-afdc-6c0f68af03dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:57.156672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-85671f38-f7e4-4c3e-afdc-6c0f68af03dc None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:16:57.157908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-85671f38-f7e4-4c3e-afdc-6c0f68af03dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:16:57.237600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 632/1262] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:16:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:16:57.260312 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de05ce-7214-45d1-9563-facb8033858b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:57.275547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:57.407148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de05ce-7214-45d1-9563-facb8033858b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:57.453540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27aa04-ca3b-496c-a06e-82a6d2b0efd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:57.454367 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27aa04-ca3b-496c-a06e-82a6d2b0efd1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:57.454634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27aa04-ca3b-496c-a06e-82a6d2b0efd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:57.454904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27aa04-ca3b-496c-a06e-82a6d2b0efd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:57.466924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27aa04-ca3b-496c-a06e-82a6d2b0efd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-be27aa04-ca3b-496c-a06e-82a6d2b0efd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:16:57.474787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:57.476608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:57.477650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 631/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:16:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:57.484978 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85671f38-f7e4-4c3e-afdc-6c0f68af03dc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:57.504758 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:57.614225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85671f38-f7e4-4c3e-afdc-6c0f68af03dc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:57.659117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761a12-5035-4a6d-8c2f-1bbfbe9abe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:57.659696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761a12-5035-4a6d-8c2f-1bbfbe9abe54 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:57.659987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761a12-5035-4a6d-8c2f-1bbfbe9abe54 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:57.660263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761a12-5035-4a6d-8c2f-1bbfbe9abe54 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:57.661072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41761a12-5035-4a6d-8c2f-1bbfbe9abe54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:57.661385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41761a12-5035-4a6d-8c2f-1bbfbe9abe54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:57.662810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41761a12-5035-4a6d-8c2f-1bbfbe9abe54 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:57.672684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 633/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:16:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:57.678802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27aa04-ca3b-496c-a06e-82a6d2b0efd1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:57.771898 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:57.822311 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27aa04-ca3b-496c-a06e-82a6d2b0efd1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:57.883988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfcef9-60a4-4639-a751-43501275c880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:57.885424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfcef9-60a4-4639-a751-43501275c880 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:57.885912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfcef9-60a4-4639-a751-43501275c880 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:57.886396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfcef9-60a4-4639-a751-43501275c880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:57.915720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfcef9-60a4-4639-a751-43501275c880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:57.921512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfcef9-60a4-4639-a751-43501275c880 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-11dfcef9-60a4-4639-a751-43501275c880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:57.941262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:57.948098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:57.949324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:57.949324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:57.949324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:57.949324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:57.949324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 632/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:57.949864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761a12-5035-4a6d-8c2f-1bbfbe9abe54 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:58.041027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:58.064293 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761a12-5035-4a6d-8c2f-1bbfbe9abe54 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:58.119163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ed4d5-c860-4079-917a-1cb5f35cd99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:58.120327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ed4d5-c860-4079-917a-1cb5f35cd99f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:58.120867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ed4d5-c860-4079-917a-1cb5f35cd99f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:58.121443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ed4d5-c860-4079-917a-1cb5f35cd99f None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:58.122828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ed4d5-c860-4079-917a-1cb5f35cd99f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:58.123380 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ed4d5-c860-4079-917a-1cb5f35cd99f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:58.126081 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ed4d5-c860-4079-917a-1cb5f35cd99f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:58.149817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 634/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:58.156599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfcef9-60a4-4639-a751-43501275c880 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:58.278881 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfcef9-60a4-4639-a751-43501275c880 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:58.304484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:58.321843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f60fd-6a22-43bb-b3a9-638e45886090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:58.322696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f60fd-6a22-43bb-b3a9-638e45886090 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:58.322963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f60fd-6a22-43bb-b3a9-638e45886090 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:58.323218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f60fd-6a22-43bb-b3a9-638e45886090 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:58.333453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f60fd-6a22-43bb-b3a9-638e45886090 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:58.334988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f60fd-6a22-43bb-b3a9-638e45886090 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-755f60fd-6a22-43bb-b3a9-638e45886090 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:16:58.351079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:58.352317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:58.353604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:58.353604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:58.353604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:16:58.353604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:16:58.353604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:16:58.353604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:16:58.353604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:16:58.353604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:16:58.353604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:16:58.353604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:58.353604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 633/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:58.361935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ed4d5-c860-4079-917a-1cb5f35cd99f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:58.478050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ed4d5-c860-4079-917a-1cb5f35cd99f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:58.516223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a3de-6422-4c0f-9e13-2e1e6e52723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:58.517290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a3de-6422-4c0f-9e13-2e1e6e52723a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:58.517569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a3de-6422-4c0f-9e13-2e1e6e52723a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:58.517844 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a3de-6422-4c0f-9e13-2e1e6e52723a None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:58.518694 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a3de-6422-4c0f-9e13-2e1e6e52723a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:58.519004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a3de-6422-4c0f-9e13-2e1e6e52723a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:58.520477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a3de-6422-4c0f-9e13-2e1e6e52723a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:58.531258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:58.541520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 635/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 21 08:16:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:58.547720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f60fd-6a22-43bb-b3a9-638e45886090 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:58.690143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f60fd-6a22-43bb-b3a9-638e45886090 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:58.728553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c145ca3-929c-4dc5-8a0b-f97397a59bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:58.729448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145ca3-929c-4dc5-8a0b-f97397a59bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:58.729732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145ca3-929c-4dc5-8a0b-f97397a59bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:58.730054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145ca3-929c-4dc5-8a0b-f97397a59bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:58.742562 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c145ca3-929c-4dc5-8a0b-f97397a59bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:58.744077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c145ca3-929c-4dc5-8a0b-f97397a59bf5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2c145ca3-929c-4dc5-8a0b-f97397a59bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:16:58.762939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:58.764024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:58.765345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:16:58.765345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:16:58.765345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:16:58.765345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:58.765345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 634/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:58.770942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a3de-6422-4c0f-9e13-2e1e6e52723a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:58.885812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a3de-6422-4c0f-9e13-2e1e6e52723a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:58.923834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805a6aa-94ef-4e00-8dfa-5cfafa6bd4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:58.924520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805a6aa-94ef-4e00-8dfa-5cfafa6bd4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:58.924811 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805a6aa-94ef-4e00-8dfa-5cfafa6bd4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:58.925084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805a6aa-94ef-4e00-8dfa-5cfafa6bd4c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:58.925813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805a6aa-94ef-4e00-8dfa-5cfafa6bd4c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:58.926118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805a6aa-94ef-4e00-8dfa-5cfafa6bd4c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:58.927506 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805a6aa-94ef-4e00-8dfa-5cfafa6bd4c6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:58.939272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 636/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:58.945165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c145ca3-929c-4dc5-8a0b-f97397a59bf5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:58.981128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:59.056935 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c145ca3-929c-4dc5-8a0b-f97397a59bf5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:59.093219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a6ee7-4206-4498-906f-3b46137852c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:59.094051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a6ee7-4206-4498-906f-3b46137852c2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.094331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a6ee7-4206-4498-906f-3b46137852c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.094609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a6ee7-4206-4498-906f-3b46137852c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.102102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a6ee7-4206-4498-906f-3b46137852c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:59.103589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a6ee7-4206-4498-906f-3b46137852c2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f78a6ee7-4206-4498-906f-3b46137852c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:16:59.118800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:16:59.119975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:16:59.121121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:16:59.121121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:16:59.121121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:16:59.121121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:16:59.121121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:16:59.121121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:16:59.121121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:16:59.121121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:16:59.121121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 635/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:16:59.126340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805a6aa-94ef-4e00-8dfa-5cfafa6bd4c6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:59.190344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:59.243909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805a6aa-94ef-4e00-8dfa-5cfafa6bd4c6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:59.283539 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838e941-7329-4b99-8629-01cd16c70ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:59.284293 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838e941-7329-4b99-8629-01cd16c70ade None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.284637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838e941-7329-4b99-8629-01cd16c70ade None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.284949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838e941-7329-4b99-8629-01cd16c70ade None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.285773 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838e941-7329-4b99-8629-01cd16c70ade None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:16:59.286080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838e941-7329-4b99-8629-01cd16c70ade None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:59.287567 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838e941-7329-4b99-8629-01cd16c70ade None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:59.302608 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 637/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:16:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:16:59.309731 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a6ee7-4206-4498-906f-3b46137852c2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:16:59.410050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:16:59.423748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a6ee7-4206-4498-906f-3b46137852c2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:16:59.462551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c92544-f5f4-4410-b782-d19d0f23eea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:16:59.463463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c92544-f5f4-4410-b782-d19d0f23eea6 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:16:59.463739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c92544-f5f4-4410-b782-d19d0f23eea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:16:59.463991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c92544-f5f4-4410-b782-d19d0f23eea6 None admin] PATH_INFO: `/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/1fd9ea435d7b48cb8b1b2a27d79cfa91/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:16:59.466148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c92544-f5f4-4410-b782-d19d0f23eea6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c487ed72a15c45faa40f743ae752e48b, user_id=1fd9ea435d7b48cb8b1b2a27d79cfa91, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:16:59.467613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c92544-f5f4-4410-b782-d19d0f23eea6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:16:59.482280 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 636/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 21 08:16:59 2022] PUT /identity/v3/projects/c487ed72a15c45faa40f743ae752e48b/users/1fd9ea435d7b48cb8b1b2a27d79cfa91/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:17:01.500511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336e402-7395-4ca5-9435-cb37acf31c57 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:01.501355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336e402-7395-4ca5-9435-cb37acf31c57 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:01.501355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336e402-7395-4ca5-9435-cb37acf31c57 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:01.503623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 638/1274] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:17:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:01.512151 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6187b-6c86-4926-8d6d-817d8f9b85f3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:01.512666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6187b-6c86-4926-8d6d-817d8f9b85f3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:01.512666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6187b-6c86-4926-8d6d-817d8f9b85f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:01.532189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e3d6187b-6c86-4926-8d6d-817d8f9b85f3 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:01.533435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e3d6187b-6c86-4926-8d6d-817d8f9b85f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:01.614913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 637/1275] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:01.646404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336e402-7395-4ca5-9435-cb37acf31c57 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:01.772243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336e402-7395-4ca5-9435-cb37acf31c57 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:01.797060 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:01.824533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad29d19-c8e7-40c4-be08-287e56da99f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:01.825661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad29d19-c8e7-40c4-be08-287e56da99f6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:01.825899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad29d19-c8e7-40c4-be08-287e56da99f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:01.826189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad29d19-c8e7-40c4-be08-287e56da99f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:01.842955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad29d19-c8e7-40c4-be08-287e56da99f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6ad29d19-c8e7-40c4-be08-287e56da99f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:17:01.851326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:01.852422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:17:01.853455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 639/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 21 08:17:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:01.862697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6187b-6c86-4926-8d6d-817d8f9b85f3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:01.961015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:01.989973 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6187b-6c86-4926-8d6d-817d8f9b85f3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:02.039096 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3f440-7014-442c-96d8-b44d813b4adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:02.039753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3f440-7014-442c-96d8-b44d813b4adf None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:02.040057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3f440-7014-442c-96d8-b44d813b4adf None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:02.040325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3f440-7014-442c-96d8-b44d813b4adf None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:02.041123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3f440-7014-442c-96d8-b44d813b4adf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:02.041433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3f440-7014-442c-96d8-b44d813b4adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:02.042838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3f440-7014-442c-96d8-b44d813b4adf None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:02.054041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 638/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 21 08:17:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:02.061861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad29d19-c8e7-40c4-be08-287e56da99f6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:02.190400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad29d19-c8e7-40c4-be08-287e56da99f6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:02.235151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34783f-91c5-4368-90a5-20e970b1994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:02.236140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34783f-91c5-4368-90a5-20e970b1994a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:02.236656 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34783f-91c5-4368-90a5-20e970b1994a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:02.237080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34783f-91c5-4368-90a5-20e970b1994a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:02.257582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34783f-91c5-4368-90a5-20e970b1994a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:02.259797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34783f-91c5-4368-90a5-20e970b1994a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8b34783f-91c5-4368-90a5-20e970b1994a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:02.280639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:02.281668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:02.282714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:02.282714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:02.282714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:02.282714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:17:02.282714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 640/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:02.288069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3f440-7014-442c-96d8-b44d813b4adf None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:02.406044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3f440-7014-442c-96d8-b44d813b4adf None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:02.445963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f2c68-927f-4661-bb0e-c13156fd2381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:02.446635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f2c68-927f-4661-bb0e-c13156fd2381 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:02.446908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f2c68-927f-4661-bb0e-c13156fd2381 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:02.447179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f2c68-927f-4661-bb0e-c13156fd2381 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:02.447906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f2c68-927f-4661-bb0e-c13156fd2381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:02.448211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f2c68-927f-4661-bb0e-c13156fd2381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:02.449831 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f2c68-927f-4661-bb0e-c13156fd2381 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:02.462626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 639/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:02.471592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34783f-91c5-4368-90a5-20e970b1994a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:02.510679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:02.601859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34783f-91c5-4368-90a5-20e970b1994a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:02.643749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2413fc-c87f-4069-a596-3c3910236bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:02.644546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2413fc-c87f-4069-a596-3c3910236bcc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:02.644858 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2413fc-c87f-4069-a596-3c3910236bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:02.645133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2413fc-c87f-4069-a596-3c3910236bcc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:02.653816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2413fc-c87f-4069-a596-3c3910236bcc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:02.655329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2413fc-c87f-4069-a596-3c3910236bcc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1f2413fc-c87f-4069-a596-3c3910236bcc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:17:02.670647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:02.671950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:02.673092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:02.673092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:02.673092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:17:02.673092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:17:02.673092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:17:02.673092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:17:02.673092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:17:02.673092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:17:02.673092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:17:02.673092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:17:02.673092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 641/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:02.678392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f2c68-927f-4661-bb0e-c13156fd2381 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:02.684247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:02.794615 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f2c68-927f-4661-bb0e-c13156fd2381 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:02.830731 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8d0ad-0177-4f3e-ac7a-a85cc1202cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:02.831406 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8d0ad-0177-4f3e-ac7a-a85cc1202cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:02.831687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8d0ad-0177-4f3e-ac7a-a85cc1202cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:02.831961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8d0ad-0177-4f3e-ac7a-a85cc1202cd5 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:02.832837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8d0ad-0177-4f3e-ac7a-a85cc1202cd5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:02.833146 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8d0ad-0177-4f3e-ac7a-a85cc1202cd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:02.834605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8d0ad-0177-4f3e-ac7a-a85cc1202cd5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:02.852397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 640/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 21 08:17:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:02.859062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2413fc-c87f-4069-a596-3c3910236bcc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:02.964057 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:02.975070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2413fc-c87f-4069-a596-3c3910236bcc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.010443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217157d0-f379-4b59-91a9-e3d3b95cb5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.011107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217157d0-f379-4b59-91a9-e3d3b95cb5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.011424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217157d0-f379-4b59-91a9-e3d3b95cb5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.011719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217157d0-f379-4b59-91a9-e3d3b95cb5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.097718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217157d0-f379-4b59-91a9-e3d3b95cb5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:03.099117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217157d0-f379-4b59-91a9-e3d3b95cb5a7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:03.204322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:03.222408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 642/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 21 08:17:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:17:03.228555 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8d0ad-0177-4f3e-ac7a-a85cc1202cd5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.290745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:03.338241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8d0ad-0177-4f3e-ac7a-a85cc1202cd5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.376745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1bc36-0b26-4a7f-81d4-233d8e3c7ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.377547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1bc36-0b26-4a7f-81d4-233d8e3c7ebb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.377851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1bc36-0b26-4a7f-81d4-233d8e3c7ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.378195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1bc36-0b26-4a7f-81d4-233d8e3c7ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.390422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1bc36-0b26-4a7f-81d4-233d8e3c7ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:03.392219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1bc36-0b26-4a7f-81d4-233d8e3c7ebb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4eb1bc36-0b26-4a7f-81d4-233d8e3c7ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:17:03.410491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:03.411583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:03.412916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:17:03.412916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:17:03.412916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:17:03.412916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:17:03.412916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 641/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:03.417916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217157d0-f379-4b59-91a9-e3d3b95cb5a7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.535292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217157d0-f379-4b59-91a9-e3d3b95cb5a7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.572023 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88d420-aac1-42fe-8833-d2bfd3fd6ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.572748 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88d420-aac1-42fe-8833-d2bfd3fd6ecb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.573024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88d420-aac1-42fe-8833-d2bfd3fd6ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.573294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88d420-aac1-42fe-8833-d2bfd3fd6ecb None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.574035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88d420-aac1-42fe-8833-d2bfd3fd6ecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:03.574448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88d420-aac1-42fe-8833-d2bfd3fd6ecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:03.575781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88d420-aac1-42fe-8833-d2bfd3fd6ecb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:03.589534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 643/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:03.596057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1bc36-0b26-4a7f-81d4-233d8e3c7ebb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.705460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1bc36-0b26-4a7f-81d4-233d8e3c7ebb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.720158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:03.741794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953a6d3-b79e-4f61-9fd4-3a2b19e586a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.742602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953a6d3-b79e-4f61-9fd4-3a2b19e586a0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.742882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953a6d3-b79e-4f61-9fd4-3a2b19e586a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.743157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953a6d3-b79e-4f61-9fd4-3a2b19e586a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.750290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953a6d3-b79e-4f61-9fd4-3a2b19e586a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:03.751792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953a6d3-b79e-4f61-9fd4-3a2b19e586a0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e953a6d3-b79e-4f61-9fd4-3a2b19e586a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:17:03.765918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:03.767415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:03.768687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:17:03.768687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:17:03.768687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:17:03.768687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:17:03.768687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:17:03.768687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:17:03.768687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:17:03.768687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 21 08:17:03.768687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 642/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:03.774002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88d420-aac1-42fe-8833-d2bfd3fd6ecb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:03.830093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:03.908538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88d420-aac1-42fe-8833-d2bfd3fd6ecb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:03.945789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4bef3-dbf8-4561-9466-78d37c019377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:03.946452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4bef3-dbf8-4561-9466-78d37c019377 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:03.946731 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4bef3-dbf8-4561-9466-78d37c019377 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:03.946962 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4bef3-dbf8-4561-9466-78d37c019377 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:03.947782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4bef3-dbf8-4561-9466-78d37c019377 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:03.948093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4bef3-dbf8-4561-9466-78d37c019377 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:03.949593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4bef3-dbf8-4561-9466-78d37c019377 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:03.965006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 644/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:03.971534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953a6d3-b79e-4f61-9fd4-3a2b19e586a0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:04.092522 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953a6d3-b79e-4f61-9fd4-3a2b19e586a0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:04.127487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453d0a9-e58b-4766-8322-450cc4e940c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:04.128140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d0a9-e58b-4766-8322-450cc4e940c6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:04.128422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d0a9-e58b-4766-8322-450cc4e940c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:04.128720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d0a9-e58b-4766-8322-450cc4e940c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:04.129554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453d0a9-e58b-4766-8322-450cc4e940c6 None admin] RBAC: Adding query filter params (role.id=fee299f447b040f6b5d08cb30a0b3295, scope.project.id=c487ed72a15c45faa40f743ae752e48b, user.id=1fd9ea435d7b48cb8b1b2a27d79cfa91) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:04.129862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453d0a9-e58b-4766-8322-450cc4e940c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:04.131356 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453d0a9-e58b-4766-8322-450cc4e940c6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:04.137526 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 643/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 21 08:17:03 2022] GET /identity/v3/role_assignments?user.id=1fd9ea435d7b48cb8b1b2a27d79cfa91&scope.project.id=c487ed72a15c45faa40f743ae752e48b&role.id=fee299f447b040f6b5d08cb30a0b3295 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:06.315939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74188d3-a1e4-4fba-b94f-53ec42539d95 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.316447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74188d3-a1e4-4fba-b94f-53ec42539d95 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.316447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74188d3-a1e4-4fba-b94f-53ec42539d95 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.317930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 645/1288] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:06.323469 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc5ed8-8b5c-4e02-9a1d-a994db29bcaa None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.323905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc5ed8-8b5c-4e02-9a1d-a994db29bcaa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.323995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc5ed8-8b5c-4e02-9a1d-a994db29bcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.342372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-32bc5ed8-8b5c-4e02-9a1d-a994db29bcaa None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:06.343562 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-32bc5ed8-8b5c-4e02-9a1d-a994db29bcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:06.377173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:06.428306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 644/1289] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:06.449978 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74188d3-a1e4-4fba-b94f-53ec42539d95 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:06.563052 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74188d3-a1e4-4fba-b94f-53ec42539d95 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:06.578100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:06.607409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd6062-ca1d-4f92-a956-9ce2132ae87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:06.608141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd6062-ca1d-4f92-a956-9ce2132ae87f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.608424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd6062-ca1d-4f92-a956-9ce2132ae87f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.608731 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd6062-ca1d-4f92-a956-9ce2132ae87f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.609455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd6062-ca1d-4f92-a956-9ce2132ae87f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:06.611092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd6062-ca1d-4f92-a956-9ce2132ae87f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1ecd6062-ca1d-4f92-a956-9ce2132ae87f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:06.625198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:06.626677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:17:06.627633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 646/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 21 08:17:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:06.633137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc5ed8-8b5c-4e02-9a1d-a994db29bcaa None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:06.739822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc5ed8-8b5c-4e02-9a1d-a994db29bcaa None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:06.781900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d43ca-a333-4701-a413-0f593cb7bdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:06.782569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d43ca-a333-4701-a413-0f593cb7bdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.782845 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d43ca-a333-4701-a413-0f593cb7bdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.783121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d43ca-a333-4701-a413-0f593cb7bdf1 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.783826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d43ca-a333-4701-a413-0f593cb7bdf1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:06.784129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d43ca-a333-4701-a413-0f593cb7bdf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:06.785553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d43ca-a333-4701-a413-0f593cb7bdf1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:06.790781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 645/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jul 21 08:17:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:06.796803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd6062-ca1d-4f92-a956-9ce2132ae87f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:06.919808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd6062-ca1d-4f92-a956-9ce2132ae87f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:06.955800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7c968-4d3a-4722-a829-e5b8bb3b5ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:06.956471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7c968-4d3a-4722-a829-e5b8bb3b5ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:06.956924 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7c968-4d3a-4722-a829-e5b8bb3b5ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:06.957198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7c968-4d3a-4722-a829-e5b8bb3b5ea6 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:06.957912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7c968-4d3a-4722-a829-e5b8bb3b5ea6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:06.958222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7c968-4d3a-4722-a829-e5b8bb3b5ea6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:06.959612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7c968-4d3a-4722-a829-e5b8bb3b5ea6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:06.964283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 647/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jul 21 08:17:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:08.995505 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49e5f-f52c-412e-a013-f8ce8a4f51c1 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:08.996110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49e5f-f52c-412e-a013-f8ce8a4f51c1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:08.996110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49e5f-f52c-412e-a013-f8ce8a4f51c1 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:08.997583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 646/1293] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:09.004259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f55b59-031b-4fa9-85d0-625ca5178858 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:09.004790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f55b59-031b-4fa9-85d0-625ca5178858 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:09.004902 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f55b59-031b-4fa9-85d0-625ca5178858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:09.030309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-69f55b59-031b-4fa9-85d0-625ca5178858 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:09.031543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-69f55b59-031b-4fa9-85d0-625ca5178858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:09.066458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:09.107980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 648/1294] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:09.131702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49e5f-f52c-412e-a013-f8ce8a4f51c1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:09.168152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:09.250880 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49e5f-f52c-412e-a013-f8ce8a4f51c1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:09.286854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bea630-bda2-4234-9082-60336b05b9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:09.287538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bea630-bda2-4234-9082-60336b05b9a6 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:09.287820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bea630-bda2-4234-9082-60336b05b9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:09.288094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bea630-bda2-4234-9082-60336b05b9a6 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:09.288864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bea630-bda2-4234-9082-60336b05b9a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:09.290253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bea630-bda2-4234-9082-60336b05b9a6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:09.306559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 647/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 21 08:17:09 2022] POST /identity/v3/services => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:11.365054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24735841-81d3-4f89-96d9-9e40ca7816bf None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.365651 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24735841-81d3-4f89-96d9-9e40ca7816bf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.365651 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24735841-81d3-4f89-96d9-9e40ca7816bf None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.367055 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 649/1296] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:11.374249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f51ef5-5e72-4f2e-bc29-8f0ce0bd1efe None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.374860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f51ef5-5e72-4f2e-bc29-8f0ce0bd1efe None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.374860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f51ef5-5e72-4f2e-bc29-8f0ce0bd1efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.392997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a0f51ef5-5e72-4f2e-bc29-8f0ce0bd1efe None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:11.394213 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a0f51ef5-5e72-4f2e-bc29-8f0ce0bd1efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:11.475584 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 648/1297] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:17:11.498573 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24735841-81d3-4f89-96d9-9e40ca7816bf None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.616146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24735841-81d3-4f89-96d9-9e40ca7816bf None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.656449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc98ae-2bce-4380-b92e-8c834867e423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.657415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc98ae-2bce-4380-b92e-8c834867e423 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.657803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc98ae-2bce-4380-b92e-8c834867e423 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.658138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc98ae-2bce-4380-b92e-8c834867e423 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.658948 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc98ae-2bce-4380-b92e-8c834867e423 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:11.660617 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc98ae-2bce-4380-b92e-8c834867e423 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a0dc98ae-2bce-4380-b92e-8c834867e423 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:11.674236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:11.675491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:17:11.676840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 650/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:17:11.681828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f51ef5-5e72-4f2e-bc29-8f0ce0bd1efe None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.701118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:11.796789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f51ef5-5e72-4f2e-bc29-8f0ce0bd1efe None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:11.843314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f05f49-3e85-41ec-8265-6184e133f215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:11.844458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f05f49-3e85-41ec-8265-6184e133f215 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:11.844807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f05f49-3e85-41ec-8265-6184e133f215 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:11.845085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f05f49-3e85-41ec-8265-6184e133f215 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:11.845890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f05f49-3e85-41ec-8265-6184e133f215 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:11.846194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f05f49-3e85-41ec-8265-6184e133f215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:11.847610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f05f49-3e85-41ec-8265-6184e133f215 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:11.854831 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 649/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:11.861478 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc98ae-2bce-4380-b92e-8c834867e423 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:11.903113 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:12.024094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc98ae-2bce-4380-b92e-8c834867e423 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:12.079372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63860883-39fc-4e8f-a8ee-0fc4df685e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:12.080201 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63860883-39fc-4e8f-a8ee-0fc4df685e6c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:12.080697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63860883-39fc-4e8f-a8ee-0fc4df685e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:12.081197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63860883-39fc-4e8f-a8ee-0fc4df685e6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.082742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63860883-39fc-4e8f-a8ee-0fc4df685e6c None admin] RBAC: Adding query filter params (interface=public, service_id=ae0a510ec4fd40f28a7649228a763f97, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:12.083283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63860883-39fc-4e8f-a8ee-0fc4df685e6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.085316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63860883-39fc-4e8f-a8ee-0fc4df685e6c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.094996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 651/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 21 08:17:11 2022] GET /identity/v3/endpoints?service_id=ae0a510ec4fd40f28a7649228a763f97&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:12.100825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f05f49-3e85-41ec-8265-6184e133f215 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:12.211641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:12.232689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f05f49-3e85-41ec-8265-6184e133f215 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:12.270054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c691-8975-44a1-92bc-8ac98e7bbc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:12.270730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c691-8975-44a1-92bc-8ac98e7bbc7b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:12.271008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c691-8975-44a1-92bc-8ac98e7bbc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:12.271273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c691-8975-44a1-92bc-8ac98e7bbc7b None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:12.271958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c691-8975-44a1-92bc-8ac98e7bbc7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:12.273397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c691-8975-44a1-92bc-8ac98e7bbc7b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:12.282836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 650/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 21 08:17:12 2022] GET /identity/v3/services => generated 2191 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:17:14.393412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36166ce8-9143-4a24-9c96-2b552a891c1c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.393987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36166ce8-9143-4a24-9c96-2b552a891c1c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.393987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36166ce8-9143-4a24-9c96-2b552a891c1c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.395392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 652/1302] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:17:14.401517 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2170be-96cf-4360-b79e-44374208eb44 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.402063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2170be-96cf-4360-b79e-44374208eb44 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.402063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2170be-96cf-4360-b79e-44374208eb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.421378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-eb2170be-96cf-4360-b79e-44374208eb44 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:17:14.422602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-eb2170be-96cf-4360-b79e-44374208eb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:17:14.497708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 651/1303] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:17:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:17:14.521160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36166ce8-9143-4a24-9c96-2b552a891c1c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:14.633666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:14.641898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36166ce8-9143-4a24-9c96-2b552a891c1c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:14.678400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8c45b-bca3-496c-9bb9-477bb27943d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:14.679218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8c45b-bca3-496c-9bb9-477bb27943d0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.679490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8c45b-bca3-496c-9bb9-477bb27943d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.679758 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8c45b-bca3-496c-9bb9-477bb27943d0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.680414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8c45b-bca3-496c-9bb9-477bb27943d0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:14.681848 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8c45b-bca3-496c-9bb9-477bb27943d0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-32b8c45b-bca3-496c-9bb9-477bb27943d0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:17:14.694668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:17:14.695982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 21 08:17:14.697077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 653/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 21 08:17:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:17:14.702418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2170be-96cf-4360-b79e-44374208eb44 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:14.786917 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:14.812133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2170be-96cf-4360-b79e-44374208eb44 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:14.847722 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee29d2c-9180-48d0-91e8-4c50f8155e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:14.848397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee29d2c-9180-48d0-91e8-4c50f8155e37 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:14.848710 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee29d2c-9180-48d0-91e8-4c50f8155e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:14.848968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee29d2c-9180-48d0-91e8-4c50f8155e37 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:14.849686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee29d2c-9180-48d0-91e8-4c50f8155e37 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:17:14.849991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee29d2c-9180-48d0-91e8-4c50f8155e37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:14.851396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee29d2c-9180-48d0-91e8-4c50f8155e37 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:14.857662 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 652/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jul 21 08:17:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:17:14.863810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8c45b-bca3-496c-9bb9-477bb27943d0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:17:14.975047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8c45b-bca3-496c-9bb9-477bb27943d0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:17:15.014407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f435b-1d1e-4770-b109-48ebc6756f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:17:15.015076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f435b-1d1e-4770-b109-48ebc6756f40 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:17:15.015356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f435b-1d1e-4770-b109-48ebc6756f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:17:15.015628 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f435b-1d1e-4770-b109-48ebc6756f40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:17:15.016779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f435b-1d1e-4770-b109-48ebc6756f40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:17:15.018207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f435b-1d1e-4770-b109-48ebc6756f40 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:17:15.039750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 654/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 21 08:17:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:17:24.854394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=30 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:17:25.034642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:20.068176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afc059-66bb-4191-ae89-f9ad07cbcb7e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:20.068789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afc059-66bb-4191-ae89-f9ad07cbcb7e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:20.068789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afc059-66bb-4191-ae89-f9ad07cbcb7e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:20.070314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 653/1307] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:20.075522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a2e12-250a-442e-b055-87914b5ca834 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:20.076135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a2e12-250a-442e-b055-87914b5ca834 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:20.076135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a2e12-250a-442e-b055-87914b5ca834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:20.162755 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-910a2e12-250a-442e-b055-87914b5ca834 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:20.163870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-910a2e12-250a-442e-b055-87914b5ca834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:20.297054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 655/1308] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:20.344351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f6768-53f2-4d40-89be-051b90d78655 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:20.345036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f6768-53f2-4d40-89be-051b90d78655 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:20.345519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f6768-53f2-4d40-89be-051b90d78655 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:20.347168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 654/1309] 10.222.0.40 () {54 vars in 965 bytes} [Thu Jul 21 08:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:20.355186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553ab2-0c2f-4958-ae19-b12e91b12e23 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:20.355611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553ab2-0c2f-4958-ae19-b12e91b12e23 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:20.355958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553ab2-0c2f-4958-ae19-b12e91b12e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:20.459847 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f2553ab2-0c2f-4958-ae19-b12e91b12e23 None None] MFA Rules not processed for user `06a267cec6fb4dbea619f0a77b5674dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:20.461127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f2553ab2-0c2f-4958-ae19-b12e91b12e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:20.516342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:20.628714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 656/1310] 10.222.0.40 () {58 vars in 1062 bytes} [Thu Jul 21 08:18:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:20.629550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f6768-53f2-4d40-89be-051b90d78655 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:20.631336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f06f6768-53f2-4d40-89be-051b90d78655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:20.753649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f6768-53f2-4d40-89be-051b90d78655 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:20.829941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bff05e-72c4-423a-883f-42973f087a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:20.830610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bff05e-72c4-423a-883f-42973f087a49 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:20.830888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bff05e-72c4-423a-883f-42973f087a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:20.831160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bff05e-72c4-423a-883f-42973f087a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:20.832855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e6bff05e-72c4-423a-883f-42973f087a49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:20.889120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:20.951424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bff05e-72c4-423a-883f-42973f087a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:20.953372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bff05e-72c4-423a-883f-42973f087a49 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:20.994682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 655/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:18:23.353032 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac2523-f1c4-4be9-832c-62616ec1d9aa None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:23.353603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac2523-f1c4-4be9-832c-62616ec1d9aa None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:23.353603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac2523-f1c4-4be9-832c-62616ec1d9aa None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:23.354945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 657/1312] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:23.360616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1799970-c674-467c-8a05-7be0c08c5bdc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:23.361098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1799970-c674-467c-8a05-7be0c08c5bdc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:23.361189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1799970-c674-467c-8a05-7be0c08c5bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:23.436854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e1799970-c674-467c-8a05-7be0c08c5bdc None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:23.438096 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e1799970-c674-467c-8a05-7be0c08c5bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:23.539689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 656/1313] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:23.591776 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9050c99-bef5-47bd-b001-898d9a8ef567 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:23.592033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9050c99-bef5-47bd-b001-898d9a8ef567 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:23.592320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9050c99-bef5-47bd-b001-898d9a8ef567 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:23.593743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 658/1314] 10.222.0.40 () {54 vars in 965 bytes} [Thu Jul 21 08:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:23.600176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c17fcb-52a8-4b2b-a0d4-bc22a025914d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:23.600457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c17fcb-52a8-4b2b-a0d4-bc22a025914d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:23.600761 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c17fcb-52a8-4b2b-a0d4-bc22a025914d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:23.614922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:23.688004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c6c17fcb-52a8-4b2b-a0d4-bc22a025914d None None] MFA Rules not processed for user `06a267cec6fb4dbea619f0a77b5674dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:23.689252 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c6c17fcb-52a8-4b2b-a0d4-bc22a025914d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:23.774587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 657/1315] 10.222.0.40 () {58 vars in 1062 bytes} [Thu Jul 21 08:18:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:23.784027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9050c99-bef5-47bd-b001-898d9a8ef567 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:23.785631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d9050c99-bef5-47bd-b001-898d9a8ef567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:23.907839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9050c99-bef5-47bd-b001-898d9a8ef567 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:23.984032 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:23.986826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7ec67-5d90-406c-88e2-5d412069cb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:23.987524 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7ec67-5d90-406c-88e2-5d412069cb24 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:23.987792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7ec67-5d90-406c-88e2-5d412069cb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:23.988078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7ec67-5d90-406c-88e2-5d412069cb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:23.990436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-aed7ec67-5d90-406c-88e2-5d412069cb24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:24.107631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7ec67-5d90-406c-88e2-5d412069cb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:24.109285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7ec67-5d90-406c-88e2-5d412069cb24 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:24.129245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 659/1316] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:18:26.741394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e9c41-3e99-49df-aed2-242d96824064 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:26.741973 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e9c41-3e99-49df-aed2-242d96824064 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:26.741973 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e9c41-3e99-49df-aed2-242d96824064 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:26.743351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 658/1317] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:26.748877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c48c5-e8ed-4204-b7f2-a1a69f6f3d3c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:26.749325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c48c5-e8ed-4204-b7f2-a1a69f6f3d3c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:26.749448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c48c5-e8ed-4204-b7f2-a1a69f6f3d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:26.816479 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8b2c48c5-e8ed-4204-b7f2-a1a69f6f3d3c None None] MFA Rules not processed for user `c91018e1aa094e4cbbd6eadad3738ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:26.817760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8b2c48c5-e8ed-4204-b7f2-a1a69f6f3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:26.873804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:26.922508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 660/1318] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:26.962099 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e9c41-3e99-49df-aed2-242d96824064 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:26.963672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9d3e9c41-3e99-49df-aed2-242d96824064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:27.079806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e9c41-3e99-49df-aed2-242d96824064 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:27.082626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:27.159746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed1723-90a3-4041-b429-e44146c39d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:27.160408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed1723-90a3-4041-b429-e44146c39d95 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:27.160722 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed1723-90a3-4041-b429-e44146c39d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:27.160994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed1723-90a3-4041-b429-e44146c39d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:27.162638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a1ed1723-90a3-4041-b429-e44146c39d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:27.278293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed1723-90a3-4041-b429-e44146c39d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:27.279809 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed1723-90a3-4041-b429-e44146c39d95 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:27.298848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 659/1319] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:18:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:18:29.950683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de550ac-136c-4915-bb3c-68a4fc1bc202 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:29.951266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de550ac-136c-4915-bb3c-68a4fc1bc202 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:29.951266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de550ac-136c-4915-bb3c-68a4fc1bc202 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:29.952672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 661/1320] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:29.958160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f25ae-9c71-4bf3-915f-6e0e5bd4c803 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:29.958614 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f25ae-9c71-4bf3-915f-6e0e5bd4c803 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:29.958707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f25ae-9c71-4bf3-915f-6e0e5bd4c803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:29.999346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:30.026661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d98f25ae-9c71-4bf3-915f-6e0e5bd4c803 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:30.027892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d98f25ae-9c71-4bf3-915f-6e0e5bd4c803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:30.126850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 660/1321] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:30.166118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de550ac-136c-4915-bb3c-68a4fc1bc202 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:30.167685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0de550ac-136c-4915-bb3c-68a4fc1bc202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:30.283620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de550ac-136c-4915-bb3c-68a4fc1bc202 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:30.370256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf2815-ca3a-4688-a4b2-241e13ffb6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:30.370918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf2815-ca3a-4688-a4b2-241e13ffb6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.371192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf2815-ca3a-4688-a4b2-241e13ffb6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.371460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf2815-ca3a-4688-a4b2-241e13ffb6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.373230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-88bf2815-ca3a-4688-a4b2-241e13ffb6c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:30.381082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:30.490542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf2815-ca3a-4688-a4b2-241e13ffb6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:30.492027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf2815-ca3a-4688-a4b2-241e13ffb6c4 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:30.511621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 662/1322] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:18:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:18:33.761881 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72dbd7-ac0a-44b3-b297-83df63c5edaf None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.762509 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72dbd7-ac0a-44b3-b297-83df63c5edaf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.762920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72dbd7-ac0a-44b3-b297-83df63c5edaf None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.765191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 661/1323] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:18:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:33.771771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef50889-64d2-420f-98a2-51beb3e64462 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.772359 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef50889-64d2-420f-98a2-51beb3e64462 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.772359 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef50889-64d2-420f-98a2-51beb3e64462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.867007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4ef50889-64d2-420f-98a2-51beb3e64462 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:33.869026 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4ef50889-64d2-420f-98a2-51beb3e64462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:33.953842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:34.011692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 663/1324] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:34.074479 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72dbd7-ac0a-44b3-b297-83df63c5edaf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:34.076129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2f72dbd7-ac0a-44b3-b297-83df63c5edaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:34.239809 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72dbd7-ac0a-44b3-b297-83df63c5edaf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:34.259895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:34.376621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e4315-a550-403f-aaba-0c769854061e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:34.377393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e4315-a550-403f-aaba-0c769854061e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:34.377744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e4315-a550-403f-aaba-0c769854061e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:34.378177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e4315-a550-403f-aaba-0c769854061e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:34.380204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1c4e4315-a550-403f-aaba-0c769854061e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:34.528914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e4315-a550-403f-aaba-0c769854061e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:34.530375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e4315-a550-403f-aaba-0c769854061e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:34.550500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 662/1325] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:18:36.736621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f655e-303a-4330-b604-cae49bafba41 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:36.737242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f655e-303a-4330-b604-cae49bafba41 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:36.737242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f655e-303a-4330-b604-cae49bafba41 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:36.738686 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 664/1326] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:36.744850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413aad3-1b91-4c4f-a0d1-82fa6be8a53a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:36.745432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413aad3-1b91-4c4f-a0d1-82fa6be8a53a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:36.745542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413aad3-1b91-4c4f-a0d1-82fa6be8a53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:36.806742 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:36.827711 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e413aad3-1b91-4c4f-a0d1-82fa6be8a53a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:36.828985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e413aad3-1b91-4c4f-a0d1-82fa6be8a53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:36.932177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 663/1327] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:36.969437 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f655e-303a-4330-b604-cae49bafba41 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:36.971010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5b4f655e-303a-4330-b604-cae49bafba41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:37.081682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f655e-303a-4330-b604-cae49bafba41 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:37.160659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf6951-ca61-4588-9d5d-39b146d9711d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:37.161312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf6951-ca61-4588-9d5d-39b146d9711d service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:37.161592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf6951-ca61-4588-9d5d-39b146d9711d service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:37.161864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf6951-ca61-4588-9d5d-39b146d9711d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:37.163508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-56bf6951-ca61-4588-9d5d-39b146d9711d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:37.181065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:37.282823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf6951-ca61-4588-9d5d-39b146d9711d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:37.284294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf6951-ca61-4588-9d5d-39b146d9711d service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:37.305345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 665/1328] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:18:39.421231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d068-35e0-4738-b78c-97030a9f3f73 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.421836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d068-35e0-4738-b78c-97030a9f3f73 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.421938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d068-35e0-4738-b78c-97030a9f3f73 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:39.423425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 664/1329] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:39.429432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b249069-604e-4ccc-b493-1388f72fb2a6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.430163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b249069-604e-4ccc-b493-1388f72fb2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.430163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b249069-604e-4ccc-b493-1388f72fb2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:39.500958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2b249069-604e-4ccc-b493-1388f72fb2a6 None None] MFA Rules not processed for user `c91018e1aa094e4cbbd6eadad3738ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:39.502205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2b249069-604e-4ccc-b493-1388f72fb2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:39.574372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:39.608004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 666/1330] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:39.646541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294d068-35e0-4738-b78c-97030a9f3f73 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:39.648101 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3294d068-35e0-4738-b78c-97030a9f3f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:39.760214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294d068-35e0-4738-b78c-97030a9f3f73 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:39.781043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:39.837999 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904038c7-71bd-450f-8c3c-3732bcd3019e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:39.838691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904038c7-71bd-450f-8c3c-3732bcd3019e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.838972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904038c7-71bd-450f-8c3c-3732bcd3019e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.839243 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904038c7-71bd-450f-8c3c-3732bcd3019e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:39.840959 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-904038c7-71bd-450f-8c3c-3732bcd3019e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:39.975824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904038c7-71bd-450f-8c3c-3732bcd3019e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:39.977581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904038c7-71bd-450f-8c3c-3732bcd3019e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:39.999299 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 665/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:18:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:18:42.294050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e34c18-516b-4f82-b37a-227f2f7d670c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.294653 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e34c18-516b-4f82-b37a-227f2f7d670c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.294653 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e34c18-516b-4f82-b37a-227f2f7d670c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.295983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 667/1332] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:42.301869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64172d95-4525-4132-a281-36ed7150aaaa None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.302268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64172d95-4525-4132-a281-36ed7150aaaa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.302396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64172d95-4525-4132-a281-36ed7150aaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.368775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:42.371536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-64172d95-4525-4132-a281-36ed7150aaaa None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:42.373556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-64172d95-4525-4132-a281-36ed7150aaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:42.481119 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 666/1333] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:42.526040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e34c18-516b-4f82-b37a-227f2f7d670c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:42.527612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a9e34c18-516b-4f82-b37a-227f2f7d670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:42.653988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e34c18-516b-4f82-b37a-227f2f7d670c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:42.740479 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742426c-448c-4f77-b9bc-b88d61762f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:42.741092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742426c-448c-4f77-b9bc-b88d61762f51 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.741379 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742426c-448c-4f77-b9bc-b88d61762f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.741652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742426c-448c-4f77-b9bc-b88d61762f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.743357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4742426c-448c-4f77-b9bc-b88d61762f51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:42.782006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:42.872456 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742426c-448c-4f77-b9bc-b88d61762f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:42.874042 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742426c-448c-4f77-b9bc-b88d61762f51 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:42.898031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 668/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:18:45.027632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c1231-8f70-465d-9a56-1fe5f3a81e58 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.028282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c1231-8f70-465d-9a56-1fe5f3a81e58 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.028282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c1231-8f70-465d-9a56-1fe5f3a81e58 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.029753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 667/1335] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:45.038668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60867a15-8542-4309-9d2e-26ae07bac24a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.039340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60867a15-8542-4309-9d2e-26ae07bac24a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.039340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60867a15-8542-4309-9d2e-26ae07bac24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.133272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-60867a15-8542-4309-9d2e-26ae07bac24a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:45.135315 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-60867a15-8542-4309-9d2e-26ae07bac24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:45.275764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:45.315350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 669/1336] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:45.357127 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c1231-8f70-465d-9a56-1fe5f3a81e58 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:45.358682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d35c1231-8f70-465d-9a56-1fe5f3a81e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:45.474261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c1231-8f70-465d-9a56-1fe5f3a81e58 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:45.503354 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:45.551568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac588ca1-7da4-4d30-9361-d4b007859338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:45.552135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588ca1-7da4-4d30-9361-d4b007859338 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.552416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588ca1-7da4-4d30-9361-d4b007859338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.552716 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588ca1-7da4-4d30-9361-d4b007859338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.554447 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ac588ca1-7da4-4d30-9361-d4b007859338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:45.682759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac588ca1-7da4-4d30-9361-d4b007859338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:45.684219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac588ca1-7da4-4d30-9361-d4b007859338 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:45.704392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 668/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:18:48.173141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dbd3c-bdf7-4d6d-b922-4cdd201fde81 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:48.173732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dbd3c-bdf7-4d6d-b922-4cdd201fde81 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:48.173732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dbd3c-bdf7-4d6d-b922-4cdd201fde81 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:48.175082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 670/1338] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:48.180901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174b7a1-b08b-452d-a0a2-5ba2babdfe48 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:48.181359 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174b7a1-b08b-452d-a0a2-5ba2babdfe48 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:48.181466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174b7a1-b08b-452d-a0a2-5ba2babdfe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:48.253361 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7174b7a1-b08b-452d-a0a2-5ba2babdfe48 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:48.254593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7174b7a1-b08b-452d-a0a2-5ba2babdfe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:48.263106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:48.373950 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 669/1339] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:48.419852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dbd3c-bdf7-4d6d-b922-4cdd201fde81 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:48.421787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ca8dbd3c-bdf7-4d6d-b922-4cdd201fde81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:48.531866 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dbd3c-bdf7-4d6d-b922-4cdd201fde81 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:48.611874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a01fdf-61f5-451f-b84e-4ce1c0830532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:48.612522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01fdf-61f5-451f-b84e-4ce1c0830532 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:48.612849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01fdf-61f5-451f-b84e-4ce1c0830532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:48.613121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01fdf-61f5-451f-b84e-4ce1c0830532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:48.614829 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b7a01fdf-61f5-451f-b84e-4ce1c0830532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:48.659971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:48.738145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a01fdf-61f5-451f-b84e-4ce1c0830532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:48.739610 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a01fdf-61f5-451f-b84e-4ce1c0830532 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:48.763019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 671/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:18:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:18:53.049851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13aaf0f-520b-4571-b330-b7ceed20c55c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.050335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13aaf0f-520b-4571-b330-b7ceed20c55c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.050454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13aaf0f-520b-4571-b330-b7ceed20c55c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.051964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 670/1341] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:53.060658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84d0a5-bdf0-4af5-a88f-26fbb2b59188 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.061083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84d0a5-bdf0-4af5-a88f-26fbb2b59188 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.061262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84d0a5-bdf0-4af5-a88f-26fbb2b59188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.140990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ed84d0a5-bdf0-4af5-a88f-26fbb2b59188 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:53.142249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ed84d0a5-bdf0-4af5-a88f-26fbb2b59188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:53.233894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:53.245997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 672/1342] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:53.288520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13aaf0f-520b-4571-b330-b7ceed20c55c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:53.290946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e13aaf0f-520b-4571-b330-b7ceed20c55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:53.400028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13aaf0f-520b-4571-b330-b7ceed20c55c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:53.439216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:53.476615 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574af6e-947f-4043-a371-17a4442f4987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:53.477281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574af6e-947f-4043-a371-17a4442f4987 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.477561 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574af6e-947f-4043-a371-17a4442f4987 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.477839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574af6e-947f-4043-a371-17a4442f4987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.479495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b574af6e-947f-4043-a371-17a4442f4987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:53.592322 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574af6e-947f-4043-a371-17a4442f4987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:53.593746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574af6e-947f-4043-a371-17a4442f4987 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:53.612791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 671/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:18:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:18:56.327652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ae7b2-5c2b-4d89-9211-67175ab8d2ee None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:56.328209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ae7b2-5c2b-4d89-9211-67175ab8d2ee None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:56.328209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ae7b2-5c2b-4d89-9211-67175ab8d2ee None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:56.329665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 673/1344] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:56.336056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011dfcb-7caf-4dc3-90a9-01857aae131f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:56.336706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011dfcb-7caf-4dc3-90a9-01857aae131f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:56.336706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011dfcb-7caf-4dc3-90a9-01857aae131f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:56.416753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6011dfcb-7caf-4dc3-90a9-01857aae131f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:56.417897 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6011dfcb-7caf-4dc3-90a9-01857aae131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:56.439839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:56.543715 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 672/1345] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:18:56.585109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ae7b2-5c2b-4d89-9211-67175ab8d2ee None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:56.586799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6d5ae7b2-5c2b-4d89-9211-67175ab8d2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:56.710889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ae7b2-5c2b-4d89-9211-67175ab8d2ee None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:56.797499 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25152b-1d49-4b2f-b12f-c3cf3f29da3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:56.798510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25152b-1d49-4b2f-b12f-c3cf3f29da3b service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:56.798792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25152b-1d49-4b2f-b12f-c3cf3f29da3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:56.799067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25152b-1d49-4b2f-b12f-c3cf3f29da3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:56.801151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2d25152b-1d49-4b2f-b12f-c3cf3f29da3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:56.852878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:56.938009 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25152b-1d49-4b2f-b12f-c3cf3f29da3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:56.939535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25152b-1d49-4b2f-b12f-c3cf3f29da3b service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:56.962841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 674/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:18:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:19:01.318002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68549-b450-4ed5-8e05-30620723e4ba None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:01.318573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68549-b450-4ed5-8e05-30620723e4ba None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:01.318573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68549-b450-4ed5-8e05-30620723e4ba None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:01.319957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 673/1347] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:01.325891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e902c10-4362-4601-9ae5-6c68af2dff4b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:01.326325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e902c10-4362-4601-9ae5-6c68af2dff4b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:01.327121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e902c10-4362-4601-9ae5-6c68af2dff4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:01.417099 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7e902c10-4362-4601-9ae5-6c68af2dff4b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:01.419080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7e902c10-4362-4601-9ae5-6c68af2dff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:01.540947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:01.548560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 675/1348] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:01.583417 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68549-b450-4ed5-8e05-30620723e4ba None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:01.585039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-12a68549-b450-4ed5-8e05-30620723e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:01.709921 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68549-b450-4ed5-8e05-30620723e4ba None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:01.768486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:01.801419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049a8b3-873c-44a0-96ed-e6f0eaac0df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:01.802089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049a8b3-873c-44a0-96ed-e6f0eaac0df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:01.802370 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049a8b3-873c-44a0-96ed-e6f0eaac0df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:01.802644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049a8b3-873c-44a0-96ed-e6f0eaac0df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:01.804405 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d049a8b3-873c-44a0-96ed-e6f0eaac0df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:01.925533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049a8b3-873c-44a0-96ed-e6f0eaac0df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:01.926991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049a8b3-873c-44a0-96ed-e6f0eaac0df4 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:01.947645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 674/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:07.203973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad7749-d0cb-4eaa-ab8a-099267accf1c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:07.204843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad7749-d0cb-4eaa-ab8a-099267accf1c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:07.204843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad7749-d0cb-4eaa-ab8a-099267accf1c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:07.210441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 676/1350] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:19:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:07.216019 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c010af-95c8-4f26-a2fc-19cb2b729272 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:07.216828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c010af-95c8-4f26-a2fc-19cb2b729272 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:07.216828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c010af-95c8-4f26-a2fc-19cb2b729272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:07.341988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-06c010af-95c8-4f26-a2fc-19cb2b729272 None None] MFA Rules not processed for user `1fd9ea435d7b48cb8b1b2a27d79cfa91`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:07.343718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-06c010af-95c8-4f26-a2fc-19cb2b729272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:07.409190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:07.633684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 675/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:19:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:11.794188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eae32b-3d2f-4a29-adb0-fbd014882161 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:11.794809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eae32b-3d2f-4a29-adb0-fbd014882161 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:11.794809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eae32b-3d2f-4a29-adb0-fbd014882161 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:11.796381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 677/1352] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:11.801637 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8423418-4452-4ad9-935d-4a47166e6c27 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:11.802128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8423418-4452-4ad9-935d-4a47166e6c27 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:11.802229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8423418-4452-4ad9-935d-4a47166e6c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:11.883743 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f8423418-4452-4ad9-935d-4a47166e6c27 None None] MFA Rules not processed for user `1fd9ea435d7b48cb8b1b2a27d79cfa91`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:11.885321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f8423418-4452-4ad9-935d-4a47166e6c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:11.961122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:12.000241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 676/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:19:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:13.481990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b75df-a7ba-427d-811e-152fdcd2eb80 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:13.482549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b75df-a7ba-427d-811e-152fdcd2eb80 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:13.482549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b75df-a7ba-427d-811e-152fdcd2eb80 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:13.483910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 678/1354] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:13.489143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e643-2d7d-44a4-ade8-7a1fc2d8a811 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:13.489621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e643-2d7d-44a4-ade8-7a1fc2d8a811 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:13.489702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e643-2d7d-44a4-ade8-7a1fc2d8a811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:13.567366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9c41e643-2d7d-44a4-ade8-7a1fc2d8a811 None None] MFA Rules not processed for user `1fd9ea435d7b48cb8b1b2a27d79cfa91`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:13.568556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9c41e643-2d7d-44a4-ade8-7a1fc2d8a811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:13.678838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 677/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:19:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:17.224615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3641-0b66-43bd-bf04-fed2049b2d7e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.225182 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3641-0b66-43bd-bf04-fed2049b2d7e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.225182 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3641-0b66-43bd-bf04-fed2049b2d7e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.226771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 679/1356] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:17.233707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf66a9-5e18-479a-a680-5f5c6b95d266 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.234239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf66a9-5e18-479a-a680-5f5c6b95d266 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.234239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf66a9-5e18-479a-a680-5f5c6b95d266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.277766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:17.326736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0ddf66a9-5e18-479a-a680-5f5c6b95d266 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:17.328075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0ddf66a9-5e18-479a-a680-5f5c6b95d266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:17.439931 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 678/1357] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:17.500565 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b0433-acd4-45a8-8cd0-5a0839edc30b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.501147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b0433-acd4-45a8-8cd0-5a0839edc30b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.501582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b0433-acd4-45a8-8cd0-5a0839edc30b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.503715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 680/1358] 10.222.0.40 () {54 vars in 962 bytes} [Thu Jul 21 08:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:17.514501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e278e-1c7e-4a3a-b758-16d9bc9ef340 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.515350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e278e-1c7e-4a3a-b758-16d9bc9ef340 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.516370 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e278e-1c7e-4a3a-b758-16d9bc9ef340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.613534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5e3e278e-1c7e-4a3a-b758-16d9bc9ef340 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:17.614800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5e3e278e-1c7e-4a3a-b758-16d9bc9ef340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:17.666747 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:17.739315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 679/1359] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Jul 21 08:19:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:19:17.747381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b0433-acd4-45a8-8cd0-5a0839edc30b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:17.748938 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-239b0433-acd4-45a8-8cd0-5a0839edc30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:17.920839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b0433-acd4-45a8-8cd0-5a0839edc30b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:18.000656 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:18.044754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f296-4654-498f-87fd-7ea88c9ab1c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:18.045407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f296-4654-498f-87fd-7ea88c9ab1c7 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:18.045825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f296-4654-498f-87fd-7ea88c9ab1c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:18.046076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f296-4654-498f-87fd-7ea88c9ab1c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:18.047741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4bf6f296-4654-498f-87fd-7ea88c9ab1c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:18.146108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f296-4654-498f-87fd-7ea88c9ab1c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:18.147728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f296-4654-498f-87fd-7ea88c9ab1c7 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:18.168671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 681/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:20.445697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42917edd-c618-4edd-afe2-b8b8665dc47a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:20.446233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42917edd-c618-4edd-afe2-b8b8665dc47a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:20.446233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42917edd-c618-4edd-afe2-b8b8665dc47a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:20.447717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 680/1361] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:20.453076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eab83d-be70-4550-8ff4-a7ba302a1b3a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:20.453527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eab83d-be70-4550-8ff4-a7ba302a1b3a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:20.453606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eab83d-be70-4550-8ff4-a7ba302a1b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:20.532394 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-72eab83d-be70-4550-8ff4-a7ba302a1b3a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:20.534068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-72eab83d-be70-4550-8ff4-a7ba302a1b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:20.576678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:20.654019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 682/1362] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:20.702557 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42917edd-c618-4edd-afe2-b8b8665dc47a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:20.704088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-42917edd-c618-4edd-afe2-b8b8665dc47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:20.921329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42917edd-c618-4edd-afe2-b8b8665dc47a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:20.937315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:21.090877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac4d36-7672-41bf-be71-34b9198b4181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:21.091750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac4d36-7672-41bf-be71-34b9198b4181 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:21.092114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac4d36-7672-41bf-be71-34b9198b4181 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:21.092566 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac4d36-7672-41bf-be71-34b9198b4181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:21.094544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-90ac4d36-7672-41bf-be71-34b9198b4181 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:21.202283 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac4d36-7672-41bf-be71-34b9198b4181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:21.203882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac4d36-7672-41bf-be71-34b9198b4181 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:21.225561 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 681/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:23.614217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe32287-fe7f-44a5-9c67-44ad8cb72865 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.615074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe32287-fe7f-44a5-9c67-44ad8cb72865 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.615505 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe32287-fe7f-44a5-9c67-44ad8cb72865 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.617169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 683/1364] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:23.625687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdd3bd-5505-4a28-9cf1-edd42749890e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.625687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdd3bd-5505-4a28-9cf1-edd42749890e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.626572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdd3bd-5505-4a28-9cf1-edd42749890e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.642300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:23.699223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-35bdd3bd-5505-4a28-9cf1-edd42749890e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:23.700640 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-35bdd3bd-5505-4a28-9cf1-edd42749890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:23.808544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 682/1365] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:23.859517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cba2ab-f109-4ca4-a3d1-72a98fa10f38 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.859790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cba2ab-f109-4ca4-a3d1-72a98fa10f38 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.860316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cba2ab-f109-4ca4-a3d1-72a98fa10f38 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.861965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 684/1366] 10.222.0.40 () {54 vars in 962 bytes} [Thu Jul 21 08:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:23.868210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc27d-e735-4c53-9635-3da682b28c31 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.868435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc27d-e735-4c53-9635-3da682b28c31 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.868890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc27d-e735-4c53-9635-3da682b28c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.958944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-48acc27d-e735-4c53-9635-3da682b28c31 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:23.960275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-48acc27d-e735-4c53-9635-3da682b28c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:24.001676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:24.117918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 683/1367] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Jul 21 08:19:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:24.126872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cba2ab-f109-4ca4-a3d1-72a98fa10f38 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:24.128436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-69cba2ab-f109-4ca4-a3d1-72a98fa10f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:24.301370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cba2ab-f109-4ca4-a3d1-72a98fa10f38 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:24.328228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:24.439867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688723a1-7237-40ad-9213-0671d47d36e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:24.440424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688723a1-7237-40ad-9213-0671d47d36e7 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:24.440766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688723a1-7237-40ad-9213-0671d47d36e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:24.441058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688723a1-7237-40ad-9213-0671d47d36e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:24.442768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-688723a1-7237-40ad-9213-0671d47d36e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:24.546812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688723a1-7237-40ad-9213-0671d47d36e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:24.548070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688723a1-7237-40ad-9213-0671d47d36e7 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:24.568480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 685/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:25.441973 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fc5be-0fba-41be-9bfe-ad8524a97978 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:25.442531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fc5be-0fba-41be-9bfe-ad8524a97978 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:25.442531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fc5be-0fba-41be-9bfe-ad8524a97978 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:25.444581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 684/1369] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:25.449723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c507260-0948-46cf-9f49-8986af810d43 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:25.450286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c507260-0948-46cf-9f49-8986af810d43 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:25.450395 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c507260-0948-46cf-9f49-8986af810d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:25.485327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:25.528312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6c507260-0948-46cf-9f49-8986af810d43 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:25.529560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6c507260-0948-46cf-9f49-8986af810d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:25.638388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 686/1370] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:25.989480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704db94-b1df-42d1-9b11-2953fdcb82c4 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:25.989768 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704db94-b1df-42d1-9b11-2953fdcb82c4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:25.990048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704db94-b1df-42d1-9b11-2953fdcb82c4 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:25.991686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 685/1371] 10.222.0.40 () {54 vars in 964 bytes} [Thu Jul 21 08:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:25.997335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab65202-b322-4e32-88a7-8b336ca89a0a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:25.997774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab65202-b322-4e32-88a7-8b336ca89a0a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:25.998206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab65202-b322-4e32-88a7-8b336ca89a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.084888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3ab65202-b322-4e32-88a7-8b336ca89a0a None None] MFA Rules not processed for user `8e44cec1e8ee4c82b104cf64ae0de6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:26.086284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3ab65202-b322-4e32-88a7-8b336ca89a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:26.138485 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:26.174242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 687/1372] 10.222.0.40 () {58 vars in 1061 bytes} [Thu Jul 21 08:19:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:26.182115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704db94-b1df-42d1-9b11-2953fdcb82c4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:26.185733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4704db94-b1df-42d1-9b11-2953fdcb82c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:26.308677 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704db94-b1df-42d1-9b11-2953fdcb82c4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:26.355345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:26.402851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600ded5-651b-432a-b909-bc19768a39b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:26.403578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600ded5-651b-432a-b909-bc19768a39b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.403894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600ded5-651b-432a-b909-bc19768a39b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.404201 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600ded5-651b-432a-b909-bc19768a39b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.405969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5600ded5-651b-432a-b909-bc19768a39b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:26.525922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600ded5-651b-432a-b909-bc19768a39b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:26.527420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600ded5-651b-432a-b909-bc19768a39b3 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:26.547994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 686/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:19:26.712990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec3ff-282b-4387-88ce-0d0dfd794a49 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.713569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec3ff-282b-4387-88ce-0d0dfd794a49 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.713569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec3ff-282b-4387-88ce-0d0dfd794a49 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.715346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 688/1374] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:26.723055 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe680a-fa05-4f1f-81f2-c52ea1849fdd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.723287 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe680a-fa05-4f1f-81f2-c52ea1849fdd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.723555 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe680a-fa05-4f1f-81f2-c52ea1849fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.796079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d8fe680a-fa05-4f1f-81f2-c52ea1849fdd None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:26.797363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d8fe680a-fa05-4f1f-81f2-c52ea1849fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:26.819749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:26.908993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 687/1375] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:26.951514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccec3ff-282b-4387-88ce-0d0dfd794a49 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:26.953449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eccec3ff-282b-4387-88ce-0d0dfd794a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:27.125047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccec3ff-282b-4387-88ce-0d0dfd794a49 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:27.178680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:27.250986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce01b7-17f6-4ca8-9dc7-b4a48d6e4a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:27.251760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce01b7-17f6-4ca8-9dc7-b4a48d6e4a44 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:27.252099 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce01b7-17f6-4ca8-9dc7-b4a48d6e4a44 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:27.252688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce01b7-17f6-4ca8-9dc7-b4a48d6e4a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:27.254686 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-89ce01b7-17f6-4ca8-9dc7-b4a48d6e4a44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:27.359794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce01b7-17f6-4ca8-9dc7-b4a48d6e4a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:27.361467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce01b7-17f6-4ca8-9dc7-b4a48d6e4a44 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:27.380613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 689/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:29.513772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd082b-e0fb-4727-824a-0c2600ec5794 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:29.514258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd082b-e0fb-4727-824a-0c2600ec5794 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:29.514348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd082b-e0fb-4727-824a-0c2600ec5794 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:29.516137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 688/1377] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:29.521582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32371e00-801d-480b-a143-fc5dc0b3a530 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:29.522075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32371e00-801d-480b-a143-fc5dc0b3a530 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:29.522075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32371e00-801d-480b-a143-fc5dc0b3a530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:29.623008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-32371e00-801d-480b-a143-fc5dc0b3a530 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:29.624234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-32371e00-801d-480b-a143-fc5dc0b3a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:29.631944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:29.733148 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 690/1378] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:29.777138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd082b-e0fb-4727-824a-0c2600ec5794 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:29.778788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0fdd082b-e0fb-4727-824a-0c2600ec5794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:29.945805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd082b-e0fb-4727-824a-0c2600ec5794 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:29.950679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:30.095864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c042f3-8f25-443d-84d3-67333256f47f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:30.096461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c042f3-8f25-443d-84d3-67333256f47f service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:30.096772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c042f3-8f25-443d-84d3-67333256f47f service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:30.097049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c042f3-8f25-443d-84d3-67333256f47f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:30.098724 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-89c042f3-8f25-443d-84d3-67333256f47f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:30.208607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c042f3-8f25-443d-84d3-67333256f47f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:30.208607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c042f3-8f25-443d-84d3-67333256f47f service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:30.228751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 689/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:32.299750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0741b44-e048-4138-8dc8-b23c3eeffb95 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:32.300315 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0741b44-e048-4138-8dc8-b23c3eeffb95 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:32.300315 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0741b44-e048-4138-8dc8-b23c3eeffb95 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:32.304045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 691/1380] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:32.307081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb15d68-efa2-4a46-bc85-052aeee20a20 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:32.307501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb15d68-efa2-4a46-bc85-052aeee20a20 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:32.307668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb15d68-efa2-4a46-bc85-052aeee20a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:32.318115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:32.381134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1fb15d68-efa2-4a46-bc85-052aeee20a20 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:32.382287 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1fb15d68-efa2-4a46-bc85-052aeee20a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:32.500537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 690/1381] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:19:32.541487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0741b44-e048-4138-8dc8-b23c3eeffb95 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:32.543219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b0741b44-e048-4138-8dc8-b23c3eeffb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:32.702045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:32.714747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0741b44-e048-4138-8dc8-b23c3eeffb95 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:32.840224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4165ece-e212-42f5-a6a1-31412eaa1afa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:32.841104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4165ece-e212-42f5-a6a1-31412eaa1afa service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:32.841480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4165ece-e212-42f5-a6a1-31412eaa1afa service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:32.841837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4165ece-e212-42f5-a6a1-31412eaa1afa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:32.843621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f4165ece-e212-42f5-a6a1-31412eaa1afa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:32.956995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4165ece-e212-42f5-a6a1-31412eaa1afa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:32.958768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4165ece-e212-42f5-a6a1-31412eaa1afa service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:32.971881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:32.982227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 692/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:35.094434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354c972-d5fa-4ef3-aed1-867faa4c1444 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.095024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354c972-d5fa-4ef3-aed1-867faa4c1444 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.095024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354c972-d5fa-4ef3-aed1-867faa4c1444 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.096476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 691/1383] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:35.102249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7113d-70e9-4a0d-88e1-9a557dcf6b5b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.102881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7113d-70e9-4a0d-88e1-9a557dcf6b5b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.102881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7113d-70e9-4a0d-88e1-9a557dcf6b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.178346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-81b7113d-70e9-4a0d-88e1-9a557dcf6b5b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:35.179783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-81b7113d-70e9-4a0d-88e1-9a557dcf6b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:35.296886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 693/1384] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:35.343553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354c972-d5fa-4ef3-aed1-867faa4c1444 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:35.345825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e354c972-d5fa-4ef3-aed1-867faa4c1444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:35.458535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:35.527832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354c972-d5fa-4ef3-aed1-867faa4c1444 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:35.656116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fa732-396e-4c47-b5b8-5325b38680f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:35.656721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fa732-396e-4c47-b5b8-5325b38680f2 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.657003 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fa732-396e-4c47-b5b8-5325b38680f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.657279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fa732-396e-4c47-b5b8-5325b38680f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.658964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-178fa732-396e-4c47-b5b8-5325b38680f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:35.710054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:35.753519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fa732-396e-4c47-b5b8-5325b38680f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:35.755204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fa732-396e-4c47-b5b8-5325b38680f2 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:35.774113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 692/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:38.165221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed54a8c-d6de-4e2e-abbd-1e88bdb2f6bc None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:38.165819 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed54a8c-d6de-4e2e-abbd-1e88bdb2f6bc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:38.165819 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed54a8c-d6de-4e2e-abbd-1e88bdb2f6bc None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:38.167666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 694/1386] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:38.173789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02241bbb-c6c4-42c8-8f49-011875b486e8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:38.174255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02241bbb-c6c4-42c8-8f49-011875b486e8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:38.174386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02241bbb-c6c4-42c8-8f49-011875b486e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:38.249595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-02241bbb-c6c4-42c8-8f49-011875b486e8 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:38.251375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-02241bbb-c6c4-42c8-8f49-011875b486e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:38.373773 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 693/1387] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:38.424856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed54a8c-d6de-4e2e-abbd-1e88bdb2f6bc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:38.426602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4ed54a8c-d6de-4e2e-abbd-1e88bdb2f6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:38.511834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:38.587235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed54a8c-d6de-4e2e-abbd-1e88bdb2f6bc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:38.728460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b29f8-ec43-4744-b9b1-40a33f130c68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:38.729542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b29f8-ec43-4744-b9b1-40a33f130c68 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:38.729913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b29f8-ec43-4744-b9b1-40a33f130c68 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:38.730269 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b29f8-ec43-4744-b9b1-40a33f130c68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:38.732614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9d5b29f8-ec43-4744-b9b1-40a33f130c68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:38.778289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:38.841868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b29f8-ec43-4744-b9b1-40a33f130c68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:38.844208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b29f8-ec43-4744-b9b1-40a33f130c68 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:38.867249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 695/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:41.008802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5a989-096d-4d4b-81a2-8d60340d1830 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.009467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5a989-096d-4d4b-81a2-8d60340d1830 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.009467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5a989-096d-4d4b-81a2-8d60340d1830 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.010915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 694/1389] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:41.017000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cb3d7-11ba-4a1b-88dd-79541a946157 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.017448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cb3d7-11ba-4a1b-88dd-79541a946157 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.017547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cb3d7-11ba-4a1b-88dd-79541a946157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.093549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8c6cb3d7-11ba-4a1b-88dd-79541a946157 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:41.094947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8c6cb3d7-11ba-4a1b-88dd-79541a946157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:41.207847 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 696/1390] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:41.254102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5a989-096d-4d4b-81a2-8d60340d1830 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:41.255658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-14b5a989-096d-4d4b-81a2-8d60340d1830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:41.300797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:41.430339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5a989-096d-4d4b-81a2-8d60340d1830 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:41.539170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:41.552361 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ddb58-a456-4738-bdec-a0a7c4ca2130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:41.553003 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ddb58-a456-4738-bdec-a0a7c4ca2130 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.553285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ddb58-a456-4738-bdec-a0a7c4ca2130 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.553546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ddb58-a456-4738-bdec-a0a7c4ca2130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.555230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-801ddb58-a456-4738-bdec-a0a7c4ca2130 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:41.646681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5b669-2ee6-41f8-a1d9-3cb5737b8e17 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.646961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5b669-2ee6-41f8-a1d9-3cb5737b8e17 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.647249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5b669-2ee6-41f8-a1d9-3cb5737b8e17 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.648749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 697/1391] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:41.652792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ddb58-a456-4738-bdec-a0a7c4ca2130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:41.654078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0becb4-e4fa-412e-99c3-4cfd8b0c8830 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.654371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0becb4-e4fa-412e-99c3-4cfd8b0c8830 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.654532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ddb58-a456-4738-bdec-a0a7c4ca2130 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:41.654650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0becb4-e4fa-412e-99c3-4cfd8b0c8830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.670520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:41.676289 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 695/1392] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:41.726458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9e0becb4-e4fa-412e-99c3-4cfd8b0c8830 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:41.728369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9e0becb4-e4fa-412e-99c3-4cfd8b0c8830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:41.846060 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 698/1393] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:41.904165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9143f-cf5b-4405-a7b2-5bd41682cd83 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.904452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9143f-cf5b-4405-a7b2-5bd41682cd83 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.904776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9143f-cf5b-4405-a7b2-5bd41682cd83 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.906274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 696/1394] 10.222.0.40 () {54 vars in 966 bytes} [Thu Jul 21 08:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:41.911641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fda60-b68b-4bac-81f2-569fc047a4c1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.911953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fda60-b68b-4bac-81f2-569fc047a4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.912234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fda60-b68b-4bac-81f2-569fc047a4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.993125 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-722fda60-b68b-4bac-81f2-569fc047a4c1 None None] MFA Rules not processed for user `f4f9a6f6d6d840d6bc29fd0ab26ddb29`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:41.993988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-722fda60-b68b-4bac-81f2-569fc047a4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:42.032259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:42.081273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 699/1395] 10.222.0.40 () {58 vars in 1063 bytes} [Thu Jul 21 08:19:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:42.090074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9143f-cf5b-4405-a7b2-5bd41682cd83 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:42.091591 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fee9143f-cf5b-4405-a7b2-5bd41682cd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:42.205420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9143f-cf5b-4405-a7b2-5bd41682cd83 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.219721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:42.288703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e5451-f352-4137-84f7-79dc6d86474c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f9a6f6d6d840d6bc29fd0ab26ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.289397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e5451-f352-4137-84f7-79dc6d86474c service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.289675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e5451-f352-4137-84f7-79dc6d86474c service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.289951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e5451-f352-4137-84f7-79dc6d86474c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.291737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0b9e5451-f352-4137-84f7-79dc6d86474c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:42.414039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e5451-f352-4137-84f7-79dc6d86474c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:42.415506 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e5451-f352-4137-84f7-79dc6d86474c service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:42.435134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 697/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:43.159305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23718f51-2d3c-41d5-a3bd-c920c7971b2a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.159850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23718f51-2d3c-41d5-a3bd-c920c7971b2a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.159850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23718f51-2d3c-41d5-a3bd-c920c7971b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.235326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-23718f51-2d3c-41d5-a3bd-c920c7971b2a None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:43.236745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23718f51-2d3c-41d5-a3bd-c920c7971b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:43.342502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 700/1397] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:19:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:43.391710 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5701-18cd-42e8-9d28-f047a5a25efa None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.392299 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5701-18cd-42e8-9d28-f047a5a25efa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.392299 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5701-18cd-42e8-9d28-f047a5a25efa None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.394052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 698/1398] 10.222.0.40 () {54 vars in 943 bytes} [Thu Jul 21 08:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:43.400534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93901352-e336-4097-82d6-eeb4b731822c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.400861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93901352-e336-4097-82d6-eeb4b731822c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.401145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93901352-e336-4097-82d6-eeb4b731822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.461548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:43.481171 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-93901352-e336-4097-82d6-eeb4b731822c None None] MFA Rules not processed for user `300b1990926c4968b75a84a1f5794df1`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:43.482501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-93901352-e336-4097-82d6-eeb4b731822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:43.599434 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 701/1399] 10.222.0.40 () {58 vars in 1040 bytes} [Thu Jul 21 08:19:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:43.613294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a5701-18cd-42e8-9d28-f047a5a25efa None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.615108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ed3a5701-18cd-42e8-9d28-f047a5a25efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:43.666588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:43.724051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b149c-7230-41a3-bc48-ce02e1653f84 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.724327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b149c-7230-41a3-bc48-ce02e1653f84 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.724635 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b149c-7230-41a3-bc48-ce02e1653f84 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.726093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 702/1400] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:43.731445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bad42-e444-4c8a-8a69-f2b8753d8b82 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.731726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bad42-e444-4c8a-8a69-f2b8753d8b82 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.732038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bad42-e444-4c8a-8a69-f2b8753d8b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.768457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a5701-18cd-42e8-9d28-f047a5a25efa None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:43.809925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-388bad42-e444-4c8a-8a69-f2b8753d8b82 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:43.811285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-388bad42-e444-4c8a-8a69-f2b8753d8b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:43.876784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:43.884639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f719cb-7715-4495-b722-2e8c298dcbb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:43.885298 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f719cb-7715-4495-b722-2e8c298dcbb2 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.885575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f719cb-7715-4495-b722-2e8c298dcbb2 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.885849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f719cb-7715-4495-b722-2e8c298dcbb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.887708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-87f719cb-7715-4495-b722-2e8c298dcbb2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:43.923010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 703/1401] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:19:43.923464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:43.975853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bad42-e444-4c8a-8a69-f2b8753d8b82 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.977186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-388bad42-e444-4c8a-8a69-f2b8753d8b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:43.984704 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f719cb-7715-4495-b722-2e8c298dcbb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:43.986378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f719cb-7715-4495-b722-2e8c298dcbb2 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:43.995359 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 699/1402] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:19:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:19:44.108521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bad42-e444-4c8a-8a69-f2b8753d8b82 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:44.186527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:44.241533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15af4e0-34c9-409a-97de-08228f7a5260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:44.242238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15af4e0-34c9-409a-97de-08228f7a5260 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:44.242520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15af4e0-34c9-409a-97de-08228f7a5260 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:44.242793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15af4e0-34c9-409a-97de-08228f7a5260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:44.244625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d15af4e0-34c9-409a-97de-08228f7a5260 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:44.398025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15af4e0-34c9-409a-97de-08228f7a5260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:44.398934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15af4e0-34c9-409a-97de-08228f7a5260 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:44.420131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 704/1403] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:46.558453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb84096-1341-47bb-92d2-b19b543aa389 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:46.559446 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb84096-1341-47bb-92d2-b19b543aa389 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:46.559727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb84096-1341-47bb-92d2-b19b543aa389 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:46.561266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 700/1404] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:46.567473 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16e31-adaf-47d1-92d0-f52ea495a2a9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:46.568013 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16e31-adaf-47d1-92d0-f52ea495a2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:46.568013 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16e31-adaf-47d1-92d0-f52ea495a2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:46.642491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0cc16e31-adaf-47d1-92d0-f52ea495a2a9 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:46.645800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0cc16e31-adaf-47d1-92d0-f52ea495a2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:46.684025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:46.755739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 705/1405] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:46.804774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb84096-1341-47bb-92d2-b19b543aa389 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:46.806319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4fb84096-1341-47bb-92d2-b19b543aa389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:46.964331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb84096-1341-47bb-92d2-b19b543aa389 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:46.987042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:47.123473 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212c71b-f93d-47b7-9834-06d551632628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:47.125006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212c71b-f93d-47b7-9834-06d551632628 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:47.125652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212c71b-f93d-47b7-9834-06d551632628 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:47.126158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212c71b-f93d-47b7-9834-06d551632628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:47.128352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6212c71b-f93d-47b7-9834-06d551632628 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:47.253377 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212c71b-f93d-47b7-9834-06d551632628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:47.255976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212c71b-f93d-47b7-9834-06d551632628 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:47.277699 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 701/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:49.398093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203ec70-a5fd-4799-b707-39618ed930f6 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.398093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203ec70-a5fd-4799-b707-39618ed930f6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.398093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203ec70-a5fd-4799-b707-39618ed930f6 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.398837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 706/1407] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:49.404231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38996afa-b4a3-48d5-96f3-388d31dd44cc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.404695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38996afa-b4a3-48d5-96f3-388d31dd44cc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.404856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38996afa-b4a3-48d5-96f3-388d31dd44cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.444437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:49.479941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-38996afa-b4a3-48d5-96f3-388d31dd44cc None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:49.481631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-38996afa-b4a3-48d5-96f3-388d31dd44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:49.614750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 702/1408] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:19:49.644140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203ec70-a5fd-4799-b707-39618ed930f6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.645714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2203ec70-a5fd-4799-b707-39618ed930f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:49.821918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203ec70-a5fd-4799-b707-39618ed930f6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:49.839382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:49.952097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b80baf-e15c-4b76-855b-4b5f96131e41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:49.952691 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80baf-e15c-4b76-855b-4b5f96131e41 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.952978 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80baf-e15c-4b76-855b-4b5f96131e41 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.953278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80baf-e15c-4b76-855b-4b5f96131e41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.955291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-05b80baf-e15c-4b76-855b-4b5f96131e41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:50.065506 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b80baf-e15c-4b76-855b-4b5f96131e41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:50.067176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b80baf-e15c-4b76-855b-4b5f96131e41 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:50.087256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 707/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:19:59.596460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=53 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:00.085076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:06.472202 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca6f3c-43e6-4da4-b426-74e035309e1f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.472854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca6f3c-43e6-4da4-b426-74e035309e1f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.472854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca6f3c-43e6-4da4-b426-74e035309e1f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.474189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 703/1410] 10.222.0.40 () {54 vars in 918 bytes} [Thu Jul 21 08:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:06.479505 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d549b9-422f-4dc2-9cf1-3ef66fa414a4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.479982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d549b9-422f-4dc2-9cf1-3ef66fa414a4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.480092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d549b9-422f-4dc2-9cf1-3ef66fa414a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.562027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-17d549b9-422f-4dc2-9cf1-3ef66fa414a4 None None] MFA Rules not processed for user `1fd9ea435d7b48cb8b1b2a27d79cfa91`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:06.563264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-17d549b9-422f-4dc2-9cf1-3ef66fa414a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:06.683662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 708/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jul 21 08:20:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:06.699446 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb308-1599-41a1-a63a-05fb2a3b6585 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.699865 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb308-1599-41a1-a63a-05fb2a3b6585 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.700331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb308-1599-41a1-a63a-05fb2a3b6585 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.702374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 704/1412] 10.222.0.40 () {54 vars in 918 bytes} [Thu Jul 21 08:20:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:06.707960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0b5a3-6340-4f2b-a4db-792490a24849 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.708381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0b5a3-6340-4f2b-a4db-792490a24849 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.708831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0b5a3-6340-4f2b-a4db-792490a24849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.798198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:06.803780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-53c0b5a3-6340-4f2b-a4db-792490a24849 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:06.805923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-53c0b5a3-6340-4f2b-a4db-792490a24849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:06.944450 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 709/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jul 21 08:20:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:09.511197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001afc-9e8a-4bee-bdc4-4da7175e04b8 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.511819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001afc-9e8a-4bee-bdc4-4da7175e04b8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.511819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001afc-9e8a-4bee-bdc4-4da7175e04b8 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.513175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:09.519973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9aa4-994f-4b92-8d4d-9092316e8adc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.520467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9aa4-994f-4b92-8d4d-9092316e8adc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.520621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9aa4-994f-4b92-8d4d-9092316e8adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.604083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3e5a9aa4-994f-4b92-8d4d-9092316e8adc None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:09.605269 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3e5a9aa4-994f-4b92-8d4d-9092316e8adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:09.665792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.722517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:09.770452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001afc-9e8a-4bee-bdc4-4da7175e04b8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.771986 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c0001afc-9e8a-4bee-bdc4-4da7175e04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:09.926050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001afc-9e8a-4bee-bdc4-4da7175e04b8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.021849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:10.063804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cb81a-6959-4f4f-9d12-e858f9edc541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.064451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cb81a-6959-4f4f-9d12-e858f9edc541 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.064756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cb81a-6959-4f4f-9d12-e858f9edc541 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.065031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cb81a-6959-4f4f-9d12-e858f9edc541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.066702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-675cb81a-6959-4f4f-9d12-e858f9edc541 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:10.162883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cb81a-6959-4f4f-9d12-e858f9edc541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.164529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cb81a-6959-4f4f-9d12-e858f9edc541 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.184065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 706/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:11.104899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847a054-16dd-4604-94d1-e8ef375112c9 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.105782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847a054-16dd-4604-94d1-e8ef375112c9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.105782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847a054-16dd-4604-94d1-e8ef375112c9 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.107810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:20:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:11.113636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adced2c2-35bd-48b7-81a2-9b39dbdf0d13 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.114165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adced2c2-35bd-48b7-81a2-9b39dbdf0d13 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.114165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adced2c2-35bd-48b7-81a2-9b39dbdf0d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.205860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-adced2c2-35bd-48b7-81a2-9b39dbdf0d13 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:11.207089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-adced2c2-35bd-48b7-81a2-9b39dbdf0d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:11.235856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:11.312773 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:11.471013 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847a054-16dd-4604-94d1-e8ef375112c9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:11.472595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9847a054-16dd-4604-94d1-e8ef375112c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:11.637253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847a054-16dd-4604-94d1-e8ef375112c9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:11.686155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:11.768819 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b771de-a94e-42dd-b1c7-2e23f12f09d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:11.769402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b771de-a94e-42dd-b1c7-2e23f12f09d1 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.769687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b771de-a94e-42dd-b1c7-2e23f12f09d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.769959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b771de-a94e-42dd-b1c7-2e23f12f09d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.771670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-13b771de-a94e-42dd-b1c7-2e23f12f09d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:11.872054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b771de-a94e-42dd-b1c7-2e23f12f09d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:11.874659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b771de-a94e-42dd-b1c7-2e23f12f09d1 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:11.893883 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 712/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:12.797261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254333a2-84be-4dda-883e-ac742c38212c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:12.797882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254333a2-84be-4dda-883e-ac742c38212c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:12.797882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254333a2-84be-4dda-883e-ac742c38212c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:12.799226 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:12.806482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf307b-1aa0-4f09-b5c4-05d076e91deb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:12.806947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf307b-1aa0-4f09-b5c4-05d076e91deb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:12.807064 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf307b-1aa0-4f09-b5c4-05d076e91deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:12.866975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:12.890720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-deaf307b-1aa0-4f09-b5c4-05d076e91deb None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:12.892340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-deaf307b-1aa0-4f09-b5c4-05d076e91deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:13.001482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:13.153988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254333a2-84be-4dda-883e-ac742c38212c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:13.155499 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-254333a2-84be-4dda-883e-ac742c38212c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:13.315486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254333a2-84be-4dda-883e-ac742c38212c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:13.329095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:13.439849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1853475-9833-475b-bcd2-d0a6a40d6c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:13.440410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853475-9833-475b-bcd2-d0a6a40d6c03 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:13.440719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853475-9833-475b-bcd2-d0a6a40d6c03 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:13.440987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853475-9833-475b-bcd2-d0a6a40d6c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:13.442648 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e1853475-9833-475b-bcd2-d0a6a40d6c03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:13.543933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1853475-9833-475b-bcd2-d0a6a40d6c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:13.545689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1853475-9833-475b-bcd2-d0a6a40d6c03 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:13.564288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 709/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:14.438405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ff4d-67db-4626-a848-1f044f92297a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.439011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ff4d-67db-4626-a848-1f044f92297a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.439011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ff4d-67db-4626-a848-1f044f92297a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.440373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:14.445701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc3508-8fcd-4290-be40-6b290a14948a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.446207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc3508-8fcd-4290-be40-6b290a14948a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.446313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc3508-8fcd-4290-be40-6b290a14948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.466156 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:14.528879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c0dc3508-8fcd-4290-be40-6b290a14948a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:14.530122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c0dc3508-8fcd-4290-be40-6b290a14948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:14.638803 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:14.805151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7ff4d-67db-4626-a848-1f044f92297a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.807493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e6d7ff4d-67db-4626-a848-1f044f92297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:14.930357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:14.980101 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7ff4d-67db-4626-a848-1f044f92297a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.112181 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07566c7f-fd98-4e29-82c7-c0944d260403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.113092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07566c7f-fd98-4e29-82c7-c0944d260403 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.113569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07566c7f-fd98-4e29-82c7-c0944d260403 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.114033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07566c7f-fd98-4e29-82c7-c0944d260403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.116798 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-07566c7f-fd98-4e29-82c7-c0944d260403 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:15.208508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:15.228734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07566c7f-fd98-4e29-82c7-c0944d260403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.230445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07566c7f-fd98-4e29-82c7-c0944d260403 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.250780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 715/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:16.126262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72312a89-5a34-49a9-88e2-9967427722ef None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:16.126840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72312a89-5a34-49a9-88e2-9967427722ef None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:16.126840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72312a89-5a34-49a9-88e2-9967427722ef None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:16.128143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:16.134424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286356f9-7e99-48f1-840f-14a537586c6a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:16.134881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286356f9-7e99-48f1-840f-14a537586c6a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:16.134999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286356f9-7e99-48f1-840f-14a537586c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:16.220006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-286356f9-7e99-48f1-840f-14a537586c6a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:16.221306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-286356f9-7e99-48f1-840f-14a537586c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:16.336761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:16.488570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72312a89-5a34-49a9-88e2-9967427722ef None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:16.491014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-72312a89-5a34-49a9-88e2-9967427722ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:16.594979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:16.661067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72312a89-5a34-49a9-88e2-9967427722ef None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:16.780229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2184d-e41e-44c3-bf20-d7f821e99aba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:16.780856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2184d-e41e-44c3-bf20-d7f821e99aba service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:16.781136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2184d-e41e-44c3-bf20-d7f821e99aba service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:16.781412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2184d-e41e-44c3-bf20-d7f821e99aba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:16.783071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-24d2184d-e41e-44c3-bf20-d7f821e99aba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:16.838029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:16.887864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2184d-e41e-44c3-bf20-d7f821e99aba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:16.889514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2184d-e41e-44c3-bf20-d7f821e99aba service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:16.909919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 712/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:17.717780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1a18-f75b-4458-a6ff-44cf9031828f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:17.718681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1a18-f75b-4458-a6ff-44cf9031828f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:17.718681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1a18-f75b-4458-a6ff-44cf9031828f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:17.720980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:20:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:17.727182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fcf8e-fa6f-477c-a2ad-3566c5fed88c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:17.727919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fcf8e-fa6f-477c-a2ad-3566c5fed88c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:17.728106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fcf8e-fa6f-477c-a2ad-3566c5fed88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:17.812784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-738fcf8e-fa6f-477c-a2ad-3566c5fed88c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:17.813993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-738fcf8e-fa6f-477c-a2ad-3566c5fed88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:17.915763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:18.081324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d1a18-f75b-4458-a6ff-44cf9031828f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.082770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bf7d1a18-f75b-4458-a6ff-44cf9031828f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:18.135424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:18.247120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d1a18-f75b-4458-a6ff-44cf9031828f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.378584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbf5e1-5c60-4925-9b54-bb4b3ed1a9f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.379158 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbf5e1-5c60-4925-9b54-bb4b3ed1a9f7 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.379435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbf5e1-5c60-4925-9b54-bb4b3ed1a9f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.379740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbf5e1-5c60-4925-9b54-bb4b3ed1a9f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.381508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b6fbf5e1-5c60-4925-9b54-bb4b3ed1a9f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:18.389723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:18.476860 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbf5e1-5c60-4925-9b54-bb4b3ed1a9f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:18.478471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbf5e1-5c60-4925-9b54-bb4b3ed1a9f7 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:18.496995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 718/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:19.301503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc516-fa89-4cd9-a704-4dddb95266af None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.301503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc516-fa89-4cd9-a704-4dddb95266af None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.301503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc516-fa89-4cd9-a704-4dddb95266af None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.302837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:19.308875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719877-5233-4640-a96d-69364b293728 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.309348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719877-5233-4640-a96d-69364b293728 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.309465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719877-5233-4640-a96d-69364b293728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.394341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1d719877-5233-4640-a96d-69364b293728 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:19.395585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1d719877-5233-4640-a96d-69364b293728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:19.463781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:19.493594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:19.650402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafc516-fa89-4cd9-a704-4dddb95266af None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.651825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7dafc516-fa89-4cd9-a704-4dddb95266af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:19.670085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:19.814912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafc516-fa89-4cd9-a704-4dddb95266af None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.914614 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:19.949554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea766c-ecc6-47b9-bc34-a4df0240f895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.950210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea766c-ecc6-47b9-bc34-a4df0240f895 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.950484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea766c-ecc6-47b9-bc34-a4df0240f895 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.950749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea766c-ecc6-47b9-bc34-a4df0240f895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.952407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-03ea766c-ecc6-47b9-bc34-a4df0240f895 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:20.062395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea766c-ecc6-47b9-bc34-a4df0240f895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:20.064307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea766c-ecc6-47b9-bc34-a4df0240f895 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:20.087157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 715/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:20.912685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f05ff9-9b75-4297-a910-6772fcc4d583 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.913253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f05ff9-9b75-4297-a910-6772fcc4d583 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.913253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f05ff9-9b75-4297-a910-6772fcc4d583 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.915262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:20:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:20.923568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b4c29-1fe3-467c-813e-bb4a74359512 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.924110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b4c29-1fe3-467c-813e-bb4a74359512 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.924110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b4c29-1fe3-467c-813e-bb4a74359512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:21.007320 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0f7b4c29-1fe3-467c-813e-bb4a74359512 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:21.008537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0f7b4c29-1fe3-467c-813e-bb4a74359512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:21.063017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:21.121014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:21.272119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f05ff9-9b75-4297-a910-6772fcc4d583 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:21.274676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c5f05ff9-9b75-4297-a910-6772fcc4d583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:21.448641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f05ff9-9b75-4297-a910-6772fcc4d583 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:21.511364 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:21.575352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc72ab-4da3-4aab-ae7d-c8cc8e1aa6d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:21.575906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc72ab-4da3-4aab-ae7d-c8cc8e1aa6d7 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:21.576186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc72ab-4da3-4aab-ae7d-c8cc8e1aa6d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:21.576464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc72ab-4da3-4aab-ae7d-c8cc8e1aa6d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:21.578151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-29bc72ab-4da3-4aab-ae7d-c8cc8e1aa6d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:21.676310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc72ab-4da3-4aab-ae7d-c8cc8e1aa6d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:21.677999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc72ab-4da3-4aab-ae7d-c8cc8e1aa6d7 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:21.699088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 721/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:22.526801 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b99203-6fc0-4b0e-b9e1-cf60a9d10708 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:22.527421 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b99203-6fc0-4b0e-b9e1-cf60a9d10708 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:22.527421 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b99203-6fc0-4b0e-b9e1-cf60a9d10708 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:22.528601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:22.534206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbbce5-5137-45dc-a43f-a9d0f01cc75e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:22.534699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbbce5-5137-45dc-a43f-a9d0f01cc75e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:22.534813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbbce5-5137-45dc-a43f-a9d0f01cc75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:22.622442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c2bbbce5-5137-45dc-a43f-a9d0f01cc75e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:22.623708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c2bbbce5-5137-45dc-a43f-a9d0f01cc75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:22.626046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:22.742796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:22.894433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b99203-6fc0-4b0e-b9e1-cf60a9d10708 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:22.896801 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e6b99203-6fc0-4b0e-b9e1-cf60a9d10708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:23.068370 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b99203-6fc0-4b0e-b9e1-cf60a9d10708 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:23.096852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:23.202826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9486850-d950-4132-9aba-e6b5f9e42220 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:23.203489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9486850-d950-4132-9aba-e6b5f9e42220 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.203765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9486850-d950-4132-9aba-e6b5f9e42220 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.204117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9486850-d950-4132-9aba-e6b5f9e42220 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.205872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f9486850-d950-4132-9aba-e6b5f9e42220 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:23.303908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9486850-d950-4132-9aba-e6b5f9e42220 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:23.305605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9486850-d950-4132-9aba-e6b5f9e42220 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:23.326086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 718/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:25.283652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2824f-f72e-4552-a6aa-58b47c5cbef1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:25.284279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2824f-f72e-4552-a6aa-58b47c5cbef1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:25.284279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2824f-f72e-4552-a6aa-58b47c5cbef1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:25.286136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:25.292408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719c2e-2b50-4107-ab00-54422e5f1afe None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:25.292978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719c2e-2b50-4107-ab00-54422e5f1afe None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:25.292978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719c2e-2b50-4107-ab00-54422e5f1afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:25.348401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:25.381605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ba719c2e-2b50-4107-ab00-54422e5f1afe None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:25.382834 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ba719c2e-2b50-4107-ab00-54422e5f1afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:25.499044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:25.557985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2824f-f72e-4552-a6aa-58b47c5cbef1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:25.559718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-daa2824f-f72e-4552-a6aa-58b47c5cbef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:25.682067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2824f-f72e-4552-a6aa-58b47c5cbef1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:25.718348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:25.763852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a4a84-5542-467a-8338-37d79d575b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:25.764529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a4a84-5542-467a-8338-37d79d575b90 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:25.764822 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a4a84-5542-467a-8338-37d79d575b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:25.765099 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a4a84-5542-467a-8338-37d79d575b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:25.767136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3b6a4a84-5542-467a-8338-37d79d575b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:25.894251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a4a84-5542-467a-8338-37d79d575b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:25.895629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a4a84-5542-467a-8338-37d79d575b90 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:25.916379 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 724/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:28.151381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3ff11-f597-4418-9380-2094069915b0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:28.152311 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3ff11-f597-4418-9380-2094069915b0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:28.152311 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3ff11-f597-4418-9380-2094069915b0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:28.154696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:20:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:28.160472 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac5ec9-e5e8-4ec1-a07f-1dff4792c23a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:28.160963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac5ec9-e5e8-4ec1-a07f-1dff4792c23a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:28.161067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac5ec9-e5e8-4ec1-a07f-1dff4792c23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:28.241224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-aaac5ec9-e5e8-4ec1-a07f-1dff4792c23a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:28.242477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-aaac5ec9-e5e8-4ec1-a07f-1dff4792c23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:28.255941 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:28.355237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:28.396167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3ff11-f597-4418-9380-2094069915b0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:28.397798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f7e3ff11-f597-4418-9380-2094069915b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:28.538288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3ff11-f597-4418-9380-2094069915b0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:28.554811 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:28.639336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa158de7-b6fc-4638-831d-ef7f690e4e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:28.639992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa158de7-b6fc-4638-831d-ef7f690e4e42 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:28.640268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa158de7-b6fc-4638-831d-ef7f690e4e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:28.640547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa158de7-b6fc-4638-831d-ef7f690e4e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:28.642580 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aa158de7-b6fc-4638-831d-ef7f690e4e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:28.769885 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa158de7-b6fc-4638-831d-ef7f690e4e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:28.771349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa158de7-b6fc-4638-831d-ef7f690e4e42 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:28.791531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 721/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:31.194079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6db14-760c-4b1a-b8c6-842648f805bb None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:31.194677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6db14-760c-4b1a-b8c6-842648f805bb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:31.194677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6db14-760c-4b1a-b8c6-842648f805bb None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:31.196097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:31.202121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78de81-6757-4eb8-976f-fd55d37ffa47 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:31.202664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78de81-6757-4eb8-976f-fd55d37ffa47 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:31.202664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78de81-6757-4eb8-976f-fd55d37ffa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:31.258297 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:31.280331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8c78de81-6757-4eb8-976f-fd55d37ffa47 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:31.281606 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8c78de81-6757-4eb8-976f-fd55d37ffa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:31.395293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:31.434364 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6db14-760c-4b1a-b8c6-842648f805bb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:31.435906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f1e6db14-760c-4b1a-b8c6-842648f805bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:31.551886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6db14-760c-4b1a-b8c6-842648f805bb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:31.597338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:31.635576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b0e9c-784c-42ff-8072-859d7ae21052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:31.636238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b0e9c-784c-42ff-8072-859d7ae21052 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:31.636529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b0e9c-784c-42ff-8072-859d7ae21052 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:31.636828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b0e9c-784c-42ff-8072-859d7ae21052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:31.638527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-de7b0e9c-784c-42ff-8072-859d7ae21052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:31.752721 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b0e9c-784c-42ff-8072-859d7ae21052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:31.754180 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b0e9c-784c-42ff-8072-859d7ae21052 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:31.774505 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 727/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:34.136989 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9216c-6c71-4dd0-a5e2-ab4e0b0b8eb7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:34.137572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9216c-6c71-4dd0-a5e2-ab4e0b0b8eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:34.137572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9216c-6c71-4dd0-a5e2-ab4e0b0b8eb7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:34.138846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:34.145455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72387b-5347-440d-b258-108db989ff7a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:34.146006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72387b-5347-440d-b258-108db989ff7a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:34.146006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72387b-5347-440d-b258-108db989ff7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:34.222829 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9b72387b-5347-440d-b258-108db989ff7a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:34.224293 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9b72387b-5347-440d-b258-108db989ff7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:34.250540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:34.351209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:34.392234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9216c-6c71-4dd0-a5e2-ab4e0b0b8eb7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:34.393743 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0ae9216c-6c71-4dd0-a5e2-ab4e0b0b8eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:34.529572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9216c-6c71-4dd0-a5e2-ab4e0b0b8eb7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:34.550381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:34.609168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fcb15-deb2-486e-8d4b-b7eab1cd6a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:34.610038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fcb15-deb2-486e-8d4b-b7eab1cd6a35 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:34.610357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fcb15-deb2-486e-8d4b-b7eab1cd6a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:34.610669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fcb15-deb2-486e-8d4b-b7eab1cd6a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:34.612450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4b6fcb15-deb2-486e-8d4b-b7eab1cd6a35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:34.734332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fcb15-deb2-486e-8d4b-b7eab1cd6a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:34.735834 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fcb15-deb2-486e-8d4b-b7eab1cd6a35 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:34.754573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 724/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:36.982059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58165c-9d90-4b60-bfdc-ae2031b3cb7b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.982675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58165c-9d90-4b60-bfdc-ae2031b3cb7b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.982675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58165c-9d90-4b60-bfdc-ae2031b3cb7b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.984131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:20:36.990420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e19028-7dc9-408f-8d23-a545bd692896 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.991050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e19028-7dc9-408f-8d23-a545bd692896 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.991050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e19028-7dc9-408f-8d23-a545bd692896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:37.062996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:37.066385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-36e19028-7dc9-408f-8d23-a545bd692896 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:37.068366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-36e19028-7dc9-408f-8d23-a545bd692896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:37.194635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:37.239675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58165c-9d90-4b60-bfdc-ae2031b3cb7b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:37.241340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6f58165c-9d90-4b60-bfdc-ae2031b3cb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:37.369779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58165c-9d90-4b60-bfdc-ae2031b3cb7b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:37.429107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:37.457934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47ea8a-c253-4114-b51d-a2620dd16ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:37.458609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47ea8a-c253-4114-b51d-a2620dd16ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:37.458890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47ea8a-c253-4114-b51d-a2620dd16ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:37.459162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47ea8a-c253-4114-b51d-a2620dd16ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:37.460953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0c47ea8a-c253-4114-b51d-a2620dd16ac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:37.601230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47ea8a-c253-4114-b51d-a2620dd16ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:37.603307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47ea8a-c253-4114-b51d-a2620dd16ac7 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:37.624442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 730/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:39.876242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93236415-1759-4d84-9873-f9057517bd79 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:39.876966 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93236415-1759-4d84-9873-f9057517bd79 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:39.877311 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93236415-1759-4d84-9873-f9057517bd79 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:39.879833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:20:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:39.886263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988419a7-23f6-4ed9-a793-8bf55b1477e4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:39.886899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988419a7-23f6-4ed9-a793-8bf55b1477e4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:39.886899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988419a7-23f6-4ed9-a793-8bf55b1477e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:39.967537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-988419a7-23f6-4ed9-a793-8bf55b1477e4 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:39.968839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-988419a7-23f6-4ed9-a793-8bf55b1477e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:40.016143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:40.109527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:40.150626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93236415-1759-4d84-9873-f9057517bd79 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:40.152275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-93236415-1759-4d84-9873-f9057517bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:40.305434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93236415-1759-4d84-9873-f9057517bd79 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:40.362899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:40.452249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ee9c1-34b1-4127-ae1c-5f3e501b5b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:40.453323 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ee9c1-34b1-4127-ae1c-5f3e501b5b53 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:40.453850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ee9c1-34b1-4127-ae1c-5f3e501b5b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:40.454336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ee9c1-34b1-4127-ae1c-5f3e501b5b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:40.457622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-359ee9c1-34b1-4127-ae1c-5f3e501b5b53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:40.677278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ee9c1-34b1-4127-ae1c-5f3e501b5b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:40.680148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ee9c1-34b1-4127-ae1c-5f3e501b5b53 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:40.706707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 727/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:42.926443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b8f56-aebb-4b54-978e-a8a6ed5c3c5c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:42.927114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b8f56-aebb-4b54-978e-a8a6ed5c3c5c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:42.927114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b8f56-aebb-4b54-978e-a8a6ed5c3c5c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:42.928469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:42.935433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245fb64-d109-4231-b952-321083074a58 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:42.936142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245fb64-d109-4231-b952-321083074a58 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:42.936142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245fb64-d109-4231-b952-321083074a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:43.014864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6245fb64-d109-4231-b952-321083074a58 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:43.016178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6245fb64-d109-4231-b952-321083074a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:43.026649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:43.140794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:43.182009 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b8f56-aebb-4b54-978e-a8a6ed5c3c5c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:43.185419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-051b8f56-aebb-4b54-978e-a8a6ed5c3c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:43.339116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b8f56-aebb-4b54-978e-a8a6ed5c3c5c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:43.412343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:43.448424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642a332-119e-470b-9730-f2bbdbcd37f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:43.449493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642a332-119e-470b-9730-f2bbdbcd37f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:43.449992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642a332-119e-470b-9730-f2bbdbcd37f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:43.450475 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642a332-119e-470b-9730-f2bbdbcd37f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:43.453917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d642a332-119e-470b-9730-f2bbdbcd37f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:43.626132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642a332-119e-470b-9730-f2bbdbcd37f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:43.627650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642a332-119e-470b-9730-f2bbdbcd37f9 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:43.650328 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 733/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:45.827249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7eaa-53ab-41df-80c6-85d88ca56623 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:45.827886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7eaa-53ab-41df-80c6-85d88ca56623 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:45.827886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7eaa-53ab-41df-80c6-85d88ca56623 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:45.829532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:45.835801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac4ff-5e4b-4ba5-8679-99d4ff49192c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:45.836350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac4ff-5e4b-4ba5-8679-99d4ff49192c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:45.836432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac4ff-5e4b-4ba5-8679-99d4ff49192c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:45.920061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-babac4ff-5e4b-4ba5-8679-99d4ff49192c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:45.921335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-babac4ff-5e4b-4ba5-8679-99d4ff49192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:45.964652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:46.032740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:46.071329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b7eaa-53ab-41df-80c6-85d88ca56623 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:46.072943 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e85b7eaa-53ab-41df-80c6-85d88ca56623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:46.195467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b7eaa-53ab-41df-80c6-85d88ca56623 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:46.240128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:46.286220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4c35d-9f92-46db-bc37-087436859a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:46.287045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4c35d-9f92-46db-bc37-087436859a57 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:46.287384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4c35d-9f92-46db-bc37-087436859a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:46.287718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4c35d-9f92-46db-bc37-087436859a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:46.290789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9fb4c35d-9f92-46db-bc37-087436859a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:46.440161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4c35d-9f92-46db-bc37-087436859a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:46.441923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4c35d-9f92-46db-bc37-087436859a57 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:46.463013 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 730/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:48.608487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e01fe-e7e0-428e-ac85-c1cb479fddb7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:48.609103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e01fe-e7e0-428e-ac85-c1cb479fddb7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:48.609103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e01fe-e7e0-428e-ac85-c1cb479fddb7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:48.610493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:48.616544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbf65c-6f4a-423e-85db-744757eaea08 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:48.617070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbf65c-6f4a-423e-85db-744757eaea08 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:48.617070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbf65c-6f4a-423e-85db-744757eaea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:48.696802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-69fbf65c-6f4a-423e-85db-744757eaea08 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:48.698079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-69fbf65c-6f4a-423e-85db-744757eaea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:48.719444 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:48.808290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:48.851016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e01fe-e7e0-428e-ac85-c1cb479fddb7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:48.852663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-734e01fe-e7e0-428e-ac85-c1cb479fddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:48.976058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e01fe-e7e0-428e-ac85-c1cb479fddb7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:49.061546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:49.063952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83040898-ddd5-42a9-bd96-845c644fe1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:49.064678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83040898-ddd5-42a9-bd96-845c644fe1aa service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:49.065040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83040898-ddd5-42a9-bd96-845c644fe1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:49.065403 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83040898-ddd5-42a9-bd96-845c644fe1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:49.067375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-83040898-ddd5-42a9-bd96-845c644fe1aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:49.192483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83040898-ddd5-42a9-bd96-845c644fe1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:49.194002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83040898-ddd5-42a9-bd96-845c644fe1aa service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:49.214015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 736/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:20:51.293431 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f783e-a13e-4c8e-aead-84d869ca757b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:51.294198 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f783e-a13e-4c8e-aead-84d869ca757b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:51.294198 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f783e-a13e-4c8e-aead-84d869ca757b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:51.295400 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:51.301432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73e702-987a-441a-acd8-78463bf3fa6c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:51.301985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73e702-987a-441a-acd8-78463bf3fa6c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:51.301985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73e702-987a-441a-acd8-78463bf3fa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:51.379752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3b73e702-987a-441a-acd8-78463bf3fa6c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:51.381060 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3b73e702-987a-441a-acd8-78463bf3fa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:51.438402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:51.514449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:20:51.553218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f783e-a13e-4c8e-aead-84d869ca757b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:51.554788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b43f783e-a13e-4c8e-aead-84d869ca757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:51.671518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f783e-a13e-4c8e-aead-84d869ca757b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:51.726752 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:51.758158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512a1df-4ffe-4d39-b5c5-a49eec9fb35a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:51.758837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512a1df-4ffe-4d39-b5c5-a49eec9fb35a service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:51.759111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512a1df-4ffe-4d39-b5c5-a49eec9fb35a service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:51.759363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512a1df-4ffe-4d39-b5c5-a49eec9fb35a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:51.761169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1512a1df-4ffe-4d39-b5c5-a49eec9fb35a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:51.894518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512a1df-4ffe-4d39-b5c5-a49eec9fb35a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:51.896061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512a1df-4ffe-4d39-b5c5-a49eec9fb35a service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:51.917566 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 733/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:21:01.511108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=22 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:01.914436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=66 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:12.140769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bbd23-368b-45f5-929e-916d19a63a32 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:12.141398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bbd23-368b-45f5-929e-916d19a63a32 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:12.141398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bbd23-368b-45f5-929e-916d19a63a32 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:12.143155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 738/1471] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:12.148978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a232c1-35e3-4d90-ad8b-8f41cb147918 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:12.149535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a232c1-35e3-4d90-ad8b-8f41cb147918 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:12.149535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a232c1-35e3-4d90-ad8b-8f41cb147918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:12.223463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b5a232c1-35e3-4d90-ad8b-8f41cb147918 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:12.224760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b5a232c1-35e3-4d90-ad8b-8f41cb147918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:12.351972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 734/1472] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:12.442861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85d206-1893-4eb1-8814-d633c22138b4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:12.443145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85d206-1893-4eb1-8814-d633c22138b4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:12.443419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85d206-1893-4eb1-8814-d633c22138b4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:12.444903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 739/1473] 10.222.0.40 () {54 vars in 966 bytes} [Thu Jul 21 08:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:12.449962 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ae719-7dbe-425b-ade7-ba17212086c9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:12.450269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ae719-7dbe-425b-ade7-ba17212086c9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:12.450543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ae719-7dbe-425b-ade7-ba17212086c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:12.542802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5b8ae719-7dbe-425b-ade7-ba17212086c9 None None] MFA Rules not processed for user `f4f9a6f6d6d840d6bc29fd0ab26ddb29`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:12.544456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5b8ae719-7dbe-425b-ade7-ba17212086c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:12.569931 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:12.637337 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 735/1474] 10.222.0.40 () {58 vars in 1063 bytes} [Thu Jul 21 08:21:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:12.645601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85d206-1893-4eb1-8814-d633c22138b4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:12.647176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5d85d206-1893-4eb1-8814-d633c22138b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:12.776046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85d206-1893-4eb1-8814-d633c22138b4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:12.869396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09a66f-34af-49de-985a-ee5c09cde665 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f9a6f6d6d840d6bc29fd0ab26ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:12.870058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09a66f-34af-49de-985a-ee5c09cde665 service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:12.870338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09a66f-34af-49de-985a-ee5c09cde665 service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:12.870611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09a66f-34af-49de-985a-ee5c09cde665 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:12.872325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3f09a66f-34af-49de-985a-ee5c09cde665 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:12.935485 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:13.000956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09a66f-34af-49de-985a-ee5c09cde665 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:13.002468 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09a66f-34af-49de-985a-ee5c09cde665 service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:13.024014 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 740/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:21:15.234653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e5fdb-ed2b-4fe8-b415-823546b4f054 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:15.235231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e5fdb-ed2b-4fe8-b415-823546b4f054 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:15.235231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e5fdb-ed2b-4fe8-b415-823546b4f054 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:15.236670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 736/1476] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:21:15.242916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab429e3-aeaa-4efb-b1c0-3fcbbb2c370c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:15.243725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab429e3-aeaa-4efb-b1c0-3fcbbb2c370c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:15.243725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab429e3-aeaa-4efb-b1c0-3fcbbb2c370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:15.315389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9ab429e3-aeaa-4efb-b1c0-3fcbbb2c370c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:15.316681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9ab429e3-aeaa-4efb-b1c0-3fcbbb2c370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:15.427251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 741/1477] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:15.451412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e5fdb-ed2b-4fe8-b415-823546b4f054 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:15.453772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-839e5fdb-ed2b-4fe8-b415-823546b4f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:15.594128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e5fdb-ed2b-4fe8-b415-823546b4f054 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:15.648151 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:15.705864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f204648-a22f-434a-8746-2913a89eef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:15.706570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f204648-a22f-434a-8746-2913a89eef14 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:15.706842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f204648-a22f-434a-8746-2913a89eef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:15.707106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f204648-a22f-434a-8746-2913a89eef14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:15.707847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f204648-a22f-434a-8746-2913a89eef14 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:15.709691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-4f204648-a22f-434a-8746-2913a89eef14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:21:15.709691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 21 08:21:15.709691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: Jul 21 08:21:15.710877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f204648-a22f-434a-8746-2913a89eef14 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:15.731386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 737/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 21 08:21:15 2022] GET /identity/v3/projects => generated 2553 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:21:17.816736 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b279021-5e4d-47db-840b-88c5068e9777 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:17.817688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b279021-5e4d-47db-840b-88c5068e9777 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:17.817688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b279021-5e4d-47db-840b-88c5068e9777 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:17.819778 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 742/1479] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:21:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:17.827799 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efaeff-7d7b-4a8c-90bb-b6bc31b58c98 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:17.828328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efaeff-7d7b-4a8c-90bb-b6bc31b58c98 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:17.828429 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efaeff-7d7b-4a8c-90bb-b6bc31b58c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:17.902896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-55efaeff-7d7b-4a8c-90bb-b6bc31b58c98 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:17.904308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-55efaeff-7d7b-4a8c-90bb-b6bc31b58c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:18.018899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 738/1480] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:21:18.063566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b279021-5e4d-47db-840b-88c5068e9777 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:18.065640 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2b279021-5e4d-47db-840b-88c5068e9777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:18.077118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:18.227567 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b279021-5e4d-47db-840b-88c5068e9777 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:18.320708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:18.357924 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b324980-253a-4cba-a034-a63b058f3202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:18.358158 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b324980-253a-4cba-a034-a63b058f3202 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:18.358509 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b324980-253a-4cba-a034-a63b058f3202 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:18.358624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b324980-253a-4cba-a034-a63b058f3202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:18.360346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1b324980-253a-4cba-a034-a63b058f3202 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:18.457155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b324980-253a-4cba-a034-a63b058f3202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:18.458813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b324980-253a-4cba-a034-a63b058f3202 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:18.478345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 743/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:21:20.753296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4995b9-2e06-48da-8368-1f677bc8adec None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:20.754098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4995b9-2e06-48da-8368-1f677bc8adec None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:20.754098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4995b9-2e06-48da-8368-1f677bc8adec None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:20.755894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 739/1482] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:20.762283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e5649-c780-4400-a0ae-837136d01e55 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:20.762818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e5649-c780-4400-a0ae-837136d01e55 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:20.762913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e5649-c780-4400-a0ae-837136d01e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:20.835606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ad6e5649-c780-4400-a0ae-837136d01e55 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:20.836788 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ad6e5649-c780-4400-a0ae-837136d01e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:20.891604 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:20.952001 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 744/1483] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:20.997092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4995b9-2e06-48da-8368-1f677bc8adec None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:20.998658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bb4995b9-2e06-48da-8368-1f677bc8adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:21.024610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:21.119218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4995b9-2e06-48da-8368-1f677bc8adec None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:21.205535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251b524-2a26-45a9-9cda-37db284dd371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:21.206214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251b524-2a26-45a9-9cda-37db284dd371 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:21.206551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251b524-2a26-45a9-9cda-37db284dd371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:21.206717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251b524-2a26-45a9-9cda-37db284dd371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:21.208476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d251b524-2a26-45a9-9cda-37db284dd371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:21.292571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:21.332860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251b524-2a26-45a9-9cda-37db284dd371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:21.334324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251b524-2a26-45a9-9cda-37db284dd371 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:21.354361 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 740/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:21:23.486521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b689-1b84-42a6-880a-6c6ae1c9bda7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:23.487448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b689-1b84-42a6-880a-6c6ae1c9bda7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:23.487448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b689-1b84-42a6-880a-6c6ae1c9bda7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:23.489101 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 745/1485] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:21:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:23.495739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00879aa1-953e-4447-befd-bcea466f5e19 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:23.496303 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00879aa1-953e-4447-befd-bcea466f5e19 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:23.496303 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00879aa1-953e-4447-befd-bcea466f5e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:23.578837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-00879aa1-953e-4447-befd-bcea466f5e19 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:23.580109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-00879aa1-953e-4447-befd-bcea466f5e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:23.692440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 741/1486] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:23.731200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40b689-1b84-42a6-880a-6c6ae1c9bda7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:23.732776 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-da40b689-1b84-42a6-880a-6c6ae1c9bda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:23.850460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40b689-1b84-42a6-880a-6c6ae1c9bda7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:23.943854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:23.946192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bb7b6-759e-487b-9339-0a66ea2595f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:23.946870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bb7b6-759e-487b-9339-0a66ea2595f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:23.947146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bb7b6-759e-487b-9339-0a66ea2595f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:23.947416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bb7b6-759e-487b-9339-0a66ea2595f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:23.949757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-529bb7b6-759e-487b-9339-0a66ea2595f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:24.071385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bb7b6-759e-487b-9339-0a66ea2595f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:24.072929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bb7b6-759e-487b-9339-0a66ea2595f3 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:24.095028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 746/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:21:26.410818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10736373-fdae-4200-a218-c9415d966009 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:26.411440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10736373-fdae-4200-a218-c9415d966009 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:26.411440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10736373-fdae-4200-a218-c9415d966009 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:26.412787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 742/1488] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:26.418977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89261ad-0dee-4f33-a37a-bdcd2ee5ef3e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:26.419493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89261ad-0dee-4f33-a37a-bdcd2ee5ef3e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:26.419615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89261ad-0dee-4f33-a37a-bdcd2ee5ef3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:26.490370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a89261ad-0dee-4f33-a37a-bdcd2ee5ef3e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:26.491664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a89261ad-0dee-4f33-a37a-bdcd2ee5ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:26.551664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:26.600430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 747/1489] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:21:26.643963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10736373-fdae-4200-a218-c9415d966009 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:26.645597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-10736373-fdae-4200-a218-c9415d966009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:26.684352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:26.763081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10736373-fdae-4200-a218-c9415d966009 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:26.841194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30323250-e86f-4ad1-be51-679c88fa7d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:26.841857 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30323250-e86f-4ad1-be51-679c88fa7d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:26.842134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30323250-e86f-4ad1-be51-679c88fa7d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:26.842400 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30323250-e86f-4ad1-be51-679c88fa7d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:26.844306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-30323250-e86f-4ad1-be51-679c88fa7d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:26.932846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:26.965706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30323250-e86f-4ad1-be51-679c88fa7d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:26.967186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30323250-e86f-4ad1-be51-679c88fa7d16 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:26.990544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 743/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:21:29.355715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5171ecd-4616-4fd3-a5df-dc573feb87ed None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:29.356414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5171ecd-4616-4fd3-a5df-dc573feb87ed None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:29.356414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5171ecd-4616-4fd3-a5df-dc573feb87ed None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:29.358590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 748/1491] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 21 08:21:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:29.365414 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f318f2-4004-42b4-99eb-bd418f72690e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:29.366298 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f318f2-4004-42b4-99eb-bd418f72690e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:29.366298 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f318f2-4004-42b4-99eb-bd418f72690e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:29.449387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-34f318f2-4004-42b4-99eb-bd418f72690e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:29.451310 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-34f318f2-4004-42b4-99eb-bd418f72690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:29.572686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 744/1492] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:21:29.613215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5171ecd-4616-4fd3-a5df-dc573feb87ed None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:29.614986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e5171ecd-4616-4fd3-a5df-dc573feb87ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:29.737622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5171ecd-4616-4fd3-a5df-dc573feb87ed None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:29.823531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793bb04-fa3c-4d58-be66-e56c95883591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:29.824196 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793bb04-fa3c-4d58-be66-e56c95883591 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:29.824472 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793bb04-fa3c-4d58-be66-e56c95883591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:29.824781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793bb04-fa3c-4d58-be66-e56c95883591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:29.826520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a793bb04-fa3c-4d58-be66-e56c95883591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:29.837276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:29.969970 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793bb04-fa3c-4d58-be66-e56c95883591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:29.972796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793bb04-fa3c-4d58-be66-e56c95883591 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:30.009327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 749/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:21:39.570234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=82 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:40.004775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=50 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:57.625552 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4c513-7630-4347-8688-9254adefd300 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:57.626232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4c513-7630-4347-8688-9254adefd300 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:57.626232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4c513-7630-4347-8688-9254adefd300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:57.709292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fdf4c513-7630-4347-8688-9254adefd300 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:57.710615 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fdf4c513-7630-4347-8688-9254adefd300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:57.820104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 745/1494] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:57.828482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bcf79-cc8a-4c8e-8fe0-9418cc9ffc25 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:57.829117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bcf79-cc8a-4c8e-8fe0-9418cc9ffc25 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:57.829117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bcf79-cc8a-4c8e-8fe0-9418cc9ffc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:58.038876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8d5bcf79-cc8a-4c8e-8fe0-9418cc9ffc25 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:58.040121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8d5bcf79-cc8a-4c8e-8fe0-9418cc9ffc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:58.150608 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 750/1495] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:58.155718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4c513-7630-4347-8688-9254adefd300 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:58.157015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fdf4c513-7630-4347-8688-9254adefd300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:58.169629 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4c513-7630-4347-8688-9254adefd300 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:58.243064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:58.284011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe33c2f-d714-4b62-9e4b-6bddbd6c1d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:58.284760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe33c2f-d714-4b62-9e4b-6bddbd6c1d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:58.285046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe33c2f-d714-4b62-9e4b-6bddbd6c1d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:58.285320 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe33c2f-d714-4b62-9e4b-6bddbd6c1d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:58.286167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe33c2f-d714-4b62-9e4b-6bddbd6c1d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:58.286475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe33c2f-d714-4b62-9e4b-6bddbd6c1d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:58.287561 dv-cinder-850318-4-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-2fe33c2f-d714-4b62-9e4b-6bddbd6c1d8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:22:58.287561 dv-cinder-850318-4-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 21 08:22:58.287561 dv-cinder-850318-4-smb devstack@keystone.service[80224]: Jul 21 08:22:58.288533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe33c2f-d714-4b62-9e4b-6bddbd6c1d8f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:58.302990 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 746/1496] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:58.312054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bcf79-cc8a-4c8e-8fe0-9418cc9ffc25 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:58.322267 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bcf79-cc8a-4c8e-8fe0-9418cc9ffc25 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:58.394512 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:58.433143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f41dea-09ab-44cc-9064-a35436cd7fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:58.433727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f41dea-09ab-44cc-9064-a35436cd7fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:58.434005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f41dea-09ab-44cc-9064-a35436cd7fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:58.434274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f41dea-09ab-44cc-9064-a35436cd7fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:58.434973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f41dea-09ab-44cc-9064-a35436cd7fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:58.436887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-a4f41dea-09ab-44cc-9064-a35436cd7fbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:22:58.436887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 21 08:22:58.436887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: Jul 21 08:22:58.438083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f41dea-09ab-44cc-9064-a35436cd7fbe admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:58.499631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 751/1497] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:22:58 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:22:58.504151 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe33c2f-d714-4b62-9e4b-6bddbd6c1d8f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:58.505716 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2fe33c2f-d714-4b62-9e4b-6bddbd6c1d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:58.542413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe33c2f-d714-4b62-9e4b-6bddbd6c1d8f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:58.662549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae628b-f89f-449c-ac9d-fd2ce2f28eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:58.663301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae628b-f89f-449c-ac9d-fd2ce2f28eac admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:58.663507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae628b-f89f-449c-ac9d-fd2ce2f28eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:58.663883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae628b-f89f-449c-ac9d-fd2ce2f28eac admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:58.664626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae628b-f89f-449c-ac9d-fd2ce2f28eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:58.665664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-83ae628b-f89f-449c-ac9d-fd2ce2f28eac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:22:58.665664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 21 08:22:58.665664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: Jul 21 08:22:58.667057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae628b-f89f-449c-ac9d-fd2ce2f28eac admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:58.717157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 747/1498] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:22:58 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:22:58.721455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f41dea-09ab-44cc-9064-a35436cd7fbe admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:58.723007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a4f41dea-09ab-44cc-9064-a35436cd7fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:58.790458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f41dea-09ab-44cc-9064-a35436cd7fbe admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:58.881894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:58.894490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c2936-f0d4-4a8d-b68a-b76f58ea4f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:58.895170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c2936-f0d4-4a8d-b68a-b76f58ea4f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:58.895455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c2936-f0d4-4a8d-b68a-b76f58ea4f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:58.895722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c2936-f0d4-4a8d-b68a-b76f58ea4f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:58.896473 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c2936-f0d4-4a8d-b68a-b76f58ea4f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:58.897531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-507c2936-f0d4-4a8d-b68a-b76f58ea4f90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:22:58.897531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 21 08:22:58.897531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: Jul 21 08:22:58.898441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c2936-f0d4-4a8d-b68a-b76f58ea4f90 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:58.913157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 752/1499] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:22:58.917544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae628b-f89f-449c-ac9d-fd2ce2f28eac admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:58.919110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-83ae628b-f89f-449c-ac9d-fd2ce2f28eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:58.930958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae628b-f89f-449c-ac9d-fd2ce2f28eac admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:58.965054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:59.042901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ae101-9820-419c-aa0e-3d39ab8e4861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:59.043487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ae101-9820-419c-aa0e-3d39ab8e4861 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:59.043776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ae101-9820-419c-aa0e-3d39ab8e4861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:59.044051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ae101-9820-419c-aa0e-3d39ab8e4861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:59.044871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ae101-9820-419c-aa0e-3d39ab8e4861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:59.045914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-7d5ae101-9820-419c-aa0e-3d39ab8e4861 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:22:59.045914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 21 08:22:59.045914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: Jul 21 08:22:59.046802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ae101-9820-419c-aa0e-3d39ab8e4861 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:59.060125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 748/1500] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:22:59.064735 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c2936-f0d4-4a8d-b68a-b76f58ea4f90 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:59.066504 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-507c2936-f0d4-4a8d-b68a-b76f58ea4f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:59.104607 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c2936-f0d4-4a8d-b68a-b76f58ea4f90 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:59.211198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ff486-745c-4094-831f-469bd8bbcb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:59.212108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ff486-745c-4094-831f-469bd8bbcb57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:59.212383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ff486-745c-4094-831f-469bd8bbcb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:59.212734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ff486-745c-4094-831f-469bd8bbcb57 admin admin] PATH_INFO: `/v3/projects/0ed7dac65a614086916162be7f495bcf/users/dcccbb01bccb43c286dca39746cb4234/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:59.238309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ff486-745c-4094-831f-469bd8bbcb57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed7dac65a614086916162be7f495bcf, user_id=dcccbb01bccb43c286dca39746cb4234, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:59.239366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-1e6ff486-745c-4094-831f-469bd8bbcb57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:22:59.239366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 21 08:22:59.239366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: Jul 21 08:22:59.241361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ff486-745c-4094-831f-469bd8bbcb57 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:59.269838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 753/1501] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:22:59 2022] PUT /identity/v3/projects/0ed7dac65a614086916162be7f495bcf/users/dcccbb01bccb43c286dca39746cb4234/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:22:59.287850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53c873-c40b-45f7-a46c-88754dad9d6f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:59.288718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53c873-c40b-45f7-a46c-88754dad9d6f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:59.289270 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53c873-c40b-45f7-a46c-88754dad9d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:59.363866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fa53c873-c40b-45f7-a46c-88754dad9d6f None None] MFA Rules not processed for user `dcccbb01bccb43c286dca39746cb4234`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:59.366046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fa53c873-c40b-45f7-a46c-88754dad9d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:59.456344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 749/1502] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:22:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:59.472520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92d0b8-2e80-4034-85b2-0301361a72da None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:59.472997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92d0b8-2e80-4034-85b2-0301361a72da None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:59.473482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92d0b8-2e80-4034-85b2-0301361a72da None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:59.475700 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 754/1503] 10.222.0.40 () {54 vars in 964 bytes} [Thu Jul 21 08:22:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:59.481183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a675a0-a750-40cf-9533-56a99500561c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:59.481503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a675a0-a750-40cf-9533-56a99500561c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:59.481780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a675a0-a750-40cf-9533-56a99500561c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:59.513699 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:59.562525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-09a675a0-a750-40cf-9533-56a99500561c None None] MFA Rules not processed for user `8e44cec1e8ee4c82b104cf64ae0de6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:59.563638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-09a675a0-a750-40cf-9533-56a99500561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:59.646002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 750/1504] 10.222.0.40 () {58 vars in 1061 bytes} [Thu Jul 21 08:22:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:22:59.653869 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92d0b8-2e80-4034-85b2-0301361a72da None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:59.656024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0c92d0b8-2e80-4034-85b2-0301361a72da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:59.714130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:59.780017 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92d0b8-2e80-4034-85b2-0301361a72da None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:59.866308 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb38726-debb-4d44-8fba-91b7d3d60e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:59.866988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb38726-debb-4d44-8fba-91b7d3d60e18 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:59.867310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb38726-debb-4d44-8fba-91b7d3d60e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:59.867625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb38726-debb-4d44-8fba-91b7d3d60e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:59.869520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dfb38726-debb-4d44-8fba-91b7d3d60e18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:59.977875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb38726-debb-4d44-8fba-91b7d3d60e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:59.979327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb38726-debb-4d44-8fba-91b7d3d60e18 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:59.983633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:00.005115 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 755/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:22:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:00.052767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3e72-87de-4d4a-8e54-fd498876c96a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:00.053264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3e72-87de-4d4a-8e54-fd498876c96a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:00.053264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3e72-87de-4d4a-8e54-fd498876c96a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:00.054644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 751/1506] 10.222.0.40 () {52 vars in 829 bytes} [Thu Jul 21 08:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:00.058605 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb38726-debb-4d44-8fba-91b7d3d60e18 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:00.059832 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dfb38726-debb-4d44-8fba-91b7d3d60e18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:00.166967 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb38726-debb-4d44-8fba-91b7d3d60e18 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:00.272299 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:00.273206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:00.273487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:00.273763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] PATH_INFO: `/v3/users/dcccbb01bccb43c286dca39746cb4234` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:00.287292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcccbb01bccb43c286dca39746cb4234)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:00.288389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:23:00.288389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 21 08:23:00.288389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: Jul 21 08:23:00.289662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:00.300257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:00.364799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcccbb01bccb43c286dca39746cb4234'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:23:00.380393 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcccbb01bccb43c286dca39746cb4234'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:23:00.399759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcccbb01bccb43c286dca39746cb4234'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:23:00.400343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcccbb01bccb43c286dca39746cb4234'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:23:00.400809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcccbb01bccb43c286dca39746cb4234'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:23:00.421933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 756/1507] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:23:00 2022] DELETE /identity/v3/users/dcccbb01bccb43c286dca39746cb4234 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:23:00.428888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a1c9c-5eb0-44d1-a281-d58ddc842833 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:00.429235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a1c9c-5eb0-44d1-a281-d58ddc842833 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:00.429613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a1c9c-5eb0-44d1-a281-d58ddc842833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:00.491302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-cf4a1c9c-5eb0-44d1-a281-d58ddc842833 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:00.492578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cf4a1c9c-5eb0-44d1-a281-d58ddc842833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:00.574766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:00.589222 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 752/1508] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:23:00.599823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:00.601148 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:00.719998 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e893e24-d6c1-42ad-a5f1-de00b21f168d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:00.787895 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:00.810691 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b5219-7164-4e12-a161-35bd5914feba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:00.811367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5219-7164-4e12-a161-35bd5914feba service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:00.811646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5219-7164-4e12-a161-35bd5914feba service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:00.811939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5219-7164-4e12-a161-35bd5914feba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:00.813664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4e4b5219-7164-4e12-a161-35bd5914feba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:00.933073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b5219-7164-4e12-a161-35bd5914feba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:00.934857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b5219-7164-4e12-a161-35bd5914feba service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:00.961250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 757/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:01.327449 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a1c9c-5eb0-44d1-a281-d58ddc842833 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:01.328745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cf4a1c9c-5eb0-44d1-a281-d58ddc842833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:01.340924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a1c9c-5eb0-44d1-a281-d58ddc842833 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:01.458138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:01.459037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:01.459316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:01.459566 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] PATH_INFO: `/v3/projects/0ed7dac65a614086916162be7f495bcf` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:01.471191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed7dac65a614086916162be7f495bcf)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:01.472288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:23:01.472288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 21 08:23:01.472288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: Jul 21 08:23:01.473596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:01.537933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed7dac65a614086916162be7f495bcf', 'request_id': 'req-55e8e64a-afe4-40cd-b1dc-4587dcd34892'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:23:01.553902 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed7dac65a614086916162be7f495bcf', 'request_id': 'req-55e8e64a-afe4-40cd-b1dc-4587dcd34892'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:23:01.561286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed7dac65a614086916162be7f495bcf', 'request_id': 'req-55e8e64a-afe4-40cd-b1dc-4587dcd34892'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:23:01.589130 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] The token cache is being invalidate because project 0ed7dac65a614086916162be7f495bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:23:01.589417 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:23:01.589951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-55e8e64a-afe4-40cd-b1dc-4587dcd34892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:23:01.591387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 753/1510] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:23:01 2022] DELETE /identity/v3/projects/0ed7dac65a614086916162be7f495bcf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:23:10.958411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=62 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:11.587353 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:45.792733 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494e73f-ea53-45c1-9527-329196363734 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:45.793797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494e73f-ea53-45c1-9527-329196363734 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:45.793797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494e73f-ea53-45c1-9527-329196363734 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:45.794972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:45.801471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c069b6-bfc7-4fa8-9560-1c761494458d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:45.801947 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c069b6-bfc7-4fa8-9560-1c761494458d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:45.802049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c069b6-bfc7-4fa8-9560-1c761494458d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:45.892072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-56c069b6-bfc7-4fa8-9560-1c761494458d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:45.893368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-56c069b6-bfc7-4fa8-9560-1c761494458d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:46.157004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:46.309416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494e73f-ea53-45c1-9527-329196363734 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:46.312908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5494e73f-ea53-45c1-9527-329196363734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:46.446753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494e73f-ea53-45c1-9527-329196363734 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:46.453267 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50153faf-0850-406a-8960-4cdac53f4336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:46.453922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50153faf-0850-406a-8960-4cdac53f4336 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:46.454199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50153faf-0850-406a-8960-4cdac53f4336 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:46.454476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50153faf-0850-406a-8960-4cdac53f4336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:46.463141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50153faf-0850-406a-8960-4cdac53f4336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:46.464781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50153faf-0850-406a-8960-4cdac53f4336 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:46.474296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 759/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:47.303907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf9d46-867e-467e-ac05-7181ec6b7ee5 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:47.304373 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf9d46-867e-467e-ac05-7181ec6b7ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:47.304480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf9d46-867e-467e-ac05-7181ec6b7ee5 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:47.305886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:47.311218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb36f89-5bfc-4c39-bcc1-a657801093da None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:47.311662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb36f89-5bfc-4c39-bcc1-a657801093da None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:47.311765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb36f89-5bfc-4c39-bcc1-a657801093da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:47.330799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3fb36f89-5bfc-4c39-bcc1-a657801093da None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:47.331928 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3fb36f89-5bfc-4c39-bcc1-a657801093da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:47.340640 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:47.493483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf9d46-867e-467e-ac05-7181ec6b7ee5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:47.511556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf9d46-867e-467e-ac05-7181ec6b7ee5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:47.519295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1936912-db6b-4c8b-a1e1-4a605bf97c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:47.519937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1936912-db6b-4c8b-a1e1-4a605bf97c7b service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:47.520215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1936912-db6b-4c8b-a1e1-4a605bf97c7b service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:47.520586 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1936912-db6b-4c8b-a1e1-4a605bf97c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:47.529269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1936912-db6b-4c8b-a1e1-4a605bf97c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:47.530897 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1936912-db6b-4c8b-a1e1-4a605bf97c7b service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:47.540485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 756/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:47.911988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3841-2a4c-4e4e-b4bc-328b1ff21b19 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:47.912270 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3841-2a4c-4e4e-b4bc-328b1ff21b19 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:47.912538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3841-2a4c-4e4e-b4bc-328b1ff21b19 None None] PATH_INFO: `/v3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:47.913918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 761/1517] 10.222.0.25 () {54 vars in 925 bytes} [Thu Jul 21 08:24:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:24:47.921433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffaaed-6038-42fc-9dbb-c1899b9cc66b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:47.921717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffaaed-6038-42fc-9dbb-c1899b9cc66b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:47.921993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffaaed-6038-42fc-9dbb-c1899b9cc66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:47.989565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-92ffaaed-6038-42fc-9dbb-c1899b9cc66b None None] MFA Rules not processed for user `1fd9ea435d7b48cb8b1b2a27d79cfa91`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:47.990784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-92ffaaed-6038-42fc-9dbb-c1899b9cc66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:48.008072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:48.089479 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 757/1518] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Jul 21 08:24:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:56.877449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc9075-4257-49d1-a8f1-b38d4d66692c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:56.878402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc9075-4257-49d1-a8f1-b38d4d66692c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:56.878402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc9075-4257-49d1-a8f1-b38d4d66692c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:56.880415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 762/1519] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jul 21 08:24:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:56.888477 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ebc7-0198-4cd8-8f71-52674c79d62a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:56.889352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ebc7-0198-4cd8-8f71-52674c79d62a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:56.889352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ebc7-0198-4cd8-8f71-52674c79d62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:56.919378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5091ebc7-0198-4cd8-8f71-52674c79d62a None None] MFA Rules not processed for user `1fd9ea435d7b48cb8b1b2a27d79cfa91`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:56.920640 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5091ebc7-0198-4cd8-8f71-52674c79d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:56.932118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 758/1520] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jul 21 08:24:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:56.942221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc9075-4257-49d1-a8f1-b38d4d66692c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:56.957508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc9075-4257-49d1-a8f1-b38d4d66692c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:56.963170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33252670-7241-48b5-87e1-40c4a2839684 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd9ea435d7b48cb8b1b2a27d79cfa91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:56.963808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33252670-7241-48b5-87e1-40c4a2839684 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:56.964083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33252670-7241-48b5-87e1-40c4a2839684 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:56.964355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33252670-7241-48b5-87e1-40c4a2839684 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:56.973052 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33252670-7241-48b5-87e1-40c4a2839684 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:56.974661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33252670-7241-48b5-87e1-40c4a2839684 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:56.989981 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 763/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:58.784785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a9dbc-bb22-4a9b-b34e-45fce70fa1b3 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:58.785376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a9dbc-bb22-4a9b-b34e-45fce70fa1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:58.785376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a9dbc-bb22-4a9b-b34e-45fce70fa1b3 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:58.786739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:58.791969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfc118-d1f3-40a2-9fd7-3eb8e86f9de2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:58.792390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfc118-d1f3-40a2-9fd7-3eb8e86f9de2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:58.792546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfc118-d1f3-40a2-9fd7-3eb8e86f9de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:58.811466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2edfc118-d1f3-40a2-9fd7-3eb8e86f9de2 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:58.812737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2edfc118-d1f3-40a2-9fd7-3eb8e86f9de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:58.821568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:24:58.981614 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a9dbc-bb22-4a9b-b34e-45fce70fa1b3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:24:58.997906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a9dbc-bb22-4a9b-b34e-45fce70fa1b3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:24:59.005143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615998f7-0cd9-40c8-af24-81653ad3104c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:24:59.005785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615998f7-0cd9-40c8-af24-81653ad3104c service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:59.006062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615998f7-0cd9-40c8-af24-81653ad3104c service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:59.006333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615998f7-0cd9-40c8-af24-81653ad3104c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:59.015701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615998f7-0cd9-40c8-af24-81653ad3104c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:24:59.017695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615998f7-0cd9-40c8-af24-81653ad3104c service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:24:59.027654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 760/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:24:59.850338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2acd2-0e68-4874-937c-bb5ebbd54157 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:59.850959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2acd2-0e68-4874-937c-bb5ebbd54157 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:59.850959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2acd2-0e68-4874-937c-bb5ebbd54157 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:59.852307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:24:59.857453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6de96-f7a8-4906-9542-4002eb5765f6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:24:59.857914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6de96-f7a8-4906-9542-4002eb5765f6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:24:59.858020 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6de96-f7a8-4906-9542-4002eb5765f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:24:59.877804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-63b6de96-f7a8-4906-9542-4002eb5765f6 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:24:59.879025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-63b6de96-f7a8-4906-9542-4002eb5765f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:24:59.887271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:25:00.038097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2acd2-0e68-4874-937c-bb5ebbd54157 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:25:00.057236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2acd2-0e68-4874-937c-bb5ebbd54157 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:25:00.063687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd640c77-6892-498d-ba82-78da04953416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:25:00.064323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd640c77-6892-498d-ba82-78da04953416 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:00.064634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd640c77-6892-498d-ba82-78da04953416 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:00.064908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd640c77-6892-498d-ba82-78da04953416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:00.073624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd640c77-6892-498d-ba82-78da04953416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:25:00.075320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd640c77-6892-498d-ba82-78da04953416 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:25:00.085813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 766/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:25:04.051752 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8427b9-ae76-4953-bfae-e3384e6778ac None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:04.052390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8427b9-ae76-4953-bfae-e3384e6778ac None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:04.052390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8427b9-ae76-4953-bfae-e3384e6778ac None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:04.053726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:25:04.059266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7bab5-3e90-4869-9c10-4c7e3029be20 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:04.059892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7bab5-3e90-4869-9c10-4c7e3029be20 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:04.059892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7bab5-3e90-4869-9c10-4c7e3029be20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:04.079985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fcf7bab5-3e90-4869-9c10-4c7e3029be20 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:25:04.081235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fcf7bab5-3e90-4869-9c10-4c7e3029be20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:25:04.089902 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:25:04.165148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8427b9-ae76-4953-bfae-e3384e6778ac None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:25:04.167498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9c8427b9-ae76-4953-bfae-e3384e6778ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:25:04.270762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8427b9-ae76-4953-bfae-e3384e6778ac None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:25:04.274832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159b520-1317-4324-94dc-acc2f1b52c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:25:04.275494 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159b520-1317-4324-94dc-acc2f1b52c6c service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:04.275774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159b520-1317-4324-94dc-acc2f1b52c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:04.276048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159b520-1317-4324-94dc-acc2f1b52c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:04.286512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159b520-1317-4324-94dc-acc2f1b52c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:25:04.288007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159b520-1317-4324-94dc-acc2f1b52c6c service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:25:04.298018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 763/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:25:06.324930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada126-e546-45d1-80f8-ba5cbd4fbe55 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:06.325486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada126-e546-45d1-80f8-ba5cbd4fbe55 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:06.325486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada126-e546-45d1-80f8-ba5cbd4fbe55 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:06.326920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:25:06.333276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bee90b-9b24-400d-ab47-beed78ac0e46 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:06.333968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bee90b-9b24-400d-ab47-beed78ac0e46 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:06.334083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bee90b-9b24-400d-ab47-beed78ac0e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:06.357301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-62bee90b-9b24-400d-ab47-beed78ac0e46 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:25:06.358667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-62bee90b-9b24-400d-ab47-beed78ac0e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:25:06.368409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:25:06.405258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada126-e546-45d1-80f8-ba5cbd4fbe55 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:25:06.417170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada126-e546-45d1-80f8-ba5cbd4fbe55 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:25:06.421163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525ab2a-01fc-437b-8ce9-4a71d7d0a36b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:25:06.421801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525ab2a-01fc-437b-8ce9-4a71d7d0a36b service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:06.422055 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525ab2a-01fc-437b-8ce9-4a71d7d0a36b service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:06.422329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525ab2a-01fc-437b-8ce9-4a71d7d0a36b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:06.432054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525ab2a-01fc-437b-8ce9-4a71d7d0a36b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:25:06.433537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525ab2a-01fc-437b-8ce9-4a71d7d0a36b service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:25:06.443258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 769/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:25:10.222412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5270d9-b579-452b-a149-782dd7eddf83 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:10.223010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5270d9-b579-452b-a149-782dd7eddf83 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:10.223010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5270d9-b579-452b-a149-782dd7eddf83 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:10.225386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:25:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:25:10.233766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad67d-4647-421c-be99-2a854e8cd0ed None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:10.234256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad67d-4647-421c-be99-2a854e8cd0ed None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:10.234353 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad67d-4647-421c-be99-2a854e8cd0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:10.256210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-539ad67d-4647-421c-be99-2a854e8cd0ed None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:25:10.258031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-539ad67d-4647-421c-be99-2a854e8cd0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:25:10.270311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:25:10.577340 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5270d9-b579-452b-a149-782dd7eddf83 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:25:10.579829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ba5270d9-b579-452b-a149-782dd7eddf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:25:10.653694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:25:10.667983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5270d9-b579-452b-a149-782dd7eddf83 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:25:10.672008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729aa36-ceef-489b-9bcd-75893a56495a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:25:10.672726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729aa36-ceef-489b-9bcd-75893a56495a service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:10.673000 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729aa36-ceef-489b-9bcd-75893a56495a service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:10.673279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729aa36-ceef-489b-9bcd-75893a56495a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:10.682988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729aa36-ceef-489b-9bcd-75893a56495a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:25:10.684452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729aa36-ceef-489b-9bcd-75893a56495a service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:25:10.694349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 766/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:25:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:25:12.734129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6813e7b-9a96-4472-a0a0-dc86ab7367b7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:12.734738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6813e7b-9a96-4472-a0a0-dc86ab7367b7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:12.735141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6813e7b-9a96-4472-a0a0-dc86ab7367b7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:12.736771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:25:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:25:12.743470 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffdf95-d91a-4600-be42-dcd020c31e58 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:12.744245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffdf95-d91a-4600-be42-dcd020c31e58 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:12.744421 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffdf95-d91a-4600-be42-dcd020c31e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:12.765532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b5ffdf95-d91a-4600-be42-dcd020c31e58 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:25:12.767108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b5ffdf95-d91a-4600-be42-dcd020c31e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:25:12.776758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:25:13.104455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6813e7b-9a96-4472-a0a0-dc86ab7367b7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:25:13.107451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f6813e7b-9a96-4472-a0a0-dc86ab7367b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:25:13.118008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:25:13.125582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6813e7b-9a96-4472-a0a0-dc86ab7367b7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:25:13.130164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ed0d-322d-4d3a-bd1a-b12c125e570a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:25:13.131046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ed0d-322d-4d3a-bd1a-b12c125e570a service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:25:13.131379 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ed0d-322d-4d3a-bd1a-b12c125e570a service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:25:13.131739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ed0d-322d-4d3a-bd1a-b12c125e570a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:25:13.143100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ed0d-322d-4d3a-bd1a-b12c125e570a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:25:13.144586 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ed0d-322d-4d3a-bd1a-b12c125e570a service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:25:13.155624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 772/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:25:22.760293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=11 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:25:23.150519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:45.218466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be00a8-967e-4aca-9ddd-0a5d32ec5ced None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:45.219468 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be00a8-967e-4aca-9ddd-0a5d32ec5ced None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:45.219468 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be00a8-967e-4aca-9ddd-0a5d32ec5ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:45.255315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c8be00a8-967e-4aca-9ddd-0a5d32ec5ced None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:45.258606 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c8be00a8-967e-4aca-9ddd-0a5d32ec5ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:45.278938 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3854ec1-a970-46a2-99c0-8c7b2c3e7ec2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:45.279865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3854ec1-a970-46a2-99c0-8c7b2c3e7ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:45.279865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3854ec1-a970-46a2-99c0-8c7b2c3e7ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:45.282872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 768/1540] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:45.293101 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b248048-f356-4c7f-a5b2-714de35c0b01 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:45.294063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b248048-f356-4c7f-a5b2-714de35c0b01 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:45.295026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b248048-f356-4c7f-a5b2-714de35c0b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:45.310128 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f3854ec1-a970-46a2-99c0-8c7b2c3e7ec2 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:45.312811 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f3854ec1-a970-46a2-99c0-8c7b2c3e7ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:45.334228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 773/1541] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:26:45.347070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76206ced-e941-4aac-bc20-e851b1707f2c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:45.347388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76206ced-e941-4aac-bc20-e851b1707f2c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:45.347728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76206ced-e941-4aac-bc20-e851b1707f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:45.357223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7b248048-f356-4c7f-a5b2-714de35c0b01 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:45.359892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7b248048-f356-4c7f-a5b2-714de35c0b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:45.384751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-76206ced-e941-4aac-bc20-e851b1707f2c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:45.385564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 769/1542] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:45.386195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-76206ced-e941-4aac-bc20-e851b1707f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:45.388879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfef67-7105-4389-b8e0-a009b2c915b8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:45.389728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfef67-7105-4389-b8e0-a009b2c915b8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:45.391097 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfef67-7105-4389-b8e0-a009b2c915b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:45.400228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 774/1543] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:26:45.401160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76206ced-e941-4aac-bc20-e851b1707f2c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:45.420769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76206ced-e941-4aac-bc20-e851b1707f2c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:45.428821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4814ad-41ce-4ff8-a6f1-3578f2f65382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:45.429512 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4814ad-41ce-4ff8-a6f1-3578f2f65382 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:45.429785 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4814ad-41ce-4ff8-a6f1-3578f2f65382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:45.430460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4814ad-41ce-4ff8-a6f1-3578f2f65382 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:45.430781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4814ad-41ce-4ff8-a6f1-3578f2f65382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:26:45.431089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4814ad-41ce-4ff8-a6f1-3578f2f65382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:45.432142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-ed4814ad-41ce-4ff8-a6f1-3578f2f65382 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:45.432142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 21 08:26:45.432142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: Jul 21 08:26:45.436023 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4814ad-41ce-4ff8-a6f1-3578f2f65382 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:45.453019 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a6dfef67-7105-4389-b8e0-a009b2c915b8 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:45.455622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a6dfef67-7105-4389-b8e0-a009b2c915b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:45.460529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 775/1544] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:26:45.460529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4814ad-41ce-4ff8-a6f1-3578f2f65382 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:45.477334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4814ad-41ce-4ff8-a6f1-3578f2f65382 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:45.485104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff966b7-8db5-4bba-9195-fb60b6550dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:45.485791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff966b7-8db5-4bba-9195-fb60b6550dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:45.486070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff966b7-8db5-4bba-9195-fb60b6550dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:45.486342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff966b7-8db5-4bba-9195-fb60b6550dc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:45.487138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 770/1545] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:45.488905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfef67-7105-4389-b8e0-a009b2c915b8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:45.492762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff966b7-8db5-4bba-9195-fb60b6550dc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:26:45.493268 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff966b7-8db5-4bba-9195-fb60b6550dc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:45.495402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff966b7-8db5-4bba-9195-fb60b6550dc1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:45.536527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfef67-7105-4389-b8e0-a009b2c915b8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:45.541437 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 776/1546] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:26:45.545464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dca31-c5e1-4a8b-ad58-942246db30ad None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:45.547006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dca31-c5e1-4a8b-ad58-942246db30ad None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:45.549150 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dca31-c5e1-4a8b-ad58-942246db30ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:45.563360 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058097c0-6806-468e-970f-8bf542db43e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:45.566140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058097c0-6806-468e-970f-8bf542db43e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:45.569886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058097c0-6806-468e-970f-8bf542db43e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:45.570746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058097c0-6806-468e-970f-8bf542db43e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:45.574182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058097c0-6806-468e-970f-8bf542db43e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:45.582836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-058097c0-6806-468e-970f-8bf542db43e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:45.582836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 21 08:26:45.582836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: Jul 21 08:26:45.590045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058097c0-6806-468e-970f-8bf542db43e0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:45.643674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-213dca31-c5e1-4a8b-ad58-942246db30ad None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:45.646215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-213dca31-c5e1-4a8b-ad58-942246db30ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:45.685809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 777/1547] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:45.687754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dca31-c5e1-4a8b-ad58-942246db30ad None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:45.729062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dca31-c5e1-4a8b-ad58-942246db30ad None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:45.739409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 771/1548] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:26:45 2022] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:45.743165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058097c0-6806-468e-970f-8bf542db43e0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:45.746951 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b92855-4b56-4b5f-b3c7-a8b3630b33a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:45.748467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b92855-4b56-4b5f-b3c7-a8b3630b33a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:45.749405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b92855-4b56-4b5f-b3c7-a8b3630b33a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:45.750200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b92855-4b56-4b5f-b3c7-a8b3630b33a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:45.751858 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b92855-4b56-4b5f-b3c7-a8b3630b33a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:45.761334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b92855-4b56-4b5f-b3c7-a8b3630b33a0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:45.830682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 778/1549] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:26:45 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:45.831629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b92855-4b56-4b5f-b3c7-a8b3630b33a0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:45.935053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058097c0-6806-468e-970f-8bf542db43e0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:45.974249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b92855-4b56-4b5f-b3c7-a8b3630b33a0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:46.004210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1a0e-be97-4f55-942a-1fafc5c3e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:46.004210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1a0e-be97-4f55-942a-1fafc5c3e532 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.004210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1a0e-be97-4f55-942a-1fafc5c3e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.004210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1a0e-be97-4f55-942a-1fafc5c3e532 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.004939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa1a0e-be97-4f55-942a-1fafc5c3e532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:46.004939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-08fa1a0e-be97-4f55-942a-1fafc5c3e532 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:46.004939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 21 08:26:46.004939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: Jul 21 08:26:46.006731 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa1a0e-be97-4f55-942a-1fafc5c3e532 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:46.070880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 779/1550] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:26:45 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:46.073230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1a0e-be97-4f55-942a-1fafc5c3e532 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:46.106107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1a0e-be97-4f55-942a-1fafc5c3e532 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:46.124278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3a672-d23b-42f5-a974-b217a90bafb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:46.126017 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3a672-d23b-42f5-a974-b217a90bafb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.126876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3a672-d23b-42f5-a974-b217a90bafb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.127658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3a672-d23b-42f5-a974-b217a90bafb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.129446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3a672-d23b-42f5-a974-b217a90bafb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:46.134416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3a672-d23b-42f5-a974-b217a90bafb1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:46.142031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90751757-1f61-4665-b436-d65084e3ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:46.143490 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90751757-1f61-4665-b436-d65084e3ed8b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.143988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90751757-1f61-4665-b436-d65084e3ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.144468 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90751757-1f61-4665-b436-d65084e3ed8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.145923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90751757-1f61-4665-b436-d65084e3ed8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:26:46.146508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90751757-1f61-4665-b436-d65084e3ed8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:46.149596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90751757-1f61-4665-b436-d65084e3ed8b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:46.196085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 780/1551] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:26:46 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:46.197117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3a672-d23b-42f5-a974-b217a90bafb1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:46.200084 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 772/1552] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:26:46.202534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3499444-0c2c-4d68-b787-ae15bfb06210 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.203006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3499444-0c2c-4d68-b787-ae15bfb06210 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.203486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3499444-0c2c-4d68-b787-ae15bfb06210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.217821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3a672-d23b-42f5-a974-b217a90bafb1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:46.237487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26571d7-596f-4788-90f8-911166f7ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:46.238213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26571d7-596f-4788-90f8-911166f7ccf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.238489 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26571d7-596f-4788-90f8-911166f7ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.238769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26571d7-596f-4788-90f8-911166f7ccf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.239527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26571d7-596f-4788-90f8-911166f7ccf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:46.241520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26571d7-596f-4788-90f8-911166f7ccf9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:46.264119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 781/1553] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:46.265038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26571d7-596f-4788-90f8-911166f7ccf9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:46.267212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e3499444-0c2c-4d68-b787-ae15bfb06210 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:46.273316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e3499444-0c2c-4d68-b787-ae15bfb06210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:46.285684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26571d7-596f-4788-90f8-911166f7ccf9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:46.294483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 773/1554] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:46.298202 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3499444-0c2c-4d68-b787-ae15bfb06210 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:46.310929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc93aa-aa7e-4117-a635-dd5df6bb4a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:46.311644 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc93aa-aa7e-4117-a635-dd5df6bb4a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.311973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc93aa-aa7e-4117-a635-dd5df6bb4a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.312254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc93aa-aa7e-4117-a635-dd5df6bb4a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.313005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc93aa-aa7e-4117-a635-dd5df6bb4a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:46.314709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc93aa-aa7e-4117-a635-dd5df6bb4a7a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:46.331767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3499444-0c2c-4d68-b787-ae15bfb06210 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:46.349702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 782/1555] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:46.352407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc93aa-aa7e-4117-a635-dd5df6bb4a7a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:46.353528 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e509a6f-5386-4272-9335-fee4670aed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:46.354749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e509a6f-5386-4272-9335-fee4670aed5a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.355101 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e509a6f-5386-4272-9335-fee4670aed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.355421 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e509a6f-5386-4272-9335-fee4670aed5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.360800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e509a6f-5386-4272-9335-fee4670aed5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:46.363675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e509a6f-5386-4272-9335-fee4670aed5a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:46.379751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc93aa-aa7e-4117-a635-dd5df6bb4a7a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:46.396108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c7625-ee10-4341-83bc-cf446af32c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:46.397851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c7625-ee10-4341-83bc-cf446af32c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.398305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c7625-ee10-4341-83bc-cf446af32c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.398584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c7625-ee10-4341-83bc-cf446af32c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.399344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c7625-ee10-4341-83bc-cf446af32c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:46.401078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c7625-ee10-4341-83bc-cf446af32c6c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:46.424742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 783/1556] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:46.432454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 774/1557] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:26:46 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:46.433989 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e509a6f-5386-4272-9335-fee4670aed5a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:46.438343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863011-ad87-4f72-b39d-657f753c0780 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.441857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863011-ad87-4f72-b39d-657f753c0780 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.441857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863011-ad87-4f72-b39d-657f753c0780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.488483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ff863011-ad87-4f72-b39d-657f753c0780 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:46.492701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ff863011-ad87-4f72-b39d-657f753c0780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:46.497085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:46.544084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:46.606242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e509a6f-5386-4272-9335-fee4670aed5a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:46.627528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 784/1558] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:46.628446 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5e21-4e3b-4fe9-bf75-96ad74ae59dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:46.629669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5e21-4e3b-4fe9-bf75-96ad74ae59dc admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.630061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5e21-4e3b-4fe9-bf75-96ad74ae59dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.630619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5e21-4e3b-4fe9-bf75-96ad74ae59dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.632419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9603c-dd04-4432-aff1-04929298f7bb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.632949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c5e21-4e3b-4fe9-bf75-96ad74ae59dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:46.633605 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9603c-dd04-4432-aff1-04929298f7bb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.634441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9603c-dd04-4432-aff1-04929298f7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.636626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c5e21-4e3b-4fe9-bf75-96ad74ae59dc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:46.652397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 775/1559] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:46.653936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5e21-4e3b-4fe9-bf75-96ad74ae59dc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:46.665523 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5e21-4e3b-4fe9-bf75-96ad74ae59dc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:46.667106 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-72e9603c-dd04-4432-aff1-04929298f7bb None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:46.668312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-72e9603c-dd04-4432-aff1-04929298f7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:46.670863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dea83-690a-4936-a209-90210b656461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:46.671876 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dea83-690a-4936-a209-90210b656461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.672239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dea83-690a-4936-a209-90210b656461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.672639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dea83-690a-4936-a209-90210b656461 admin admin] PATH_INFO: `/v3/projects/1e0768fb27024185a6653cc26b0447c2/users/81c6d25afc4b484e891769c7bd583819/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.679077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 785/1560] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:46.680390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9603c-dd04-4432-aff1-04929298f7bb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:46.690269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dea83-690a-4936-a209-90210b656461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0768fb27024185a6653cc26b0447c2, user_id=81c6d25afc4b484e891769c7bd583819, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:46.691433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-c40dea83-690a-4936-a209-90210b656461 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:46.691433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 21 08:26:46.691433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: Jul 21 08:26:46.693578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dea83-690a-4936-a209-90210b656461 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:46.701786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9603c-dd04-4432-aff1-04929298f7bb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:46.707327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de88cc-6f75-4db3-a5e6-9c2d00edd8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:46.708329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de88cc-6f75-4db3-a5e6-9c2d00edd8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.708653 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de88cc-6f75-4db3-a5e6-9c2d00edd8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.708984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de88cc-6f75-4db3-a5e6-9c2d00edd8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.709683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de88cc-6f75-4db3-a5e6-9c2d00edd8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:46.711694 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de88cc-6f75-4db3-a5e6-9c2d00edd8c9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:46.717978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 776/1561] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:46 2022] PUT /identity/v3/projects/1e0768fb27024185a6653cc26b0447c2/users/81c6d25afc4b484e891769c7bd583819/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:46.720414 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67770819-590b-4fbf-a10c-37d5f60ad924 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.721055 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67770819-590b-4fbf-a10c-37d5f60ad924 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.721745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67770819-590b-4fbf-a10c-37d5f60ad924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.749898 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-67770819-590b-4fbf-a10c-37d5f60ad924 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:46.751797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-67770819-590b-4fbf-a10c-37d5f60ad924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:46.762220 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 786/1562] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:26:46 2022] POST /identity/v3/users => generated 284 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:46.764557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf6a4e-8440-4a26-b20d-33a01528bf9a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.764956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf6a4e-8440-4a26-b20d-33a01528bf9a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.765702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf6a4e-8440-4a26-b20d-33a01528bf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.787183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9acf6a4e-8440-4a26-b20d-33a01528bf9a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:46.788480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9acf6a4e-8440-4a26-b20d-33a01528bf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:46.842118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 777/1563] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:46.843183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67770819-590b-4fbf-a10c-37d5f60ad924 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:46.853555 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67770819-590b-4fbf-a10c-37d5f60ad924 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:46.858516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7953590-1913-4c05-8363-d4621222a9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:46.859232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7953590-1913-4c05-8363-d4621222a9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.859527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7953590-1913-4c05-8363-d4621222a9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.859804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7953590-1913-4c05-8363-d4621222a9b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.860575 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 787/1564] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:46.860775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7953590-1913-4c05-8363-d4621222a9b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:26:46.861105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7953590-1913-4c05-8363-d4621222a9b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:46.861522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf6a4e-8440-4a26-b20d-33a01528bf9a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:46.862640 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7953590-1913-4c05-8363-d4621222a9b7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:46.873592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf6a4e-8440-4a26-b20d-33a01528bf9a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:46.878033 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 778/1565] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:26:46.880775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f23818-eeed-4c88-b744-028e5979e43b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.880954 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f2a6b-92ce-4835-89d4-f77fb74c9337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:46.881072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f23818-eeed-4c88-b744-028e5979e43b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.881343 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f23818-eeed-4c88-b744-028e5979e43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.882450 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f2a6b-92ce-4835-89d4-f77fb74c9337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.882958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f2a6b-92ce-4835-89d4-f77fb74c9337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.883442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f2a6b-92ce-4835-89d4-f77fb74c9337 admin admin] PATH_INFO: `/v3/projects/3f6c0cd4036744a1b53faf790f6b9ed4/users/212edf0d95bd48b8a3d26a47ccf25f01/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.905629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f2a6b-92ce-4835-89d4-f77fb74c9337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6c0cd4036744a1b53faf790f6b9ed4, user_id=212edf0d95bd48b8a3d26a47ccf25f01, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:46.908121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-88f23818-eeed-4c88-b744-028e5979e43b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:46.908449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f2a6b-92ce-4835-89d4-f77fb74c9337 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:46.909409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-88f23818-eeed-4c88-b744-028e5979e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:46.921475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 779/1566] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:46.921475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeca9c4-274e-4c07-bffe-8dda74155db1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.921475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeca9c4-274e-4c07-bffe-8dda74155db1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.921475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeca9c4-274e-4c07-bffe-8dda74155db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.936259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 788/1567] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:46 2022] PUT /identity/v3/projects/3f6c0cd4036744a1b53faf790f6b9ed4/users/212edf0d95bd48b8a3d26a47ccf25f01/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:46.936259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7375b4-818c-435a-b524-d78f5a6fbd9b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:46.936259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7375b4-818c-435a-b524-d78f5a6fbd9b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:46.936259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7375b4-818c-435a-b524-d78f5a6fbd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:46.954646 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2aeca9c4-274e-4c07-bffe-8dda74155db1 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:46.956592 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2aeca9c4-274e-4c07-bffe-8dda74155db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:46.965744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fe7375b4-818c-435a-b524-d78f5a6fbd9b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:46.967673 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fe7375b4-818c-435a-b524-d78f5a6fbd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:47.040649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 780/1568] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:47.041854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeca9c4-274e-4c07-bffe-8dda74155db1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.057350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 789/1569] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:47.057350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d061b-acd5-4ed9-a1e2-2494410cc1ee None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.057350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d061b-acd5-4ed9-a1e2-2494410cc1ee None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.057350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d061b-acd5-4ed9-a1e2-2494410cc1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.064775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeca9c4-274e-4c07-bffe-8dda74155db1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.072361 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f867b-5781-4f45-948f-5be6ab6e4952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.073381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f867b-5781-4f45-948f-5be6ab6e4952 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.073777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f867b-5781-4f45-948f-5be6ab6e4952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.074154 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f867b-5781-4f45-948f-5be6ab6e4952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.075285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f867b-5781-4f45-948f-5be6ab6e4952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.077254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0e6d061b-acd5-4ed9-a1e2-2494410cc1ee None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:47.078221 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f867b-5781-4f45-948f-5be6ab6e4952 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.079676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0e6d061b-acd5-4ed9-a1e2-2494410cc1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:47.092724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 790/1570] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:47.094357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d06f5-fb09-42a3-b723-9307bca539ca None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.094765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d06f5-fb09-42a3-b723-9307bca539ca None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.095176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d06f5-fb09-42a3-b723-9307bca539ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.101573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 781/1571] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:47.101573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f867b-5781-4f45-948f-5be6ab6e4952 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.105491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:47.110282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f867b-5781-4f45-948f-5be6ab6e4952 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.116950 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dab52-7e11-456c-8cd8-2e435f19fea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.117638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dab52-7e11-456c-8cd8-2e435f19fea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.117912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dab52-7e11-456c-8cd8-2e435f19fea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.118178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dab52-7e11-456c-8cd8-2e435f19fea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.118887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dab52-7e11-456c-8cd8-2e435f19fea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.120947 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dab52-7e11-456c-8cd8-2e435f19fea8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.129016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5f2d06f5-fb09-42a3-b723-9307bca539ca None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:47.131341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5f2d06f5-fb09-42a3-b723-9307bca539ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:47.151761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 791/1572] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:47.153203 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d06f5-fb09-42a3-b723-9307bca539ca None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.161739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 782/1573] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:26:47 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:47.163679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1235e-aa76-4f37-a9f2-ad7b735c00c9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.164329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1235e-aa76-4f37-a9f2-ad7b735c00c9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.164738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1235e-aa76-4f37-a9f2-ad7b735c00c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.172780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d06f5-fb09-42a3-b723-9307bca539ca None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.182705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:47.184334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-32f1235e-aa76-4f37-a9f2-ad7b735c00c9 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:47.185859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-32f1235e-aa76-4f37-a9f2-ad7b735c00c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:47.264999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca04be-5834-4fdf-9674-516ae9fa6b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.266231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca04be-5834-4fdf-9674-516ae9fa6b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.266541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca04be-5834-4fdf-9674-516ae9fa6b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.266789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca04be-5834-4fdf-9674-516ae9fa6b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.267552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca04be-5834-4fdf-9674-516ae9fa6b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:26:47.267884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca04be-5834-4fdf-9674-516ae9fa6b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.269286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 783/1574] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:47.270568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca04be-5834-4fdf-9674-516ae9fa6b03 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.270847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364753a-058f-4573-b55d-70b09183d77b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.271142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364753a-058f-4573-b55d-70b09183d77b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.271503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364753a-058f-4573-b55d-70b09183d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.298629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 792/1575] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:26:47.298629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca04be-5834-4fdf-9674-516ae9fa6b03 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.299340 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5364753a-058f-4573-b55d-70b09183d77b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:47.299340 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5364753a-058f-4573-b55d-70b09183d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:47.311804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 784/1576] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:47.312801 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364753a-058f-4573-b55d-70b09183d77b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.326540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364753a-058f-4573-b55d-70b09183d77b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.332092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6256e-1707-4504-a082-4483acba2b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.332824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6256e-1707-4504-a082-4483acba2b77 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.333107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6256e-1707-4504-a082-4483acba2b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.333380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6256e-1707-4504-a082-4483acba2b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.334213 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6256e-1707-4504-a082-4483acba2b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:26:47.334518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6256e-1707-4504-a082-4483acba2b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.336996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6256e-1707-4504-a082-4483acba2b77 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.350215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 785/1577] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:26:47.351027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6256e-1707-4504-a082-4483acba2b77 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.367995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6256e-1707-4504-a082-4483acba2b77 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.374125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafea747-0c23-4cfc-a8f2-859b5818a18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.374856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafea747-0c23-4cfc-a8f2-859b5818a18b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.375142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafea747-0c23-4cfc-a8f2-859b5818a18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.375423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafea747-0c23-4cfc-a8f2-859b5818a18b admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.376176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafea747-0c23-4cfc-a8f2-859b5818a18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.377877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafea747-0c23-4cfc-a8f2-859b5818a18b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.383099 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca04be-5834-4fdf-9674-516ae9fa6b03 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.387316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab06d24-43f7-46fe-a425-02cbdb4f253d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.388067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab06d24-43f7-46fe-a425-02cbdb4f253d service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.388351 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab06d24-43f7-46fe-a425-02cbdb4f253d service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.388662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab06d24-43f7-46fe-a425-02cbdb4f253d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.391120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 786/1578] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:47.392006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafea747-0c23-4cfc-a8f2-859b5818a18b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.399892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab06d24-43f7-46fe-a425-02cbdb4f253d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.401463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab06d24-43f7-46fe-a425-02cbdb4f253d service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.402667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafea747-0c23-4cfc-a8f2-859b5818a18b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.407535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83a9b4-72a8-43fb-ae2f-e2be9b27ccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.408234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83a9b4-72a8-43fb-ae2f-e2be9b27ccaa admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.408540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83a9b4-72a8-43fb-ae2f-e2be9b27ccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.408835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83a9b4-72a8-43fb-ae2f-e2be9b27ccaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.409561 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83a9b4-72a8-43fb-ae2f-e2be9b27ccaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:26:47.409869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83a9b4-72a8-43fb-ae2f-e2be9b27ccaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.411544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83a9b4-72a8-43fb-ae2f-e2be9b27ccaa admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.413969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 793/1579] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:47.414900 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab06d24-43f7-46fe-a425-02cbdb4f253d service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.433530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 787/1580] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:26:47.433530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83a9b4-72a8-43fb-ae2f-e2be9b27ccaa admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.433876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab06d24-43f7-46fe-a425-02cbdb4f253d service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.433876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9cfd5-d94c-4c97-98a1-caca6181f67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.433876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9cfd5-d94c-4c97-98a1-caca6181f67b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.433876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9cfd5-d94c-4c97-98a1-caca6181f67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.434256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9cfd5-d94c-4c97-98a1-caca6181f67b admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.434864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9cfd5-d94c-4c97-98a1-caca6181f67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.436712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9cfd5-d94c-4c97-98a1-caca6181f67b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.440842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83a9b4-72a8-43fb-ae2f-e2be9b27ccaa admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.445460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46ec6d-b160-49f7-bb29-a07aa199bb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.446226 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46ec6d-b160-49f7-bb29-a07aa199bb81 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.446558 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46ec6d-b160-49f7-bb29-a07aa199bb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.446901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46ec6d-b160-49f7-bb29-a07aa199bb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.462846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 794/1581] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:26:47 2022] POST /identity/v3/users => generated 285 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:47.463957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9cfd5-d94c-4c97-98a1-caca6181f67b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.471408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46ec6d-b160-49f7-bb29-a07aa199bb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.476065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46ec6d-b160-49f7-bb29-a07aa199bb81 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.477219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9cfd5-d94c-4c97-98a1-caca6181f67b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.482471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87442b-a27f-422a-8749-a4855bd9ecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.483221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87442b-a27f-422a-8749-a4855bd9ecd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.483509 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87442b-a27f-422a-8749-a4855bd9ecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.483784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87442b-a27f-422a-8749-a4855bd9ecd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.484565 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87442b-a27f-422a-8749-a4855bd9ecd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.486745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87442b-a27f-422a-8749-a4855bd9ecd6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.502529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 788/1582] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:47.504579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46ec6d-b160-49f7-bb29-a07aa199bb81 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.526070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46ec6d-b160-49f7-bb29-a07aa199bb81 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.526697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 795/1583] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:26:47 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:47.528242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87442b-a27f-422a-8749-a4855bd9ecd6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.656194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04ac9f-3439-453c-9fa3-3c75ee743ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.657887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04ac9f-3439-453c-9fa3-3c75ee743ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.658497 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04ac9f-3439-453c-9fa3-3c75ee743ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.659819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04ac9f-3439-453c-9fa3-3c75ee743ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.662062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04ac9f-3439-453c-9fa3-3c75ee743ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:26:47.662727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04ac9f-3439-453c-9fa3-3c75ee743ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.667280 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04ac9f-3439-453c-9fa3-3c75ee743ea1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.682746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87442b-a27f-422a-8749-a4855bd9ecd6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.690988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2ea35-ad99-465a-9732-0b99118267e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.692148 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2ea35-ad99-465a-9732-0b99118267e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.692937 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2ea35-ad99-465a-9732-0b99118267e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.693246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2ea35-ad99-465a-9732-0b99118267e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.694308 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2ea35-ad99-465a-9732-0b99118267e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.704917 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 789/1584] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:26:47.705272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2ea35-ad99-465a-9732-0b99118267e5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.705453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04ac9f-3439-453c-9fa3-3c75ee743ea1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.722196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04ac9f-3439-453c-9fa3-3c75ee743ea1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.723241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:47.728652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35372665-c086-4be8-8f4c-50cf1269f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.729601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35372665-c086-4be8-8f4c-50cf1269f49d admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.729904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35372665-c086-4be8-8f4c-50cf1269f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.730283 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35372665-c086-4be8-8f4c-50cf1269f49d admin admin] PATH_INFO: `/v3/projects/eb1fff1cd8524c75b5e6a3c9c8ba3d64/users/2d8859c630df46319f31cb910a870bd3/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.749856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 796/1585] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:26:47 2022] POST /identity/v3/projects => generated 389 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:47.750616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35372665-c086-4be8-8f4c-50cf1269f49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1fff1cd8524c75b5e6a3c9c8ba3d64, user_id=2d8859c630df46319f31cb910a870bd3, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.751237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2ea35-ad99-465a-9732-0b99118267e5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.757411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35372665-c086-4be8-8f4c-50cf1269f49d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.762843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:47.780122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 790/1586] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:47 2022] PUT /identity/v3/projects/eb1fff1cd8524c75b5e6a3c9c8ba3d64/users/2d8859c630df46319f31cb910a870bd3/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:47.781900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35372665-c086-4be8-8f4c-50cf1269f49d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.860408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35372665-c086-4be8-8f4c-50cf1269f49d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.861400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2ea35-ad99-465a-9732-0b99118267e5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.870258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812844b-744f-4f57-be80-456a4ed1bef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.871100 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812844b-744f-4f57-be80-456a4ed1bef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.871457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812844b-744f-4f57-be80-456a4ed1bef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.871803 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812844b-744f-4f57-be80-456a4ed1bef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.872021 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01160053-ab4d-44e8-a035-853929b3f866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.872855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812844b-744f-4f57-be80-456a4ed1bef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.873137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01160053-ab4d-44e8-a035-853929b3f866 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.873616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01160053-ab4d-44e8-a035-853929b3f866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.873961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01160053-ab4d-44e8-a035-853929b3f866 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.874753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01160053-ab4d-44e8-a035-853929b3f866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.874887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812844b-744f-4f57-be80-456a4ed1bef2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.876988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01160053-ab4d-44e8-a035-853929b3f866 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.894196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 791/1587] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:47.895502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812844b-744f-4f57-be80-456a4ed1bef2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.906761 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812844b-744f-4f57-be80-456a4ed1bef2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:47.913948 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada985cb-7d89-41de-a502-1e6582ff7f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:47.914579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada985cb-7d89-41de-a502-1e6582ff7f13 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:47.914916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada985cb-7d89-41de-a502-1e6582ff7f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:47.915198 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada985cb-7d89-41de-a502-1e6582ff7f13 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:47.915957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada985cb-7d89-41de-a502-1e6582ff7f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:47.918028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada985cb-7d89-41de-a502-1e6582ff7f13 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:47.921273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 797/1588] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:26:47 2022] POST /identity/v3/projects => generated 403 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:47.922433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01160053-ab4d-44e8-a035-853929b3f866 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.944170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 792/1589] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:26:47 2022] POST /identity/v3/users => generated 288 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:47.945066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada985cb-7d89-41de-a502-1e6582ff7f13 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:47.958867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada985cb-7d89-41de-a502-1e6582ff7f13 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.037241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01160053-ab4d-44e8-a035-853929b3f866 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.042736 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e1a0b-bcc9-495f-a55c-0f4312b6a19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.043624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e1a0b-bcc9-495f-a55c-0f4312b6a19d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.043954 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e1a0b-bcc9-495f-a55c-0f4312b6a19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.044235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e1a0b-bcc9-495f-a55c-0f4312b6a19d admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.045087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e1a0b-bcc9-495f-a55c-0f4312b6a19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.047145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e1a0b-bcc9-495f-a55c-0f4312b6a19d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.055904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eb57f-526b-436e-9682-7e8dfe7ece26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.056658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb57f-526b-436e-9682-7e8dfe7ece26 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.056945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb57f-526b-436e-9682-7e8dfe7ece26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.057371 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb57f-526b-436e-9682-7e8dfe7ece26 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.058080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eb57f-526b-436e-9682-7e8dfe7ece26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.060084 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eb57f-526b-436e-9682-7e8dfe7ece26 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.097422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 793/1590] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:26:47 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:48.097669 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 798/1591] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:26:47 2022] POST /identity/v3/projects => generated 403 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:48.097767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c69745-72fd-4cb7-992c-da41c001cb38 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.097767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c69745-72fd-4cb7-992c-da41c001cb38 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.097767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c69745-72fd-4cb7-992c-da41c001cb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.098031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e1a0b-bcc9-495f-a55c-0f4312b6a19d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.139169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-50c69745-72fd-4cb7-992c-da41c001cb38 None None] MFA Rules not processed for user `2d8859c630df46319f31cb910a870bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:48.141319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-50c69745-72fd-4cb7-992c-da41c001cb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:48.225612 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:48.249977 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 794/1592] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:48.255947 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c69745-72fd-4cb7-992c-da41c001cb38 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.270436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e1a0b-bcc9-495f-a55c-0f4312b6a19d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.271865 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c69745-72fd-4cb7-992c-da41c001cb38 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.277706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9049d-74ac-47f1-a9ff-12ec4e9166ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.278991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9049d-74ac-47f1-a9ff-12ec4e9166ad admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.278991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9049d-74ac-47f1-a9ff-12ec4e9166ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.279441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9049d-74ac-47f1-a9ff-12ec4e9166ad admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.280216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9049d-74ac-47f1-a9ff-12ec4e9166ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.282515 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9049d-74ac-47f1-a9ff-12ec4e9166ad admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.285119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f40e4-5059-4bed-8019-b4162fc7e9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.286035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f40e4-5059-4bed-8019-b4162fc7e9be admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.286615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f40e4-5059-4bed-8019-b4162fc7e9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.287311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f40e4-5059-4bed-8019-b4162fc7e9be admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.289085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f40e4-5059-4bed-8019-b4162fc7e9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.293915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f40e4-5059-4bed-8019-b4162fc7e9be admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.307462 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:48.311386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 795/1593] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:26:48 2022] POST /identity/v3/users => generated 302 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:48.312412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9049d-74ac-47f1-a9ff-12ec4e9166ad admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.329785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9049d-74ac-47f1-a9ff-12ec4e9166ad admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.332600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 799/1594] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:48.335235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f40e4-5059-4bed-8019-b4162fc7e9be admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.337054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dfff5-585d-44a8-afa4-8d2fa219b99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.337867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dfff5-585d-44a8-afa4-8d2fa219b99d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.339519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dfff5-585d-44a8-afa4-8d2fa219b99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.339889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dfff5-585d-44a8-afa4-8d2fa219b99d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.341468 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dfff5-585d-44a8-afa4-8d2fa219b99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.349240 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dfff5-585d-44a8-afa4-8d2fa219b99d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.358917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f40e4-5059-4bed-8019-b4162fc7e9be admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.369110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e9633-5eb4-464a-bf0c-f3168333223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.370470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e9633-5eb4-464a-bf0c-f3168333223d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.371011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e9633-5eb4-464a-bf0c-f3168333223d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.371497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e9633-5eb4-464a-bf0c-f3168333223d admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.373600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e9633-5eb4-464a-bf0c-f3168333223d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.377086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 796/1595] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:48.377313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e9633-5eb4-464a-bf0c-f3168333223d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.378411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dfff5-585d-44a8-afa4-8d2fa219b99d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.392423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dfff5-585d-44a8-afa4-8d2fa219b99d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.398236 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e30f0-61cc-4639-85a2-10d451e1e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.399304 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e30f0-61cc-4639-85a2-10d451e1e31a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.399732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e30f0-61cc-4639-85a2-10d451e1e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.400183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e30f0-61cc-4639-85a2-10d451e1e31a admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.402053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e30f0-61cc-4639-85a2-10d451e1e31a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.402239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 800/1596] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:48.404350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e9633-5eb4-464a-bf0c-f3168333223d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.404983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e30f0-61cc-4639-85a2-10d451e1e31a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.459153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 797/1597] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:26:48 2022] POST /identity/v3/users => generated 302 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:48.459153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e30f0-61cc-4639-85a2-10d451e1e31a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.488465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e30f0-61cc-4639-85a2-10d451e1e31a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.503004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8549c30-0f63-4140-b37a-3bd24331287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.506944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8549c30-0f63-4140-b37a-3bd24331287b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.507606 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8549c30-0f63-4140-b37a-3bd24331287b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.508804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8549c30-0f63-4140-b37a-3bd24331287b admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.509899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8549c30-0f63-4140-b37a-3bd24331287b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.516229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8549c30-0f63-4140-b37a-3bd24331287b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.525594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e9633-5eb4-464a-bf0c-f3168333223d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.539142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d77f6-0b6b-4a5b-9de6-769e9ec7c302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.540262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d77f6-0b6b-4a5b-9de6-769e9ec7c302 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.541187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d77f6-0b6b-4a5b-9de6-769e9ec7c302 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.541659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d77f6-0b6b-4a5b-9de6-769e9ec7c302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.555787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 798/1598] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:48.555787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8549c30-0f63-4140-b37a-3bd24331287b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.576375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d77f6-0b6b-4a5b-9de6-769e9ec7c302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.579933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d77f6-0b6b-4a5b-9de6-769e9ec7c302 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.586961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8549c30-0f63-4140-b37a-3bd24331287b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.598875 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9419ee-60d6-4c1f-b54c-7d410658265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.599841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9419ee-60d6-4c1f-b54c-7d410658265c admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.600147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9419ee-60d6-4c1f-b54c-7d410658265c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.600437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9419ee-60d6-4c1f-b54c-7d410658265c admin admin] PATH_INFO: `/v3/projects/04b7af8c43f643588e4db69a9521d16a/users/acd28292452d4926af99237bcd0abc7d/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.605893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 801/1599] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:48.606924 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d77f6-0b6b-4a5b-9de6-769e9ec7c302 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.624253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9419ee-60d6-4c1f-b54c-7d410658265c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b7af8c43f643588e4db69a9521d16a, user_id=acd28292452d4926af99237bcd0abc7d, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.627440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9419ee-60d6-4c1f-b54c-7d410658265c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.633868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d77f6-0b6b-4a5b-9de6-769e9ec7c302 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.647047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b6da5-e3ee-414d-8465-1f6eb8916f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.648920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b6da5-e3ee-414d-8465-1f6eb8916f2e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.648920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b6da5-e3ee-414d-8465-1f6eb8916f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.648920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b6da5-e3ee-414d-8465-1f6eb8916f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.649365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b6da5-e3ee-414d-8465-1f6eb8916f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.653817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 799/1600] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:48 2022] PUT /identity/v3/projects/04b7af8c43f643588e4db69a9521d16a/users/acd28292452d4926af99237bcd0abc7d/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:48.658321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9419ee-60d6-4c1f-b54c-7d410658265c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.658629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b6da5-e3ee-414d-8465-1f6eb8916f2e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.735104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 802/1601] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:48.742014 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b6da5-e3ee-414d-8465-1f6eb8916f2e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.771051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b6da5-e3ee-414d-8465-1f6eb8916f2e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.848990 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9419ee-60d6-4c1f-b54c-7d410658265c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.857321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1e913-ed07-4b54-b4ef-79c60077aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.858374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1e913-ed07-4b54-b4ef-79c60077aa4e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.858754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1e913-ed07-4b54-b4ef-79c60077aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.861457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1e913-ed07-4b54-b4ef-79c60077aa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.865579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1e913-ed07-4b54-b4ef-79c60077aa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.868162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1e913-ed07-4b54-b4ef-79c60077aa4e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.902179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 800/1602] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:48.902179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1e913-ed07-4b54-b4ef-79c60077aa4e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.928416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1e913-ed07-4b54-b4ef-79c60077aa4e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:48.933458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e75f8-7b25-4fc0-9399-c9caa7ea9090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.934177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e75f8-7b25-4fc0-9399-c9caa7ea9090 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.934465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e75f8-7b25-4fc0-9399-c9caa7ea9090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.934737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e75f8-7b25-4fc0-9399-c9caa7ea9090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.939675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74417c4-6fd2-4f41-9b54-c5dbd9e94403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:48.939943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e75f8-7b25-4fc0-9399-c9caa7ea9090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.942197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74417c4-6fd2-4f41-9b54-c5dbd9e94403 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.942491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74417c4-6fd2-4f41-9b54-c5dbd9e94403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.943687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e75f8-7b25-4fc0-9399-c9caa7ea9090 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.943882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74417c4-6fd2-4f41-9b54-c5dbd9e94403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.945841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74417c4-6fd2-4f41-9b54-c5dbd9e94403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:48.949041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74417c4-6fd2-4f41-9b54-c5dbd9e94403 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:48.964281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 803/1603] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:48.965629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd05e5-38d1-43e1-b539-78d58ebc4f38 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:48.966075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd05e5-38d1-43e1-b539-78d58ebc4f38 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:48.966356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd05e5-38d1-43e1-b539-78d58ebc4f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:48.978199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 801/1604] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:48.978199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74417c4-6fd2-4f41-9b54-c5dbd9e94403 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:48.994706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74417c4-6fd2-4f41-9b54-c5dbd9e94403 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:49.002632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd9478-40d8-44bd-9374-41f57b3f281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:49.003515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-32bd05e5-38d1-43e1-b539-78d58ebc4f38 None None] MFA Rules not processed for user `acd28292452d4926af99237bcd0abc7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:49.003907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd9478-40d8-44bd-9374-41f57b3f281d admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:49.004287 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd9478-40d8-44bd-9374-41f57b3f281d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:49.004718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd9478-40d8-44bd-9374-41f57b3f281d admin admin] PATH_INFO: `/v3/projects/43adc7d982d04ccc897b8aad1c5c9793/users/402c84b80e4b4996af901e79bf82c4b1/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:49.004858 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-32bd05e5-38d1-43e1-b539-78d58ebc4f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:49.030826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd9478-40d8-44bd-9374-41f57b3f281d admin admin] RBAC: Authorizing `identity:create_grant(project_id=43adc7d982d04ccc897b8aad1c5c9793, user_id=402c84b80e4b4996af901e79bf82c4b1, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:49.033611 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd9478-40d8-44bd-9374-41f57b3f281d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:49.060298 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 802/1605] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:48 2022] PUT /identity/v3/projects/43adc7d982d04ccc897b8aad1c5c9793/users/402c84b80e4b4996af901e79bf82c4b1/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:49.062213 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd9478-40d8-44bd-9374-41f57b3f281d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:49.169142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:49.259186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 804/1606] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:49.260899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd05e5-38d1-43e1-b539-78d58ebc4f38 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:49.315208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd05e5-38d1-43e1-b539-78d58ebc4f38 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:49.331897 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8429b6e-37af-434f-81cd-ea28c8499878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:49.332772 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8429b6e-37af-434f-81cd-ea28c8499878 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:49.333145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8429b6e-37af-434f-81cd-ea28c8499878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:49.333486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8429b6e-37af-434f-81cd-ea28c8499878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:49.334997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8429b6e-37af-434f-81cd-ea28c8499878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:49.338430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8429b6e-37af-434f-81cd-ea28c8499878 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:49.343879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:49.364090 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd9478-40d8-44bd-9374-41f57b3f281d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:49.372627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 805/1607] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:49.377912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8429b6e-37af-434f-81cd-ea28c8499878 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:49.392351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2848f-eefe-4e4b-8cdd-ab51604e032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:49.396160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2848f-eefe-4e4b-8cdd-ab51604e032a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:49.409609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8429b6e-37af-434f-81cd-ea28c8499878 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:49.413155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2848f-eefe-4e4b-8cdd-ab51604e032a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:49.413828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2848f-eefe-4e4b-8cdd-ab51604e032a admin admin] PATH_INFO: `/v3/projects/2fb84544e44d44308b3165b73df65646/users/2fc696f590374358aee6e70563219321/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:49.428012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d1d1e-0568-43a2-aad2-f5fa1dadc67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:49.429899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d1d1e-0568-43a2-aad2-f5fa1dadc67b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:49.430313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d1d1e-0568-43a2-aad2-f5fa1dadc67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:49.430674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d1d1e-0568-43a2-aad2-f5fa1dadc67b admin admin] PATH_INFO: `/v3/projects/950876676b0f41818163c93b2e17b825/users/b5361788e2984e9d825e410df86c2fc2/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:49.471636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d1d1e-0568-43a2-aad2-f5fa1dadc67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=950876676b0f41818163c93b2e17b825, user_id=b5361788e2984e9d825e410df86c2fc2, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:49.474621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d1d1e-0568-43a2-aad2-f5fa1dadc67b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:49.506857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 806/1608] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:49 2022] PUT /identity/v3/projects/950876676b0f41818163c93b2e17b825/users/b5361788e2984e9d825e410df86c2fc2/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:49.509784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b59cd3-4e96-438f-94e1-3bef493bdd81 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:49.511850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b59cd3-4e96-438f-94e1-3bef493bdd81 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:49.512576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b59cd3-4e96-438f-94e1-3bef493bdd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:49.516133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2848f-eefe-4e4b-8cdd-ab51604e032a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb84544e44d44308b3165b73df65646, user_id=2fc696f590374358aee6e70563219321, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:49.521422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2848f-eefe-4e4b-8cdd-ab51604e032a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:49.552749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 803/1609] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:49 2022] PUT /identity/v3/projects/2fb84544e44d44308b3165b73df65646/users/2fc696f590374358aee6e70563219321/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:49.552749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2848f-eefe-4e4b-8cdd-ab51604e032a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:49.560927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-66b59cd3-4e96-438f-94e1-3bef493bdd81 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:49.562800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-66b59cd3-4e96-438f-94e1-3bef493bdd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:49.661709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2848f-eefe-4e4b-8cdd-ab51604e032a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:49.672823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c985ce-1095-44df-ab86-015d208f8f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:49.674640 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c985ce-1095-44df-ab86-015d208f8f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:49.675297 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c985ce-1095-44df-ab86-015d208f8f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:49.675892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c985ce-1095-44df-ab86-015d208f8f42 admin admin] PATH_INFO: `/v3/projects/ddb265757a924e6684466c5c8000bd27/users/510fd864e4884836862df0d572af6bf9/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:49.760023 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 807/1610] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:49.764070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c985ce-1095-44df-ab86-015d208f8f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb265757a924e6684466c5c8000bd27, user_id=510fd864e4884836862df0d572af6bf9, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:49.776220 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937fb54-f085-43bf-92de-2ee1990f792a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:49.777339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937fb54-f085-43bf-92de-2ee1990f792a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:49.778155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937fb54-f085-43bf-92de-2ee1990f792a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:49.785667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c985ce-1095-44df-ab86-015d208f8f42 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:49.786376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 808/1611] 10.222.0.40 () {54 vars in 962 bytes} [Thu Jul 21 08:26:49 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:26:49.792757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7eace-fa0a-4158-b06f-c07389d76d64 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:49.793773 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7eace-fa0a-4158-b06f-c07389d76d64 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:49.796993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7eace-fa0a-4158-b06f-c07389d76d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:49.823339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 804/1612] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:49 2022] PUT /identity/v3/projects/ddb265757a924e6684466c5c8000bd27/users/510fd864e4884836862df0d572af6bf9/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:49.832225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08da201-f283-400a-836e-bfcf75410aa0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:49.832569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08da201-f283-400a-836e-bfcf75410aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:49.832828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08da201-f283-400a-836e-bfcf75410aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:49.874134 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-71d7eace-fa0a-4158-b06f-c07389d76d64 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:49.876130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-71d7eace-fa0a-4158-b06f-c07389d76d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:49.884913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c08da201-f283-400a-836e-bfcf75410aa0 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:49.886323 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c08da201-f283-400a-836e-bfcf75410aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:50.040389 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 805/1613] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:50.046503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68631b6-21fb-4176-8783-59540a50f535 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:50.046794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68631b6-21fb-4176-8783-59540a50f535 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:50.047079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68631b6-21fb-4176-8783-59540a50f535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:50.121821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 809/1614] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:50.121821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77becb52-eeea-4b2b-a51f-6f278e3f457b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:50.122290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77becb52-eeea-4b2b-a51f-6f278e3f457b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:50.122889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77becb52-eeea-4b2b-a51f-6f278e3f457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:50.151615 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b68631b6-21fb-4176-8783-59540a50f535 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:50.152754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b68631b6-21fb-4176-8783-59540a50f535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:50.200982 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:50.208092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-77becb52-eeea-4b2b-a51f-6f278e3f457b None None] MFA Rules not processed for user `510fd864e4884836862df0d572af6bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:50.209841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-77becb52-eeea-4b2b-a51f-6f278e3f457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:50.322400 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 806/1615] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Jul 21 08:26:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:50.323459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68631b6-21fb-4176-8783-59540a50f535 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:50.346160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 810/1616] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:50.347309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77becb52-eeea-4b2b-a51f-6f278e3f457b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:50.358322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:50.456862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68631b6-21fb-4176-8783-59540a50f535 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:50.467489 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77becb52-eeea-4b2b-a51f-6f278e3f457b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:50.473643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b625320-a217-4589-b5f7-b013e962d348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:50.474413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b625320-a217-4589-b5f7-b013e962d348 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:50.474690 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b625320-a217-4589-b5f7-b013e962d348 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:50.474963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b625320-a217-4589-b5f7-b013e962d348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:50.475491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c28d1-b753-40e2-8076-9488dbcc92d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:50.476811 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c28d1-b753-40e2-8076-9488dbcc92d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:50.477393 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c28d1-b753-40e2-8076-9488dbcc92d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:50.477932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c28d1-b753-40e2-8076-9488dbcc92d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:50.496706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b625320-a217-4589-b5f7-b013e962d348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:50.497692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c28d1-b753-40e2-8076-9488dbcc92d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:50.498213 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b625320-a217-4589-b5f7-b013e962d348 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:50.500398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c28d1-b753-40e2-8076-9488dbcc92d7 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:50.517202 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 807/1617] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:50.517928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b625320-a217-4589-b5f7-b013e962d348 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:50.522391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 811/1618] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:50.523835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c28d1-b753-40e2-8076-9488dbcc92d7 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:50.541906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b625320-a217-4589-b5f7-b013e962d348 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:50.543943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c28d1-b753-40e2-8076-9488dbcc92d7 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:50.545965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc18c9-5b4b-450a-95f2-69573eaf9ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:50.546642 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc18c9-5b4b-450a-95f2-69573eaf9ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:50.546926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc18c9-5b4b-450a-95f2-69573eaf9ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:50.547196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc18c9-5b4b-450a-95f2-69573eaf9ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:50.555187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c116efc-8362-4e0e-aa5e-840c85e4ccae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:50.556250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c116efc-8362-4e0e-aa5e-840c85e4ccae service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:50.556878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c116efc-8362-4e0e-aa5e-840c85e4ccae service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:50.557395 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c116efc-8362-4e0e-aa5e-840c85e4ccae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:50.575036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc18c9-5b4b-450a-95f2-69573eaf9ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:50.576549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc18c9-5b4b-450a-95f2-69573eaf9ce5 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:50.596339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 808/1619] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:50.599347 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc18c9-5b4b-450a-95f2-69573eaf9ce5 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:50.615482 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc18c9-5b4b-450a-95f2-69573eaf9ce5 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:50.632177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb433098-4494-4d79-8229-71ee05dbd219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:50.632941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb433098-4494-4d79-8229-71ee05dbd219 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:50.633218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb433098-4494-4d79-8229-71ee05dbd219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:50.633487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb433098-4494-4d79-8229-71ee05dbd219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:50.634206 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb433098-4494-4d79-8229-71ee05dbd219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:50.636204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb433098-4494-4d79-8229-71ee05dbd219 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:50.655698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c116efc-8362-4e0e-aa5e-840c85e4ccae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:50.658565 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c116efc-8362-4e0e-aa5e-840c85e4ccae service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:50.672303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 812/1620] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:50.709466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 809/1621] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:26:50 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:50.712972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c116efc-8362-4e0e-aa5e-840c85e4ccae service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:50.729166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c116efc-8362-4e0e-aa5e-840c85e4ccae service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:50.820742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae8db9-f701-4e37-b3a5-d10a3f4cd5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:50.822225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae8db9-f701-4e37-b3a5-d10a3f4cd5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:50.823683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae8db9-f701-4e37-b3a5-d10a3f4cd5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:50.824135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae8db9-f701-4e37-b3a5-d10a3f4cd5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:50.825375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae8db9-f701-4e37-b3a5-d10a3f4cd5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:50.829749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae8db9-f701-4e37-b3a5-d10a3f4cd5f0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:50.862057 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 813/1622] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:26:50 2022] POST /identity/v3/users => generated 308 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:50.867008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb433098-4494-4d79-8229-71ee05dbd219 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:50.888783 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb433098-4494-4d79-8229-71ee05dbd219 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:50.901429 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa26ae-ffa7-4839-a7f3-d3e99725b01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:50.904218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa26ae-ffa7-4839-a7f3-d3e99725b01d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:50.905528 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa26ae-ffa7-4839-a7f3-d3e99725b01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:50.906017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa26ae-ffa7-4839-a7f3-d3e99725b01d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:50.908993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa26ae-ffa7-4839-a7f3-d3e99725b01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:50.912010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa26ae-ffa7-4839-a7f3-d3e99725b01d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:50.948379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 810/1623] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:26:50.957487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae8db9-f701-4e37-b3a5-d10a3f4cd5f0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:50.973972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae8db9-f701-4e37-b3a5-d10a3f4cd5f0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:50.996390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefe095-85cb-4b21-8462-d3006e00e436 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:50.997083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefe095-85cb-4b21-8462-d3006e00e436 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:50.997570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefe095-85cb-4b21-8462-d3006e00e436 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:50.998868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613af815-97dc-43cd-9cf1-9f815da014db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:50.999935 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 811/1624] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jul 21 08:26:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:26:51.003295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613af815-97dc-43cd-9cf1-9f815da014db admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:51.003626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613af815-97dc-43cd-9cf1-9f815da014db admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:51.006942 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc334d9d-e501-4f8e-a997-b7b788ed0fb9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:51.007257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613af815-97dc-43cd-9cf1-9f815da014db admin admin] PATH_INFO: `/v3/projects/9a0d9a1a6afd4276ad9de0072727c258/users/bfd3734a498d49dd9818d733f6c92128/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:51.007823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc334d9d-e501-4f8e-a997-b7b788ed0fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:51.008316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc334d9d-e501-4f8e-a997-b7b788ed0fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:51.031643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dc334d9d-e501-4f8e-a997-b7b788ed0fb9 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:51.033684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dc334d9d-e501-4f8e-a997-b7b788ed0fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:51.038866 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613af815-97dc-43cd-9cf1-9f815da014db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0d9a1a6afd4276ad9de0072727c258, user_id=bfd3734a498d49dd9818d733f6c92128, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:51.042368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613af815-97dc-43cd-9cf1-9f815da014db admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:51.066593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 814/1625] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:50 2022] PUT /identity/v3/projects/9a0d9a1a6afd4276ad9de0072727c258/users/bfd3734a498d49dd9818d733f6c92128/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:51.072515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613af815-97dc-43cd-9cf1-9f815da014db admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:51.087118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:51.209350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613af815-97dc-43cd-9cf1-9f815da014db admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:51.219143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ecfdc-7d34-44c8-9410-0fbb0da908ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:51.220605 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ecfdc-7d34-44c8-9410-0fbb0da908ec admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:51.221641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ecfdc-7d34-44c8-9410-0fbb0da908ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:51.221911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ecfdc-7d34-44c8-9410-0fbb0da908ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:51.222901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ecfdc-7d34-44c8-9410-0fbb0da908ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:51.226255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ecfdc-7d34-44c8-9410-0fbb0da908ec admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:51.244641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 815/1626] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:51.249264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ecfdc-7d34-44c8-9410-0fbb0da908ec admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:51.277057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 812/1627] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:26:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:26:51.286142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ecfdc-7d34-44c8-9410-0fbb0da908ec admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:51.294951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc334d9d-e501-4f8e-a997-b7b788ed0fb9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:51.297991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3efd9-922e-4bdc-9dd0-2b017598b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:51.301035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3efd9-922e-4bdc-9dd0-2b017598b376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:51.301359 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3efd9-922e-4bdc-9dd0-2b017598b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:51.310797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3efd9-922e-4bdc-9dd0-2b017598b376 admin admin] PATH_INFO: `/v3/projects/9a0d9a1a6afd4276ad9de0072727c258/users/bfd3734a498d49dd9818d733f6c92128/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:51.317068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3efd9-922e-4bdc-9dd0-2b017598b376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0d9a1a6afd4276ad9de0072727c258, user_id=bfd3734a498d49dd9818d733f6c92128, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:51.319025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:51.345588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3efd9-922e-4bdc-9dd0-2b017598b376 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:51.383614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 816/1628] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:51 2022] PUT /identity/v3/projects/9a0d9a1a6afd4276ad9de0072727c258/users/bfd3734a498d49dd9818d733f6c92128/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:51.387036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad787a4-23f4-4721-8873-68361c3c333d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:51.387285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad787a4-23f4-4721-8873-68361c3c333d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:51.387575 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad787a4-23f4-4721-8873-68361c3c333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:51.417653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc334d9d-e501-4f8e-a997-b7b788ed0fb9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:51.451017 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dad787a4-23f4-4721-8873-68361c3c333d None None] MFA Rules not processed for user `bfd3734a498d49dd9818d733f6c92128`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:51.452350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dad787a4-23f4-4721-8873-68361c3c333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:51.517135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ea6b6-fc5b-4b96-b1b1-506267412d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:51.518205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ea6b6-fc5b-4b96-b1b1-506267412d6f service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:51.518888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ea6b6-fc5b-4b96-b1b1-506267412d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:51.519168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ea6b6-fc5b-4b96-b1b1-506267412d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:51.649947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 817/1629] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:26:51.667666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad787a4-23f4-4721-8873-68361c3c333d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:51.692742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad787a4-23f4-4721-8873-68361c3c333d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:51.700982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62332bf-1026-4204-9cfd-68389f9e77db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:51.702026 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62332bf-1026-4204-9cfd-68389f9e77db service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:51.702746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62332bf-1026-4204-9cfd-68389f9e77db service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:51.703029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62332bf-1026-4204-9cfd-68389f9e77db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:51.720077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62332bf-1026-4204-9cfd-68389f9e77db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:51.725197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62332bf-1026-4204-9cfd-68389f9e77db service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:51.726572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ea6b6-fc5b-4b96-b1b1-506267412d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:51.729305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ea6b6-fc5b-4b96-b1b1-506267412d6f service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:51.744095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 818/1630] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:51.779260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 813/1631] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:52.082845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62332bf-1026-4204-9cfd-68389f9e77db service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:52.266236 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549709cb-c1a9-4246-a67c-b3394c74380d None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:52.266669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549709cb-c1a9-4246-a67c-b3394c74380d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:52.267057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549709cb-c1a9-4246-a67c-b3394c74380d None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:52.269148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 814/1632] 10.222.0.40 () {54 vars in 962 bytes} [Thu Jul 21 08:26:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:26:52.276813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95747e49-75a9-434d-abb8-ba0976aae3be None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:52.277114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95747e49-75a9-434d-abb8-ba0976aae3be None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:52.277401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95747e49-75a9-434d-abb8-ba0976aae3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:52.298357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62332bf-1026-4204-9cfd-68389f9e77db service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:52.319877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:52.321639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:52.326974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:52.327414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] PATH_INFO: `/v3/users/510fd864e4884836862df0d572af6bf9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:52.334393 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=510fd864e4884836862df0d572af6bf9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:52.335329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-95747e49-75a9-434d-abb8-ba0976aae3be None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:52.341347 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-95747e49-75a9-434d-abb8-ba0976aae3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:52.347512 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:52.375619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 815/1633] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Jul 21 08:26:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:26:52.376063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:52.377677 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459cfd6-90cc-41fd-8ffd-769a831bd65e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:52.378033 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459cfd6-90cc-41fd-8ffd-769a831bd65e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:52.378319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459cfd6-90cc-41fd-8ffd-769a831bd65e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:52.387150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 816/1634] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jul 21 08:26:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:26:52.389077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6045972-bab9-49d4-825b-fcb0e627f354 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:52.389609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6045972-bab9-49d4-825b-fcb0e627f354 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:52.390034 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6045972-bab9-49d4-825b-fcb0e627f354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:52.419401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f6045972-bab9-49d4-825b-fcb0e627f354 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:52.421394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f6045972-bab9-49d4-825b-fcb0e627f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:52.473384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 817/1635] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:26:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:52.497916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6045972-bab9-49d4-825b-fcb0e627f354 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:52.522839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6045972-bab9-49d4-825b-fcb0e627f354 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:52.528291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7956fd-1ab4-4aa4-83f9-631005b37ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:52.529111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7956fd-1ab4-4aa4-83f9-631005b37ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:52.529407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7956fd-1ab4-4aa4-83f9-631005b37ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:52.529684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7956fd-1ab4-4aa4-83f9-631005b37ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:52.553039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7956fd-1ab4-4aa4-83f9-631005b37ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:52.554708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7956fd-1ab4-4aa4-83f9-631005b37ce2 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:52.560021 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510fd864e4884836862df0d572af6bf9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:52.581121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510fd864e4884836862df0d572af6bf9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:52.599752 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 818/1636] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:52.639043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510fd864e4884836862df0d572af6bf9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:52.640618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510fd864e4884836862df0d572af6bf9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:52.641631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510fd864e4884836862df0d572af6bf9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:52.685801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 819/1637] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:26:52 2022] DELETE /identity/v3/users/510fd864e4884836862df0d572af6bf9 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:52.692604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763045-1abd-4be9-896e-2ecf346a88ec None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:52.693332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763045-1abd-4be9-896e-2ecf346a88ec None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:52.693959 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763045-1abd-4be9-896e-2ecf346a88ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:52.726175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-46763045-1abd-4be9-896e-2ecf346a88ec None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:52.729122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-46763045-1abd-4be9-896e-2ecf346a88ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:52.824926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:52.962740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 819/1638] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:26:53.050532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:53.055455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:53.268920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd663b87-7870-404d-b1e2-ab2a20706d45 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:53.281278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da60daa-0768-47a3-bb26-f4d4ea9abdef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:53.281976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da60daa-0768-47a3-bb26-f4d4ea9abdef service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:53.282586 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da60daa-0768-47a3-bb26-f4d4ea9abdef service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:53.282586 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da60daa-0768-47a3-bb26-f4d4ea9abdef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:53.306959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da60daa-0768-47a3-bb26-f4d4ea9abdef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:53.312462 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da60daa-0768-47a3-bb26-f4d4ea9abdef service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:53.339481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 820/1639] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:55.535703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18000664-4afe-4aa4-8d31-954c6228598a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:55.536279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18000664-4afe-4aa4-8d31-954c6228598a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:55.536279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18000664-4afe-4aa4-8d31-954c6228598a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:55.640936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-18000664-4afe-4aa4-8d31-954c6228598a None None] MFA Rules not processed for user `b5361788e2984e9d825e410df86c2fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:55.642653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-18000664-4afe-4aa4-8d31-954c6228598a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:55.769750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da60daa-0768-47a3-bb26-f4d4ea9abdef service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:55.772232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1da60daa-0768-47a3-bb26-f4d4ea9abdef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:55.803893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da60daa-0768-47a3-bb26-f4d4ea9abdef service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:55.807594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 820/1640] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:55.812638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18000664-4afe-4aa4-8d31-954c6228598a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:55.814556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-18000664-4afe-4aa4-8d31-954c6228598a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:55.820727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:55.821858 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:55.822309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:55.822739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] PATH_INFO: `/v3/projects/ddb265757a924e6684466c5c8000bd27` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:55.824901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb265757a924e6684466c5c8000bd27)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:55.826208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:55.826208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 21 08:26:55.826208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: Jul 21 08:26:55.828278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:55.835879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18000664-4afe-4aa4-8d31-954c6228598a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:55.859924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f9942-fde0-4522-9592-201af363321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:55.860729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f9942-fde0-4522-9592-201af363321b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:55.861012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f9942-fde0-4522-9592-201af363321b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:55.861285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f9942-fde0-4522-9592-201af363321b admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:55.862012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f9942-fde0-4522-9592-201af363321b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:55.864062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f9942-fde0-4522-9592-201af363321b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:55.946843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 821/1641] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:26:55 2022] POST /identity/v3/projects => generated 403 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:55.951840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f9942-fde0-4522-9592-201af363321b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:56.001226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb265757a924e6684466c5c8000bd27', 'request_id': 'req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.022012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb265757a924e6684466c5c8000bd27', 'request_id': 'req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.040762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb265757a924e6684466c5c8000bd27', 'request_id': 'req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.081876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] The token cache is being invalidate because project ddb265757a924e6684466c5c8000bd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:26:56.082173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.082831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.085018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 821/1642] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:26:55 2022] DELETE /identity/v3/projects/ddb265757a924e6684466c5c8000bd27 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:56.092446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:56.094877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:56.119661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:56.165824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f9942-fde0-4522-9592-201af363321b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:56.181763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e1a51-2bfa-4afc-8212-9787fc44f8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:56.182736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1a51-2bfa-4afc-8212-9787fc44f8ad admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:56.183162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1a51-2bfa-4afc-8212-9787fc44f8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:56.183582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1a51-2bfa-4afc-8212-9787fc44f8ad admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:56.184427 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e1a51-2bfa-4afc-8212-9787fc44f8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:56.187733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e1a51-2bfa-4afc-8212-9787fc44f8ad admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:56.249702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cdfe8-3ad4-47f4-a1df-fab5ae43401c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:56.251986 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 822/1643] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:26:55 2022] POST /identity/v3/users => generated 308 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:26:56.253051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e1a51-2bfa-4afc-8212-9787fc44f8ad admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:56.256280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:56.258127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:56.259039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-391e1a51-2bfa-4afc-8212-9787fc44f8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:56.259959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:56.266036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] PATH_INFO: `/v3/users/bfd3734a498d49dd9818d733f6c92128` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:56.268099 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd3734a498d49dd9818d733f6c92128)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:56.270352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:56.287276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e1a51-2bfa-4afc-8212-9787fc44f8ad admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:56.302453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2d28c-a348-4277-85e7-8fbf1971bd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:56.303368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2d28c-a348-4277-85e7-8fbf1971bd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:56.303653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2d28c-a348-4277-85e7-8fbf1971bd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:56.303927 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2d28c-a348-4277-85e7-8fbf1971bd50 admin admin] PATH_INFO: `/v3/users/acd28292452d4926af99237bcd0abc7d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:56.305607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2d28c-a348-4277-85e7-8fbf1971bd50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd28292452d4926af99237bcd0abc7d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:56.306684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-85c2d28c-a348-4277-85e7-8fbf1971bd50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:26:56.306684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 21 08:26:56.306684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: Jul 21 08:26:56.308721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2d28c-a348-4277-85e7-8fbf1971bd50 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:56.373261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd3734a498d49dd9818d733f6c92128'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.382261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd3734a498d49dd9818d733f6c92128'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.406799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd3734a498d49dd9818d733f6c92128'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.407957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd3734a498d49dd9818d733f6c92128'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.408654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd3734a498d49dd9818d733f6c92128'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.414390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:56.444630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 822/1644] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:26:56 2022] DELETE /identity/v3/users/bfd3734a498d49dd9818d733f6c92128 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:56.445719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:56.447093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:56.449878 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-85c2d28c-a348-4277-85e7-8fbf1971bd50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd28292452d4926af99237bcd0abc7d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.472683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-85c2d28c-a348-4277-85e7-8fbf1971bd50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd28292452d4926af99237bcd0abc7d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.509920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-85c2d28c-a348-4277-85e7-8fbf1971bd50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd28292452d4926af99237bcd0abc7d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.579049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-85c2d28c-a348-4277-85e7-8fbf1971bd50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd28292452d4926af99237bcd0abc7d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.579049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-85c2d28c-a348-4277-85e7-8fbf1971bd50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd28292452d4926af99237bcd0abc7d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:56.593268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 823/1645] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:26:56 2022] DELETE /identity/v3/users/acd28292452d4926af99237bcd0abc7d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:56.598496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db11e1-2bdd-4d2d-9726-cb71bd5f6c84 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:56.598929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db11e1-2bdd-4d2d-9726-cb71bd5f6c84 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:56.599468 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db11e1-2bdd-4d2d-9726-cb71bd5f6c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:56.601114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4556e-1924-4262-bfcd-d452cab905c2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:56.625917 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-06db11e1-2bdd-4d2d-9726-cb71bd5f6c84 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:56.627520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-06db11e1-2bdd-4d2d-9726-cb71bd5f6c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:56.698489 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:56.776789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eb5b2-caaa-4110-9641-b76423b8bab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:56.777655 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eb5b2-caaa-4110-9641-b76423b8bab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:56.777937 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eb5b2-caaa-4110-9641-b76423b8bab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:56.778221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eb5b2-caaa-4110-9641-b76423b8bab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:56.781178 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8eb5b2-caaa-4110-9641-b76423b8bab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:56.782875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8eb5b2-caaa-4110-9641-b76423b8bab4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:56.786469 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 824/1646] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:56.812870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 823/1647] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:56.814174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db11e1-2bdd-4d2d-9726-cb71bd5f6c84 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:56.815668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-06db11e1-2bdd-4d2d-9726-cb71bd5f6c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:56.839488 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db11e1-2bdd-4d2d-9726-cb71bd5f6c84 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:56.851619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a15dae-9310-461d-990c-96c52a2ec30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:56.854869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15dae-9310-461d-990c-96c52a2ec30d admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:56.855164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15dae-9310-461d-990c-96c52a2ec30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:56.855909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15dae-9310-461d-990c-96c52a2ec30d admin admin] PATH_INFO: `/v3/projects/0d1e1c3076b446beab17e3b3b97c4ac0/users/0988739fcbba40cf8ed1f38b15cd3bc9/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:56.883210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a15dae-9310-461d-990c-96c52a2ec30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1e1c3076b446beab17e3b3b97c4ac0, user_id=0988739fcbba40cf8ed1f38b15cd3bc9, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:56.886059 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a15dae-9310-461d-990c-96c52a2ec30d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:56.917454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 825/1648] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:56 2022] PUT /identity/v3/projects/0d1e1c3076b446beab17e3b3b97c4ac0/users/0988739fcbba40cf8ed1f38b15cd3bc9/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:56.922085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eb5b2-caaa-4110-9641-b76423b8bab4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:56.940075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eb5b2-caaa-4110-9641-b76423b8bab4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:57.128657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a15dae-9310-461d-990c-96c52a2ec30d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:57.131456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c2a15dae-9310-461d-990c-96c52a2ec30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:57.148374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41785bba-e475-42a9-b3f4-a143a49c2706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:57.150084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41785bba-e475-42a9-b3f4-a143a49c2706 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:57.151901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41785bba-e475-42a9-b3f4-a143a49c2706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:57.152301 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41785bba-e475-42a9-b3f4-a143a49c2706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:57.153185 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41785bba-e475-42a9-b3f4-a143a49c2706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:57.158174 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41785bba-e475-42a9-b3f4-a143a49c2706 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:57.190729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 824/1649] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:26:57.191936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41785bba-e475-42a9-b3f4-a143a49c2706 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:57.215176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41785bba-e475-42a9-b3f4-a143a49c2706 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:57.227057 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97269e4e-e313-49b5-ac1d-ddab8d5100a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:57.228092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97269e4e-e313-49b5-ac1d-ddab8d5100a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:57.228449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97269e4e-e313-49b5-ac1d-ddab8d5100a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:57.233632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97269e4e-e313-49b5-ac1d-ddab8d5100a7 admin admin] PATH_INFO: `/v3/projects/0d1e1c3076b446beab17e3b3b97c4ac0/users/0988739fcbba40cf8ed1f38b15cd3bc9/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:57.237887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97269e4e-e313-49b5-ac1d-ddab8d5100a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1e1c3076b446beab17e3b3b97c4ac0, user_id=0988739fcbba40cf8ed1f38b15cd3bc9, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:57.241091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97269e4e-e313-49b5-ac1d-ddab8d5100a7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:57.272298 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a15dae-9310-461d-990c-96c52a2ec30d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:57.274984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 825/1650] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:26:57 2022] PUT /identity/v3/projects/0d1e1c3076b446beab17e3b3b97c4ac0/users/0988739fcbba40cf8ed1f38b15cd3bc9/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:57.355512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:26:57.378928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc520c5-32e1-4f7f-a0a3-270649d0b0df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:57.382370 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc520c5-32e1-4f7f-a0a3-270649d0b0df service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:57.382655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc520c5-32e1-4f7f-a0a3-270649d0b0df service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:57.382932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc520c5-32e1-4f7f-a0a3-270649d0b0df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:57.573763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc520c5-32e1-4f7f-a0a3-270649d0b0df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:57.576869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc520c5-32e1-4f7f-a0a3-270649d0b0df service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:57.595694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 826/1651] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:26:59.645950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97269e4e-e313-49b5-ac1d-ddab8d5100a7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:26:59.649735 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-97269e4e-e313-49b5-ac1d-ddab8d5100a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:59.676680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97269e4e-e313-49b5-ac1d-ddab8d5100a7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:26:59.683170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:26:59.684401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:59.684896 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:59.685788 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0 admin admin] PATH_INFO: `/v3/projects/9a0d9a1a6afd4276ad9de0072727c258` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:59.687832 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0d9a1a6afd4276ad9de0072727c258)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:26:59.690829 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:26:59.783140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0d9a1a6afd4276ad9de0072727c258', 'request_id': 'req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:59.796554 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0d9a1a6afd4276ad9de0072727c258', 'request_id': 'req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:59.813640 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0d9a1a6afd4276ad9de0072727c258', 'request_id': 'req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:59.844164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0 admin admin] The token cache is being invalidate because project 9a0d9a1a6afd4276ad9de0072727c258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:26:59.844468 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:59.848116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-668a3b9d-6cbe-48a7-90d1-0539dd444ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:26:59.855849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 826/1652] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:26:59 2022] DELETE /identity/v3/projects/9a0d9a1a6afd4276ad9de0072727c258 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:26:59.857660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d419ff-1106-49ec-928c-431c745f6f57 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:59.858565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d419ff-1106-49ec-928c-431c745f6f57 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:59.859062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d419ff-1106-49ec-928c-431c745f6f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:26:59.886248 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-22d419ff-1106-49ec-928c-431c745f6f57 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:26:59.887952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-22d419ff-1106-49ec-928c-431c745f6f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:26:59.985281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 827/1653] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:26:59.993296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88575252-422d-461b-aaa6-469da350b37d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:26:59.993592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88575252-422d-461b-aaa6-469da350b37d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:26:59.993876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88575252-422d-461b-aaa6-469da350b37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:00.015935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-88575252-422d-461b-aaa6-469da350b37d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:00.017782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-88575252-422d-461b-aaa6-469da350b37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:00.033084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 827/1654] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:00.034061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d419ff-1106-49ec-928c-431c745f6f57 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:00.044742 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d419ff-1106-49ec-928c-431c745f6f57 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:00.052968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddd235-2e30-4ee7-af9a-1371c61e7996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:00.053990 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddd235-2e30-4ee7-af9a-1371c61e7996 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:00.054457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddd235-2e30-4ee7-af9a-1371c61e7996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:00.054921 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddd235-2e30-4ee7-af9a-1371c61e7996 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:00.055837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddd235-2e30-4ee7-af9a-1371c61e7996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:00.056329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddd235-2e30-4ee7-af9a-1371c61e7996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:00.058194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddd235-2e30-4ee7-af9a-1371c61e7996 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:00.096630 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 828/1655] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:27:00.097259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88575252-422d-461b-aaa6-469da350b37d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:00.099163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1de7d-1f67-4787-ad36-ae1a6eeb2466 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:00.099457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1de7d-1f67-4787-ad36-ae1a6eeb2466 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:00.099730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1de7d-1f67-4787-ad36-ae1a6eeb2466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:00.108198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88575252-422d-461b-aaa6-469da350b37d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:00.114873 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587861e9-7267-432f-990f-77022dc012a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:00.115514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587861e9-7267-432f-990f-77022dc012a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:00.116782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587861e9-7267-432f-990f-77022dc012a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:00.117072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587861e9-7267-432f-990f-77022dc012a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:00.117860 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587861e9-7267-432f-990f-77022dc012a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:00.119899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587861e9-7267-432f-990f-77022dc012a6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:00.158254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f6b1de7d-1f67-4787-ad36-ae1a6eeb2466 None None] MFA Rules not processed for user `212edf0d95bd48b8a3d26a47ccf25f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:00.159755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f6b1de7d-1f67-4787-ad36-ae1a6eeb2466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:00.189815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 828/1656] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:00 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:00.194663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587861e9-7267-432f-990f-77022dc012a6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:00.220267 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:00.346308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 829/1657] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:00.367514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24dfdd-2d74-4d24-a533-5b5c5df46e03 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:00.367845 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24dfdd-2d74-4d24-a533-5b5c5df46e03 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:00.368547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24dfdd-2d74-4d24-a533-5b5c5df46e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:00.397553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587861e9-7267-432f-990f-77022dc012a6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:00.399441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:00.411412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751ad83-2252-4303-8f73-0b0cffe076a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:00.412750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751ad83-2252-4303-8f73-0b0cffe076a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:00.412750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751ad83-2252-4303-8f73-0b0cffe076a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:00.413597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751ad83-2252-4303-8f73-0b0cffe076a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:00.413597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751ad83-2252-4303-8f73-0b0cffe076a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:00.417966 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9c24dfdd-2d74-4d24-a533-5b5c5df46e03 None None] MFA Rules not processed for user `212edf0d95bd48b8a3d26a47ccf25f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:00.430378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9c24dfdd-2d74-4d24-a533-5b5c5df46e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:00.431989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751ad83-2252-4303-8f73-0b0cffe076a6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:00.487051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 829/1658] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:00 2022] POST /identity/v3/users => generated 291 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:00.488142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751ad83-2252-4303-8f73-0b0cffe076a6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:00.493237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2751ad83-2252-4303-8f73-0b0cffe076a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:00.524298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751ad83-2252-4303-8f73-0b0cffe076a6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:00.540347 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:00.541671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:00.541955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:00.542231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] PATH_INFO: `/v3/projects/04b7af8c43f643588e4db69a9521d16a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:00.544988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b7af8c43f643588e4db69a9521d16a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:00.546972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:00.590791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 830/1659] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:00.594268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da8e92-89e8-4974-b5aa-fc25aa64dd49 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:00.594647 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da8e92-89e8-4974-b5aa-fc25aa64dd49 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:00.594885 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da8e92-89e8-4974-b5aa-fc25aa64dd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:00.667795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-53da8e92-89e8-4974-b5aa-fc25aa64dd49 None None] MFA Rules not processed for user `0988739fcbba40cf8ed1f38b15cd3bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:00.669120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-53da8e92-89e8-4974-b5aa-fc25aa64dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:00.681069 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b7af8c43f643588e4db69a9521d16a', 'request_id': 'req-c7a09d89-19de-4081-871f-c0e5241e1068'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:00.698766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b7af8c43f643588e4db69a9521d16a', 'request_id': 'req-c7a09d89-19de-4081-871f-c0e5241e1068'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:00.714873 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b7af8c43f643588e4db69a9521d16a', 'request_id': 'req-c7a09d89-19de-4081-871f-c0e5241e1068'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:00.746622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] The token cache is being invalidate because project 04b7af8c43f643588e4db69a9521d16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:00.747093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:00.748356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:00.760296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 830/1660] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:00 2022] DELETE /identity/v3/projects/04b7af8c43f643588e4db69a9521d16a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:00.760296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:00.760901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:00.865625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 831/1661] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:00 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:00.879330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da8e92-89e8-4974-b5aa-fc25aa64dd49 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:00.907900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-53da8e92-89e8-4974-b5aa-fc25aa64dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:01.020445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a09d89-19de-4081-871f-c0e5241e1068 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:01.049292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4d541-2a16-4c2b-afe3-7049850a7626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:01.050840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d541-2a16-4c2b-afe3-7049850a7626 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:01.051451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d541-2a16-4c2b-afe3-7049850a7626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:01.052065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d541-2a16-4c2b-afe3-7049850a7626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:01.053887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4d541-2a16-4c2b-afe3-7049850a7626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:01.061425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4d541-2a16-4c2b-afe3-7049850a7626 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:01.111233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 831/1662] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:01.117421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b513c4-f456-48e8-966e-4c0603ead9ae None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:01.118278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b513c4-f456-48e8-966e-4c0603ead9ae None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:01.119063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b513c4-f456-48e8-966e-4c0603ead9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:01.190635 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-81b513c4-f456-48e8-966e-4c0603ead9ae None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:01.197303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-81b513c4-f456-48e8-966e-4c0603ead9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:01.232099 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 832/1663] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:01.234514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b513c4-f456-48e8-966e-4c0603ead9ae None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:01.277389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b513c4-f456-48e8-966e-4c0603ead9ae None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:01.302112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da8e92-89e8-4974-b5aa-fc25aa64dd49 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:01.304061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a2d71-3a3d-4c03-b327-dc7340954f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:01.305717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a2d71-3a3d-4c03-b327-dc7340954f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:01.306446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a2d71-3a3d-4c03-b327-dc7340954f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:01.308378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a2d71-3a3d-4c03-b327-dc7340954f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:01.309852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a2d71-3a3d-4c03-b327-dc7340954f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:01.313164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a2d71-3a3d-4c03-b327-dc7340954f38 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:01.334258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33e8cf-c9bf-45b0-a073-1acfb7d97c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:01.339254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33e8cf-c9bf-45b0-a073-1acfb7d97c03 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:01.339862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33e8cf-c9bf-45b0-a073-1acfb7d97c03 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:01.340238 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33e8cf-c9bf-45b0-a073-1acfb7d97c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:01.343537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:01.349053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0c33e8cf-c9bf-45b0-a073-1acfb7d97c03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:01.371541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 833/1664] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:01.376972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883e022-c73e-4b0f-a1a7-6132ffe2166b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:01.377477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883e022-c73e-4b0f-a1a7-6132ffe2166b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:01.386073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883e022-c73e-4b0f-a1a7-6132ffe2166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:01.447824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2883e022-c73e-4b0f-a1a7-6132ffe2166b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:01.449101 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2883e022-c73e-4b0f-a1a7-6132ffe2166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:01.472687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 834/1665] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:01.473583 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883e022-c73e-4b0f-a1a7-6132ffe2166b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:01.496195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883e022-c73e-4b0f-a1a7-6132ffe2166b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:01.497805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:01.509176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4ce1-7ee2-4aaf-850e-ed7e29261b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:01.510187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4ce1-7ee2-4aaf-850e-ed7e29261b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:01.510656 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4ce1-7ee2-4aaf-850e-ed7e29261b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:01.510955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4ce1-7ee2-4aaf-850e-ed7e29261b25 admin admin] PATH_INFO: `/v3/projects/f4f66b6ee09a47119611699e030ca277/users/0b12e45fe00a4fb6bea6c5117f152833/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:01.548142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea4ce1-7ee2-4aaf-850e-ed7e29261b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f66b6ee09a47119611699e030ca277, user_id=0b12e45fe00a4fb6bea6c5117f152833, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:01.551811 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea4ce1-7ee2-4aaf-850e-ed7e29261b25 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:01.580243 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33e8cf-c9bf-45b0-a073-1acfb7d97c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:01.581590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 835/1666] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:01 2022] PUT /identity/v3/projects/f4f66b6ee09a47119611699e030ca277/users/0b12e45fe00a4fb6bea6c5117f152833/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:01.583268 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4ce1-7ee2-4aaf-850e-ed7e29261b25 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:01.585024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33e8cf-c9bf-45b0-a073-1acfb7d97c03 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:01.615043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 832/1667] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:01.618211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0747f-7b02-4df7-b393-c025332da2da None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:01.618556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0747f-7b02-4df7-b393-c025332da2da None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:01.620999 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0747f-7b02-4df7-b393-c025332da2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:01.736880 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6be0747f-7b02-4df7-b393-c025332da2da None None] MFA Rules not processed for user `0b12e45fe00a4fb6bea6c5117f152833`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:01.745363 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4ce1-7ee2-4aaf-850e-ed7e29261b25 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:01.748739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6be0747f-7b02-4df7-b393-c025332da2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:01.751657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7a298-700c-495a-8929-da5d42950c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:01.752631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7a298-700c-495a-8929-da5d42950c5e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:01.753254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7a298-700c-495a-8929-da5d42950c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:01.753718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7a298-700c-495a-8929-da5d42950c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:01.754785 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7a298-700c-495a-8929-da5d42950c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:01.759371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7a298-700c-495a-8929-da5d42950c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:01.763117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7a298-700c-495a-8929-da5d42950c5e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:01.796725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 836/1668] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:01.801409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7a298-700c-495a-8929-da5d42950c5e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:01.827047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7a298-700c-495a-8929-da5d42950c5e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:01.840260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a42d-9db0-4597-8ad3-abe15daeb322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:01.851032 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a42d-9db0-4597-8ad3-abe15daeb322 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:01.851607 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a42d-9db0-4597-8ad3-abe15daeb322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:01.852261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a42d-9db0-4597-8ad3-abe15daeb322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:01.853201 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720a42d-9db0-4597-8ad3-abe15daeb322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:01.858365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720a42d-9db0-4597-8ad3-abe15daeb322 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:01.928976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 837/1669] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:01 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:01.933311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a42d-9db0-4597-8ad3-abe15daeb322 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:01.967937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 833/1670] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:01.969069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0747f-7b02-4df7-b393-c025332da2da None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:02.023865 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0747f-7b02-4df7-b393-c025332da2da None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:02.182238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a42d-9db0-4597-8ad3-abe15daeb322 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:02.184926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a0552-3597-4075-b8a3-1fed7f41f549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:02.186856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0552-3597-4075-b8a3-1fed7f41f549 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:02.188346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0552-3597-4075-b8a3-1fed7f41f549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:02.189464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0552-3597-4075-b8a3-1fed7f41f549 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:02.190282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a0552-3597-4075-b8a3-1fed7f41f549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:02.200685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c51f3-2c2a-4a00-9fc2-27bcc5e9c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:02.201520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c51f3-2c2a-4a00-9fc2-27bcc5e9c71a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:02.201809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c51f3-2c2a-4a00-9fc2-27bcc5e9c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:02.202164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c51f3-2c2a-4a00-9fc2-27bcc5e9c71a admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:02.202983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c51f3-2c2a-4a00-9fc2-27bcc5e9c71a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:02.205630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c51f3-2c2a-4a00-9fc2-27bcc5e9c71a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:02.210727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a0552-3597-4075-b8a3-1fed7f41f549 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:02.247220 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 838/1671] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:01 2022] POST /identity/v3/users => generated 286 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:02.249383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c51f3-2c2a-4a00-9fc2-27bcc5e9c71a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:02.264923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c51f3-2c2a-4a00-9fc2-27bcc5e9c71a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:02.273989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ec085-78d3-420e-97db-0068bee5aac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:02.276069 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ec085-78d3-420e-97db-0068bee5aac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:02.276958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ec085-78d3-420e-97db-0068bee5aac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:02.276958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ec085-78d3-420e-97db-0068bee5aac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:02.277983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ec085-78d3-420e-97db-0068bee5aac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:02.279898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ec085-78d3-420e-97db-0068bee5aac6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:02.293484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 834/1672] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:01 2022] POST /identity/v3/projects => generated 379 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:02.294777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a0552-3597-4075-b8a3-1fed7f41f549 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:02.305112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 839/1673] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:02.311283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ec085-78d3-420e-97db-0068bee5aac6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:02.345592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ec085-78d3-420e-97db-0068bee5aac6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:02.391830 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:02.440827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:02.476102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a0552-3597-4075-b8a3-1fed7f41f549 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:02.482249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa8fbf-755f-4988-919b-0b603bc30279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:02.483220 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa8fbf-755f-4988-919b-0b603bc30279 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:02.483450 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa8fbf-755f-4988-919b-0b603bc30279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:02.483792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa8fbf-755f-4988-919b-0b603bc30279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:02.484689 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa8fbf-755f-4988-919b-0b603bc30279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:02.486704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa8fbf-755f-4988-919b-0b603bc30279 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:02.489892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cda139-93a2-4bf0-b718-185036d3a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:02.491574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cda139-93a2-4bf0-b718-185036d3a8df admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:02.491896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cda139-93a2-4bf0-b718-185036d3a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:02.492842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cda139-93a2-4bf0-b718-185036d3a8df admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:02.497685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cda139-93a2-4bf0-b718-185036d3a8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:02.499790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cda139-93a2-4bf0-b718-185036d3a8df admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:02.511315 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 840/1674] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:02.512629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa8fbf-755f-4988-919b-0b603bc30279 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:02.549978 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa8fbf-755f-4988-919b-0b603bc30279 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:02.553952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 835/1675] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:02 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:02.559409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cda139-93a2-4bf0-b718-185036d3a8df admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:02.561215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef033ec2-0374-4067-b0dd-da0ed35aa12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:02.562449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef033ec2-0374-4067-b0dd-da0ed35aa12b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:02.562810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef033ec2-0374-4067-b0dd-da0ed35aa12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:02.563192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef033ec2-0374-4067-b0dd-da0ed35aa12b admin admin] PATH_INFO: `/v3/projects/44febdfb6e984150b3dea1a3cecb91a5/users/746add7e56324493898dde48f7044afb/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:02.604913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cda139-93a2-4bf0-b718-185036d3a8df admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:02.610339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef033ec2-0374-4067-b0dd-da0ed35aa12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=44febdfb6e984150b3dea1a3cecb91a5, user_id=746add7e56324493898dde48f7044afb, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:02.614642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef033ec2-0374-4067-b0dd-da0ed35aa12b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:02.619714 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278f3fd-eb4f-4ce3-b12c-55ea8d8a03c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:02.620755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278f3fd-eb4f-4ce3-b12c-55ea8d8a03c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:02.621170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278f3fd-eb4f-4ce3-b12c-55ea8d8a03c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:02.621551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278f3fd-eb4f-4ce3-b12c-55ea8d8a03c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:02.630358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278f3fd-eb4f-4ce3-b12c-55ea8d8a03c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:02.635265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278f3fd-eb4f-4ce3-b12c-55ea8d8a03c8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:02.657576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 841/1676] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:02 2022] PUT /identity/v3/projects/44febdfb6e984150b3dea1a3cecb91a5/users/746add7e56324493898dde48f7044afb/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:02.674703 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570a536-1501-4909-b791-e7eb783f1a0c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:02.675005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570a536-1501-4909-b791-e7eb783f1a0c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:02.675289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570a536-1501-4909-b791-e7eb783f1a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:02.690922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 836/1677] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:02.691911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278f3fd-eb4f-4ce3-b12c-55ea8d8a03c8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:02.728763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278f3fd-eb4f-4ce3-b12c-55ea8d8a03c8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:02.786133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a570a536-1501-4909-b791-e7eb783f1a0c None None] MFA Rules not processed for user `746add7e56324493898dde48f7044afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:02.787490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a570a536-1501-4909-b791-e7eb783f1a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:03.019997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ae8ba-044c-459b-9532-0ea917dac4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:03.025416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ae8ba-044c-459b-9532-0ea917dac4df admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:03.025416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ae8ba-044c-459b-9532-0ea917dac4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:03.025416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ae8ba-044c-459b-9532-0ea917dac4df admin admin] PATH_INFO: `/v3/projects/d84824c091aa4684934a24c5c1b69c69/users/04eccad969594b13a8db9c72b2b732b1/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:03.107026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ae8ba-044c-459b-9532-0ea917dac4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84824c091aa4684934a24c5c1b69c69, user_id=04eccad969594b13a8db9c72b2b732b1, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:03.114453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ae8ba-044c-459b-9532-0ea917dac4df admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:03.147842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 842/1678] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:03.147842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762b989-6739-49e8-8674-67ad8b71aba4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:03.147842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762b989-6739-49e8-8674-67ad8b71aba4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:03.149774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762b989-6739-49e8-8674-67ad8b71aba4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:03.157530 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 843/1679] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:27:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:27:03.165893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762b989-6739-49e8-8674-67ad8b71aba4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:03.166663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 837/1680] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:02 2022] PUT /identity/v3/projects/d84824c091aa4684934a24c5c1b69c69/users/04eccad969594b13a8db9c72b2b732b1/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:03.171136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ae8ba-044c-459b-9532-0ea917dac4df admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:03.361474 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ae8ba-044c-459b-9532-0ea917dac4df admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:03.365501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762b989-6739-49e8-8674-67ad8b71aba4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:03.375986 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ceaa8-cf52-4d62-a300-8fa7ea45e593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:03.380701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ceaa8-cf52-4d62-a300-8fa7ea45e593 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:03.381094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ceaa8-cf52-4d62-a300-8fa7ea45e593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:03.382093 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ceaa8-cf52-4d62-a300-8fa7ea45e593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:03.382911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ceaa8-cf52-4d62-a300-8fa7ea45e593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:03.385222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d741cc-1c82-4663-a2b9-3a0085c87cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:03.386007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d741cc-1c82-4663-a2b9-3a0085c87cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:03.386293 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d741cc-1c82-4663-a2b9-3a0085c87cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:03.386619 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d741cc-1c82-4663-a2b9-3a0085c87cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:03.388563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d741cc-1c82-4663-a2b9-3a0085c87cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:03.390547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ceaa8-cf52-4d62-a300-8fa7ea45e593 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:03.391817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d741cc-1c82-4663-a2b9-3a0085c87cf1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:03.455675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 838/1681] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:03.456851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ceaa8-cf52-4d62-a300-8fa7ea45e593 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:03.464977 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4d3ceaa8-cf52-4d62-a300-8fa7ea45e593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:03.553584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 844/1682] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:03 2022] POST /identity/v3/projects => generated 371 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:03.555204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f668a9f-e43f-4be3-a590-24fcd089a63e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:03.563539 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f668a9f-e43f-4be3-a590-24fcd089a63e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:03.564001 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f668a9f-e43f-4be3-a590-24fcd089a63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:03.567399 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ceaa8-cf52-4d62-a300-8fa7ea45e593 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:03.611630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:03.635393 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1f668a9f-e43f-4be3-a590-24fcd089a63e None None] MFA Rules not processed for user `1fd9ea435d7b48cb8b1b2a27d79cfa91`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:03.636976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1f668a9f-e43f-4be3-a590-24fcd089a63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:03.830752 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:03.880896 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 845/1683] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:27:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:03.883260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0259e7c-482a-43fb-9cdc-d443bf5af681 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:03.885652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0259e7c-482a-43fb-9cdc-d443bf5af681 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:03.886135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0259e7c-482a-43fb-9cdc-d443bf5af681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:03.893679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:03.894963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:03.895406 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:03.895933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] PATH_INFO: `/v3/users/2d8859c630df46319f31cb910a870bd3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:03.898428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8859c630df46319f31cb910a870bd3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:03.900851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:03.963965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e0259e7c-482a-43fb-9cdc-d443bf5af681 None None] MFA Rules not processed for user `81c6d25afc4b484e891769c7bd583819`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:03.965603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e0259e7c-482a-43fb-9cdc-d443bf5af681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:04.047419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8859c630df46319f31cb910a870bd3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:04.069244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8859c630df46319f31cb910a870bd3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:04.097454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8859c630df46319f31cb910a870bd3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:04.133984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 846/1684] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:04.141729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0259e7c-482a-43fb-9cdc-d443bf5af681 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:04.157160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8859c630df46319f31cb910a870bd3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:04.158452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8859c630df46319f31cb910a870bd3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:04.176672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0259e7c-482a-43fb-9cdc-d443bf5af681 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:04.176908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 839/1685] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:03 2022] DELETE /identity/v3/users/2d8859c630df46319f31cb910a870bd3 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:04.178473 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:04.180630 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:04.295292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274ceff-68d2-42a2-85de-a0d099dd7bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:04.296694 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ceff-68d2-42a2-85de-a0d099dd7bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:04.297879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ceff-68d2-42a2-85de-a0d099dd7bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:04.299486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ceff-68d2-42a2-85de-a0d099dd7bb8 admin admin] PATH_INFO: `/v3/projects/d84824c091aa4684934a24c5c1b69c69/users/04eccad969594b13a8db9c72b2b732b1/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:04.307585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274ceff-68d2-42a2-85de-a0d099dd7bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84824c091aa4684934a24c5c1b69c69, user_id=04eccad969594b13a8db9c72b2b732b1, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:04.309140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ef9f5-5650-43d6-bde0-c7beefb60470 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:04.313618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274ceff-68d2-42a2-85de-a0d099dd7bb8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:04.321341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aab16-b96e-425f-af8d-f11aac4b056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:04.322054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aab16-b96e-425f-af8d-f11aac4b056a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:04.322344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aab16-b96e-425f-af8d-f11aac4b056a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:04.322640 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aab16-b96e-425f-af8d-f11aac4b056a admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:04.323339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aab16-b96e-425f-af8d-f11aac4b056a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:04.329156 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aab16-b96e-425f-af8d-f11aac4b056a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:04.335029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 847/1686] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:04 2022] PUT /identity/v3/projects/d84824c091aa4684934a24c5c1b69c69/users/04eccad969594b13a8db9c72b2b732b1/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:04.336029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060282e6-45ad-437c-8ac7-b1e10e7f6afe None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:04.336453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060282e6-45ad-437c-8ac7-b1e10e7f6afe None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:04.336824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060282e6-45ad-437c-8ac7-b1e10e7f6afe None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:04.338250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 848/1687] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jul 21 08:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:27:04.339424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947aee95-8e21-4906-b4a8-418ba8d1cf7b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:04.339779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947aee95-8e21-4906-b4a8-418ba8d1cf7b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:04.340119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947aee95-8e21-4906-b4a8-418ba8d1cf7b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:04.342540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 849/1688] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jul 21 08:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:27:04.344062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af4cec-60e5-4e56-929d-c7e8919d7e9a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:04.344359 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af4cec-60e5-4e56-929d-c7e8919d7e9a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:04.344678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af4cec-60e5-4e56-929d-c7e8919d7e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:04.374429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f6af4cec-60e5-4e56-929d-c7e8919d7e9a None None] MFA Rules not processed for user `81c6d25afc4b484e891769c7bd583819`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:04.376817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f6af4cec-60e5-4e56-929d-c7e8919d7e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:04.381968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 840/1689] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:04 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:04.383915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e154ca-8e43-4c08-a493-e157ce7b4c9a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:04.384394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e154ca-8e43-4c08-a493-e157ce7b4c9a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:04.385380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e154ca-8e43-4c08-a493-e157ce7b4c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:04.411202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:04.413673 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-50e154ca-8e43-4c08-a493-e157ce7b4c9a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:04.415291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-50e154ca-8e43-4c08-a493-e157ce7b4c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:04.481556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:04.497790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 841/1690] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:04.499643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676753-17e7-4400-a09d-6c9a084c5336 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:04.499954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676753-17e7-4400-a09d-6c9a084c5336 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:04.517326 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676753-17e7-4400-a09d-6c9a084c5336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:04.552595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 850/1691] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:04.557832 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7e45f-a281-48c5-90ce-fbdad7799215 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:04.558153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7e45f-a281-48c5-90ce-fbdad7799215 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:04.558443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7e45f-a281-48c5-90ce-fbdad7799215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:04.578162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2d676753-17e7-4400-a09d-6c9a084c5336 None None] MFA Rules not processed for user `04eccad969594b13a8db9c72b2b732b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:04.580341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2d676753-17e7-4400-a09d-6c9a084c5336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:04.626638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0cc7e45f-a281-48c5-90ce-fbdad7799215 None None] MFA Rules not processed for user `06a267cec6fb4dbea619f0a77b5674dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:04.629580 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0cc7e45f-a281-48c5-90ce-fbdad7799215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:04.736536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 842/1692] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:04.745822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68ec1a-0baa-4d8c-a11f-906b2ddfa14e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:04.746190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68ec1a-0baa-4d8c-a11f-906b2ddfa14e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:04.748010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68ec1a-0baa-4d8c-a11f-906b2ddfa14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:04.806596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ad68ec1a-0baa-4d8c-a11f-906b2ddfa14e None None] MFA Rules not processed for user `1fd9ea435d7b48cb8b1b2a27d79cfa91`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:04.807952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ad68ec1a-0baa-4d8c-a11f-906b2ddfa14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:04.867667 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 851/1693] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:27:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:04.868908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7e45f-a281-48c5-90ce-fbdad7799215 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:04.930524 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7e45f-a281-48c5-90ce-fbdad7799215 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:04.941888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab35a-25ee-49f8-8fa8-a8e1fb10014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:04.945899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab35a-25ee-49f8-8fa8-a8e1fb10014e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:04.946188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab35a-25ee-49f8-8fa8-a8e1fb10014e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:04.946470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab35a-25ee-49f8-8fa8-a8e1fb10014e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:04.947307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadab35a-25ee-49f8-8fa8-a8e1fb10014e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:04.949064 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadab35a-25ee-49f8-8fa8-a8e1fb10014e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:04.996164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 852/1694] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:04.997219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab35a-25ee-49f8-8fa8-a8e1fb10014e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:05.004319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cadab35a-25ee-49f8-8fa8-a8e1fb10014e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:05.013761 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 843/1695] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jul 21 08:27:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:05.019971 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68ec1a-0baa-4d8c-a11f-906b2ddfa14e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:05.019971 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ad68ec1a-0baa-4d8c-a11f-906b2ddfa14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:05.056008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab35a-25ee-49f8-8fa8-a8e1fb10014e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:05.070975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5358bcc-40fc-4042-9166-cfbf547ccfff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:05.076025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5358bcc-40fc-4042-9166-cfbf547ccfff service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:05.076354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5358bcc-40fc-4042-9166-cfbf547ccfff service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:05.079295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5358bcc-40fc-4042-9166-cfbf547ccfff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:05.120038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5358bcc-40fc-4042-9166-cfbf547ccfff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:05.121564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5358bcc-40fc-4042-9166-cfbf547ccfff service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:05.170629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 853/1696] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:05.171660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5358bcc-40fc-4042-9166-cfbf547ccfff service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:05.175689 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a5358bcc-40fc-4042-9166-cfbf547ccfff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:05.276088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68ec1a-0baa-4d8c-a11f-906b2ddfa14e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:05.293432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73e584-7310-43fa-ad53-85ebf0e8096c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:05.294136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73e584-7310-43fa-ad53-85ebf0e8096c service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:05.294430 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73e584-7310-43fa-ad53-85ebf0e8096c service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:05.294681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73e584-7310-43fa-ad53-85ebf0e8096c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:05.301604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-be73e584-7310-43fa-ad53-85ebf0e8096c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:05.328880 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73e584-7310-43fa-ad53-85ebf0e8096c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:05.330984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73e584-7310-43fa-ad53-85ebf0e8096c service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:05.338612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5358bcc-40fc-4042-9166-cfbf547ccfff service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:05.348313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122eab68-92e7-437a-bdfd-3068e7581058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:05.349194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eab68-92e7-437a-bdfd-3068e7581058 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:05.349485 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eab68-92e7-437a-bdfd-3068e7581058 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:05.349760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eab68-92e7-437a-bdfd-3068e7581058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:05.355092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 844/1697] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:05.355856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73e584-7310-43fa-ad53-85ebf0e8096c service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:05.363317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:05.373878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122eab68-92e7-437a-bdfd-3068e7581058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:05.376014 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122eab68-92e7-437a-bdfd-3068e7581058 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:05.382186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73e584-7310-43fa-ad53-85ebf0e8096c service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:05.390043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bc7a5-f602-4223-a0a6-398be7902426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:05.392394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bc7a5-f602-4223-a0a6-398be7902426 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:05.392707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bc7a5-f602-4223-a0a6-398be7902426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:05.392981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bc7a5-f602-4223-a0a6-398be7902426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:05.405420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 854/1698] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:05.408652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122eab68-92e7-437a-bdfd-3068e7581058 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:05.417644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bc7a5-f602-4223-a0a6-398be7902426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:05.421430 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bc7a5-f602-4223-a0a6-398be7902426 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:05.437785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 845/1699] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:05.446771 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bc7a5-f602-4223-a0a6-398be7902426 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:05.453111 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122eab68-92e7-437a-bdfd-3068e7581058 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:05.465194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7ceca-f5d3-4b90-bd1e-fd5bf8158891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:05.469346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7ceca-f5d3-4b90-bd1e-fd5bf8158891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:05.469977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7ceca-f5d3-4b90-bd1e-fd5bf8158891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:05.470563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7ceca-f5d3-4b90-bd1e-fd5bf8158891 admin admin] PATH_INFO: `/v3/projects/1fc3edbdc4a04378814ccb4bf4b63d53/users/0decc46f9e4f44d192acd61e92d0b31f/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:05.492594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bc7a5-f602-4223-a0a6-398be7902426 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:05.506872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec8fa3-5261-4afb-9961-2c8c8816017f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd9ea435d7b48cb8b1b2a27d79cfa91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:05.508526 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec8fa3-5261-4afb-9961-2c8c8816017f service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:05.508938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec8fa3-5261-4afb-9961-2c8c8816017f service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:05.511745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec8fa3-5261-4afb-9961-2c8c8816017f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:05.515828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-93ec8fa3-5261-4afb-9961-2c8c8816017f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:05.519237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7ceca-f5d3-4b90-bd1e-fd5bf8158891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc3edbdc4a04378814ccb4bf4b63d53, user_id=0decc46f9e4f44d192acd61e92d0b31f, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:05.530551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7ceca-f5d3-4b90-bd1e-fd5bf8158891 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:05.559569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec8fa3-5261-4afb-9961-2c8c8816017f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:05.564464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec8fa3-5261-4afb-9961-2c8c8816017f service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:05.568943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 855/1700] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:05 2022] PUT /identity/v3/projects/1fc3edbdc4a04378814ccb4bf4b63d53/users/0decc46f9e4f44d192acd61e92d0b31f/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:05.572807 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7ceca-f5d3-4b90-bd1e-fd5bf8158891 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:05.594659 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 846/1701] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:05.624760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec8fa3-5261-4afb-9961-2c8c8816017f service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:05.640921 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec8fa3-5261-4afb-9961-2c8c8816017f service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:05.650569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:05.741988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7ceca-f5d3-4b90-bd1e-fd5bf8158891 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:05.758447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8290c-7ce9-4b0c-8a26-1441a0433eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:05.759167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8290c-7ce9-4b0c-8a26-1441a0433eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:05.759458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8290c-7ce9-4b0c-8a26-1441a0433eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:05.759741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8290c-7ce9-4b0c-8a26-1441a0433eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:05.760667 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8290c-7ce9-4b0c-8a26-1441a0433eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:05.762362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8290c-7ce9-4b0c-8a26-1441a0433eb4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:05.779410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335334-d4d4-48d8-b9c4-6ed096edea33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:05.780979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335334-d4d4-48d8-b9c4-6ed096edea33 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:05.781506 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335334-d4d4-48d8-b9c4-6ed096edea33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:05.783363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335334-d4d4-48d8-b9c4-6ed096edea33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:05.796325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 856/1702] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:27:05.797447 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f7335334-d4d4-48d8-b9c4-6ed096edea33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:05.798786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8290c-7ce9-4b0c-8a26-1441a0433eb4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:05.828760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8290c-7ce9-4b0c-8a26-1441a0433eb4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:05.852290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a81069-a8e9-4849-acd7-a85d1ce8ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:05.853287 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a81069-a8e9-4849-acd7-a85d1ce8ecf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:05.853578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a81069-a8e9-4849-acd7-a85d1ce8ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:05.853878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a81069-a8e9-4849-acd7-a85d1ce8ecf0 admin admin] PATH_INFO: `/v3/projects/1fc3edbdc4a04378814ccb4bf4b63d53/users/0decc46f9e4f44d192acd61e92d0b31f/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:05.861362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a81069-a8e9-4849-acd7-a85d1ce8ecf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc3edbdc4a04378814ccb4bf4b63d53, user_id=0decc46f9e4f44d192acd61e92d0b31f, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:05.864846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a81069-a8e9-4849-acd7-a85d1ce8ecf0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:05.894561 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 857/1703] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:05 2022] PUT /identity/v3/projects/1fc3edbdc4a04378814ccb4bf4b63d53/users/0decc46f9e4f44d192acd61e92d0b31f/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:05.918287 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dcc02-86c4-4295-b859-1f00d12f4bbe None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:05.918638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dcc02-86c4-4295-b859-1f00d12f4bbe None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:05.918906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dcc02-86c4-4295-b859-1f00d12f4bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:06.020689 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b92dcc02-86c4-4295-b859-1f00d12f4bbe None None] MFA Rules not processed for user `0decc46f9e4f44d192acd61e92d0b31f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:06.022020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b92dcc02-86c4-4295-b859-1f00d12f4bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:06.028321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7335334-d4d4-48d8-b9c4-6ed096edea33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:06.034834 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7335334-d4d4-48d8-b9c4-6ed096edea33 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:06.068516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 847/1704] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:27:06.266448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 858/1705] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:06.274781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335334-d4d4-48d8-b9c4-6ed096edea33 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:06.276579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f7335334-d4d4-48d8-b9c4-6ed096edea33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:06.308368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335334-d4d4-48d8-b9c4-6ed096edea33 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:06.486983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd319ba-50d3-4c67-ad7e-9fca0f56abfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:06.488319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd319ba-50d3-4c67-ad7e-9fca0f56abfb service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:06.488656 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd319ba-50d3-4c67-ad7e-9fca0f56abfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:06.490516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd319ba-50d3-4c67-ad7e-9fca0f56abfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:06.523049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd319ba-50d3-4c67-ad7e-9fca0f56abfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:06.528160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd319ba-50d3-4c67-ad7e-9fca0f56abfb service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:06.587951 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dcc02-86c4-4295-b859-1f00d12f4bbe None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:06.590329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 848/1706] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:06.801297 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce7964-9f15-4b51-81e3-b863cc860baa None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:06.801644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce7964-9f15-4b51-81e3-b863cc860baa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:06.802037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce7964-9f15-4b51-81e3-b863cc860baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:06.825236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dcc02-86c4-4295-b859-1f00d12f4bbe None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:06.843001 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81360a-f6d0-4b9a-aabe-94dfe4a4fcf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd9ea435d7b48cb8b1b2a27d79cfa91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:06.844439 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81360a-f6d0-4b9a-aabe-94dfe4a4fcf9 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:06.845675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81360a-f6d0-4b9a-aabe-94dfe4a4fcf9 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:06.846374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81360a-f6d0-4b9a-aabe-94dfe4a4fcf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:06.851231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-32ce7964-9f15-4b51-81e3-b863cc860baa None None] MFA Rules not processed for user `212edf0d95bd48b8a3d26a47ccf25f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:06.854595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-32ce7964-9f15-4b51-81e3-b863cc860baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:06.855985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-be81360a-f6d0-4b9a-aabe-94dfe4a4fcf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:06.898539 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81360a-f6d0-4b9a-aabe-94dfe4a4fcf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:06.900752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81360a-f6d0-4b9a-aabe-94dfe4a4fcf9 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:06.957258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 859/1707] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:06.959173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81360a-f6d0-4b9a-aabe-94dfe4a4fcf9 service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:06.968698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-be81360a-f6d0-4b9a-aabe-94dfe4a4fcf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:07.034419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:07.034850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:07.160274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81360a-f6d0-4b9a-aabe-94dfe4a4fcf9 service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:07.169833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 849/1708] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:07.179168 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:07.180124 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:07.180405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:07.180707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] PATH_INFO: `/v3/users/b5361788e2984e9d825e410df86c2fc2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:07.189663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5361788e2984e9d825e410df86c2fc2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:07.191809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:07.347041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5361788e2984e9d825e410df86c2fc2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:07.369911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5361788e2984e9d825e410df86c2fc2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:07.408042 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5361788e2984e9d825e410df86c2fc2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:07.411018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5361788e2984e9d825e410df86c2fc2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:07.413395 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5361788e2984e9d825e410df86c2fc2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:07.444610 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 860/1709] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:06 2022] DELETE /identity/v3/users/b5361788e2984e9d825e410df86c2fc2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:07.605514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce7964-9f15-4b51-81e3-b863cc860baa None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:07.608124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-32ce7964-9f15-4b51-81e3-b863cc860baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:07.670055 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce7964-9f15-4b51-81e3-b863cc860baa None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:07.787682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:07.789638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:07.973936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:07.976991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:07.977995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:07.979951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf admin admin] PATH_INFO: `/v3/projects/eb1fff1cd8524c75b5e6a3c9c8ba3d64` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:07.982550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1fff1cd8524c75b5e6a3c9c8ba3d64)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:07.984811 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:08.068207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1fff1cd8524c75b5e6a3c9c8ba3d64', 'request_id': 'req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:08.071709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6150bfd-016e-4e2b-9ab4-6772362ccfc2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:08.096247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1fff1cd8524c75b5e6a3c9c8ba3d64', 'request_id': 'req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:08.125763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1fff1cd8524c75b5e6a3c9c8ba3d64', 'request_id': 'req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:08.158805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf admin admin] The token cache is being invalidate because project eb1fff1cd8524c75b5e6a3c9c8ba3d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:08.160309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:08.165696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6a9425f0-9ba2-47d1-b488-36d3a7a1d2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:08.173992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 850/1710] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:07 2022] DELETE /identity/v3/projects/eb1fff1cd8524c75b5e6a3c9c8ba3d64 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:08.176463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6464-e298-4dcb-94bb-bcb4e5b54c92 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:08.177009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6464-e298-4dcb-94bb-bcb4e5b54c92 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:08.177376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6464-e298-4dcb-94bb-bcb4e5b54c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:08.218774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3e9c6464-e298-4dcb-94bb-bcb4e5b54c92 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:08.220324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3e9c6464-e298-4dcb-94bb-bcb4e5b54c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:08.286887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:08.324752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:08.325696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:08.325986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:08.327229 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] PATH_INFO: `/v3/users/746add7e56324493898dde48f7044afb` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:08.331350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=746add7e56324493898dde48f7044afb)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:08.337873 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:08.451361 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 851/1711] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:08.453922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71006b-68ea-44ac-940d-3f3e47028337 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:08.454268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71006b-68ea-44ac-940d-3f3e47028337 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:08.454570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71006b-68ea-44ac-940d-3f3e47028337 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:08.458662 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 852/1712] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jul 21 08:27:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:27:08.459828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33d09-5085-4470-841d-f57a11d195bb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:08.470844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33d09-5085-4470-841d-f57a11d195bb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:08.471272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33d09-5085-4470-841d-f57a11d195bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:08.520103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746add7e56324493898dde48f7044afb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:08.521400 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bbf33d09-5085-4470-841d-f57a11d195bb None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:08.524010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bbf33d09-5085-4470-841d-f57a11d195bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:08.550624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 853/1713] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:08.552252 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c0d65-777d-4254-a8d5-0d18029007f7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:08.552556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c0d65-777d-4254-a8d5-0d18029007f7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:08.552832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c0d65-777d-4254-a8d5-0d18029007f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:08.567121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746add7e56324493898dde48f7044afb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:08.580524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:08.621074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746add7e56324493898dde48f7044afb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:08.623465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746add7e56324493898dde48f7044afb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:08.627941 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746add7e56324493898dde48f7044afb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:08.631159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-db9c0d65-777d-4254-a8d5-0d18029007f7 None None] MFA Rules not processed for user `06a267cec6fb4dbea619f0a77b5674dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:08.632418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-db9c0d65-777d-4254-a8d5-0d18029007f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:08.674754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 861/1714] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:07 2022] DELETE /identity/v3/users/746add7e56324493898dde48f7044afb => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:08.675696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:08.678181 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:08.879994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 854/1715] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:27:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:08.880411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c0d65-777d-4254-a8d5-0d18029007f7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:08.889235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-db9c0d65-777d-4254-a8d5-0d18029007f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:08.947861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c0d65-777d-4254-a8d5-0d18029007f7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:08.955864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb9611-072b-45ac-9f7d-b4089cd9b51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:08.956924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb9611-072b-45ac-9f7d-b4089cd9b51a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:08.958238 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb9611-072b-45ac-9f7d-b4089cd9b51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:08.958672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb9611-072b-45ac-9f7d-b4089cd9b51a admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:08.959798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb9611-072b-45ac-9f7d-b4089cd9b51a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:08.967974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb9611-072b-45ac-9f7d-b4089cd9b51a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:08.969911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb9611-072b-45ac-9f7d-b4089cd9b51a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:08.984513 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5d523-82f5-4f50-86dd-aaf4b391f283 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:09.012941 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:09.016036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:09.017045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:09.017932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] PATH_INFO: `/v3/projects/950876676b0f41818163c93b2e17b825` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:09.020626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950876676b0f41818163c93b2e17b825)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:09.023285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:09.045906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 855/1716] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:09.053122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f81d3-0ee0-4dcb-b717-3ac14e2f7a01 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:09.053757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f81d3-0ee0-4dcb-b717-3ac14e2f7a01 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:09.054189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f81d3-0ee0-4dcb-b717-3ac14e2f7a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:09.125309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e39f81d3-0ee0-4dcb-b717-3ac14e2f7a01 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:09.133676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e39f81d3-0ee0-4dcb-b717-3ac14e2f7a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:09.176774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950876676b0f41818163c93b2e17b825', 'request_id': 'req-bf1c1f90-3d00-4e25-848e-e614b46571a9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:09.202049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950876676b0f41818163c93b2e17b825', 'request_id': 'req-bf1c1f90-3d00-4e25-848e-e614b46571a9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:09.226846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950876676b0f41818163c93b2e17b825', 'request_id': 'req-bf1c1f90-3d00-4e25-848e-e614b46571a9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:09.233368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:09.268517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] The token cache is being invalidate because project 950876676b0f41818163c93b2e17b825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:09.268818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:09.269812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:09.276557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 862/1717] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:08 2022] DELETE /identity/v3/projects/950876676b0f41818163c93b2e17b825 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:09.279528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:09.285156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:09.345056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 856/1718] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:09.347984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f81d3-0ee0-4dcb-b717-3ac14e2f7a01 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:09.353464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e39f81d3-0ee0-4dcb-b717-3ac14e2f7a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:09.402712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f81d3-0ee0-4dcb-b717-3ac14e2f7a01 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:09.432015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0e826-1103-4704-aa4b-2832140c6f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:09.435359 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0e826-1103-4704-aa4b-2832140c6f1c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:09.435649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0e826-1103-4704-aa4b-2832140c6f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:09.435923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0e826-1103-4704-aa4b-2832140c6f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:09.438323 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0e826-1103-4704-aa4b-2832140c6f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:09.444726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0e826-1103-4704-aa4b-2832140c6f1c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:09.489050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c1f90-3d00-4e25-848e-e614b46571a9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:09.503814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bffffa-4ab1-446b-8faf-e69b65a6e05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:09.504559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bffffa-4ab1-446b-8faf-e69b65a6e05f service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:09.504844 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bffffa-4ab1-446b-8faf-e69b65a6e05f service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:09.505277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bffffa-4ab1-446b-8faf-e69b65a6e05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:09.509969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-10bffffa-4ab1-446b-8faf-e69b65a6e05f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:09.531816 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 857/1719] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:09 2022] POST /identity/v3/projects => generated 393 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:09.537666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0e826-1103-4704-aa4b-2832140c6f1c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:09.538840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bffffa-4ab1-446b-8faf-e69b65a6e05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:09.541102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bffffa-4ab1-446b-8faf-e69b65a6e05f service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:09.542056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fac0e826-1103-4704-aa4b-2832140c6f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:09.563165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 863/1720] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:09.566445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bffffa-4ab1-446b-8faf-e69b65a6e05f service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:09.611825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bffffa-4ab1-446b-8faf-e69b65a6e05f service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:09.718094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0e826-1103-4704-aa4b-2832140c6f1c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:09.725233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:09.727286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:09.727909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:09.728209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] PATH_INFO: `/v3/users/0988739fcbba40cf8ed1f38b15cd3bc9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:09.730349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0988739fcbba40cf8ed1f38b15cd3bc9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:09.733313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:09.745903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b61d2a-7791-431f-b37b-b63b2a769371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:09.746795 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b61d2a-7791-431f-b37b-b63b2a769371 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:09.747091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b61d2a-7791-431f-b37b-b63b2a769371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:09.747369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b61d2a-7791-431f-b37b-b63b2a769371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:09.780458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:09.783940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b61d2a-7791-431f-b37b-b63b2a769371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:09.785415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b61d2a-7791-431f-b37b-b63b2a769371 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:09.807009 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 864/1721] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:09.807962 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b61d2a-7791-431f-b37b-b63b2a769371 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:09.821316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0988739fcbba40cf8ed1f38b15cd3bc9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:09.821993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b61d2a-7791-431f-b37b-b63b2a769371 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:09.836313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25c62f-067e-466b-9ac8-3a5897d0bdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:09.836666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0988739fcbba40cf8ed1f38b15cd3bc9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:09.837540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25c62f-067e-466b-9ac8-3a5897d0bdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:09.837974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25c62f-067e-466b-9ac8-3a5897d0bdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:09.838388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25c62f-067e-466b-9ac8-3a5897d0bdb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:09.839236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25c62f-067e-466b-9ac8-3a5897d0bdb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:09.841426 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25c62f-067e-466b-9ac8-3a5897d0bdb6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:09.851044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0988739fcbba40cf8ed1f38b15cd3bc9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:09.891577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0988739fcbba40cf8ed1f38b15cd3bc9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:09.893971 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0988739fcbba40cf8ed1f38b15cd3bc9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:09.912949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 858/1722] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:09 2022] DELETE /identity/v3/users/0988739fcbba40cf8ed1f38b15cd3bc9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:09.977542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 865/1723] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:09 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:09.983331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:09.985208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:10.227996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87badc2-c9d5-4bf6-afef-39c237428679 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:10.253004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdb273-6500-46de-a857-c2ffbc3f88a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:10.253733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb273-6500-46de-a857-c2ffbc3f88a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:10.254013 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb273-6500-46de-a857-c2ffbc3f88a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:10.254692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb273-6500-46de-a857-c2ffbc3f88a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:10.255123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdb273-6500-46de-a857-c2ffbc3f88a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:10.256862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdb273-6500-46de-a857-c2ffbc3f88a3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:10.308078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 859/1724] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:10.312271 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25c62f-067e-466b-9ac8-3a5897d0bdb6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:10.343749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25c62f-067e-466b-9ac8-3a5897d0bdb6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:10.365382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff745c9-163e-4c22-b2d5-c3a5d30b8dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:10.366354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff745c9-163e-4c22-b2d5-c3a5d30b8dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:10.366795 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff745c9-163e-4c22-b2d5-c3a5d30b8dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:10.367219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff745c9-163e-4c22-b2d5-c3a5d30b8dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:10.368277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff745c9-163e-4c22-b2d5-c3a5d30b8dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:10.372961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff745c9-163e-4c22-b2d5-c3a5d30b8dc3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:10.416985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 866/1725] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:10.422005 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdb273-6500-46de-a857-c2ffbc3f88a3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:10.448277 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdb273-6500-46de-a857-c2ffbc3f88a3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:10.471755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e5d7-a0dd-41e3-864d-d539ef725cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:10.473664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e5d7-a0dd-41e3-864d-d539ef725cec admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:10.474076 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e5d7-a0dd-41e3-864d-d539ef725cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:10.474358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e5d7-a0dd-41e3-864d-d539ef725cec admin admin] PATH_INFO: `/v3/projects/ea64c92edd4241b0a0671b55ad7ebd6c/users/fe8f23790d64477384cd77c002db1bfd/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:10.519707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667e5d7-a0dd-41e3-864d-d539ef725cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea64c92edd4241b0a0671b55ad7ebd6c, user_id=fe8f23790d64477384cd77c002db1bfd, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:10.533388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667e5d7-a0dd-41e3-864d-d539ef725cec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:10.574059 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 860/1726] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:10 2022] PUT /identity/v3/projects/ea64c92edd4241b0a0671b55ad7ebd6c/users/fe8f23790d64477384cd77c002db1bfd/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:10.586056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f103cb-3b52-4db2-aa37-3dada4b9e5fe None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:10.586344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f103cb-3b52-4db2-aa37-3dada4b9e5fe None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:10.586676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f103cb-3b52-4db2-aa37-3dada4b9e5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:10.673538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a8f103cb-3b52-4db2-aa37-3dada4b9e5fe None None] MFA Rules not processed for user `fe8f23790d64477384cd77c002db1bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:10.675218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a8f103cb-3b52-4db2-aa37-3dada4b9e5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:10.718072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e5d7-a0dd-41e3-864d-d539ef725cec admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:10.721795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9667e5d7-a0dd-41e3-864d-d539ef725cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:10.916874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 867/1727] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:10.918858 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f103cb-3b52-4db2-aa37-3dada4b9e5fe None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:10.928149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:10.937215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f103cb-3b52-4db2-aa37-3dada4b9e5fe None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:10.942741 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e5d7-a0dd-41e3-864d-d539ef725cec admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:10.945629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf1c3a-871d-4068-921f-a663745a029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:10.946695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf1c3a-871d-4068-921f-a663745a029e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:10.947179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf1c3a-871d-4068-921f-a663745a029e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:10.947606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf1c3a-871d-4068-921f-a663745a029e admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:10.948367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf1c3a-871d-4068-921f-a663745a029e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:10.950921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf1c3a-871d-4068-921f-a663745a029e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:10.955291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:10.956641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:10.958110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:10.959054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] PATH_INFO: `/v3/projects/0d1e1c3076b446beab17e3b3b97c4ac0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:10.962412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1e1c3076b446beab17e3b3b97c4ac0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:10.966851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:10.993669 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 868/1728] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:10 2022] POST /identity/v3/projects => generated 393 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:10.995740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed429da0-6610-4229-a8cd-1d0243098055 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:10.996951 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed429da0-6610-4229-a8cd-1d0243098055 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:10.997387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed429da0-6610-4229-a8cd-1d0243098055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:11.005460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:11.081082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1e1c3076b446beab17e3b3b97c4ac0', 'request_id': 'req-407007e3-357f-4af5-8922-0bb4cd8c9005'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:11.091575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1e1c3076b446beab17e3b3b97c4ac0', 'request_id': 'req-407007e3-357f-4af5-8922-0bb4cd8c9005'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:11.100286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1e1c3076b446beab17e3b3b97c4ac0', 'request_id': 'req-407007e3-357f-4af5-8922-0bb4cd8c9005'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:11.128755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] The token cache is being invalidate because project 0d1e1c3076b446beab17e3b3b97c4ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:11.129056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:11.131682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:11.134799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ed429da0-6610-4229-a8cd-1d0243098055 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:11.135984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 861/1729] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:10 2022] DELETE /identity/v3/projects/0d1e1c3076b446beab17e3b3b97c4ac0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:11.136799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ed429da0-6610-4229-a8cd-1d0243098055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:11.137985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:11.141448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:11.257046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407007e3-357f-4af5-8922-0bb4cd8c9005 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:11.258498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 869/1730] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:27:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:11.260581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4e0a0-0795-4ad3-9483-6cdc6e02f8c2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:11.261022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4e0a0-0795-4ad3-9483-6cdc6e02f8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:11.261409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4e0a0-0795-4ad3-9483-6cdc6e02f8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:11.262621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14303282-c6ff-4dbd-ae0b-414e78b4d6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:11.263666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14303282-c6ff-4dbd-ae0b-414e78b4d6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:11.264775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14303282-c6ff-4dbd-ae0b-414e78b4d6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:11.264775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14303282-c6ff-4dbd-ae0b-414e78b4d6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:11.265971 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14303282-c6ff-4dbd-ae0b-414e78b4d6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:11.268533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14303282-c6ff-4dbd-ae0b-414e78b4d6d4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:11.299813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 862/1731] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:11 2022] POST /identity/v3/users => generated 303 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:11.304192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7ef4e0a0-0795-4ad3-9483-6cdc6e02f8c2 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:11.305805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7ef4e0a0-0795-4ad3-9483-6cdc6e02f8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:11.313763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14303282-c6ff-4dbd-ae0b-414e78b4d6d4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:11.326503 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 870/1732] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:11.328942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98fe64-c5ac-4576-9de6-fd0a8df6d180 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:11.329407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98fe64-c5ac-4576-9de6-fd0a8df6d180 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:11.329860 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98fe64-c5ac-4576-9de6-fd0a8df6d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:11.334267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14303282-c6ff-4dbd-ae0b-414e78b4d6d4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:11.342261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49d29e-7502-4949-a7a9-73094e7b4431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:11.343208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49d29e-7502-4949-a7a9-73094e7b4431 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:11.343537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49d29e-7502-4949-a7a9-73094e7b4431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:11.343806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49d29e-7502-4949-a7a9-73094e7b4431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:11.344896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49d29e-7502-4949-a7a9-73094e7b4431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:11.348205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49d29e-7502-4949-a7a9-73094e7b4431 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:11.363895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 863/1733] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:11.368013 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49d29e-7502-4949-a7a9-73094e7b4431 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:11.375372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ac98fe64-c5ac-4576-9de6-fd0a8df6d180 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:11.381014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49d29e-7502-4949-a7a9-73094e7b4431 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:11.381677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ac98fe64-c5ac-4576-9de6-fd0a8df6d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:11.389661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f96a4a-e605-45dc-ae15-a8454a3e5115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:11.391203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f96a4a-e605-45dc-ae15-a8454a3e5115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:11.391486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f96a4a-e605-45dc-ae15-a8454a3e5115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:11.391761 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f96a4a-e605-45dc-ae15-a8454a3e5115 admin admin] PATH_INFO: `/v3/projects/5786656a30fa4762ad6e9ceb49eccc78/users/d7f93a8eccf94cdb8b9cbc883760c68c/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:11.404782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 871/1734] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:11.410292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98fe64-c5ac-4576-9de6-fd0a8df6d180 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:11.426995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98fe64-c5ac-4576-9de6-fd0a8df6d180 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:11.430325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f96a4a-e605-45dc-ae15-a8454a3e5115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5786656a30fa4762ad6e9ceb49eccc78, user_id=d7f93a8eccf94cdb8b9cbc883760c68c, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:11.434322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174bac1-cd9d-4816-9dd4-4d046908e7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:11.435624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174bac1-cd9d-4816-9dd4-4d046908e7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:11.436173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174bac1-cd9d-4816-9dd4-4d046908e7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:11.436288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f96a4a-e605-45dc-ae15-a8454a3e5115 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:11.436888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174bac1-cd9d-4816-9dd4-4d046908e7f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:11.438227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174bac1-cd9d-4816-9dd4-4d046908e7f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:11.439036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174bac1-cd9d-4816-9dd4-4d046908e7f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:11.442562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174bac1-cd9d-4816-9dd4-4d046908e7f9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:11.457827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 864/1735] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:11 2022] PUT /identity/v3/projects/5786656a30fa4762ad6e9ceb49eccc78/users/d7f93a8eccf94cdb8b9cbc883760c68c/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:11.462025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f96a4a-e605-45dc-ae15-a8454a3e5115 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:11.464414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 872/1736] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:11.480212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174bac1-cd9d-4816-9dd4-4d046908e7f9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:11.510038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174bac1-cd9d-4816-9dd4-4d046908e7f9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:11.555535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:11.582671 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f96a4a-e605-45dc-ae15-a8454a3e5115 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:11.598777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b2232-c98e-4da2-a91d-6f32ed95ec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:11.599934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2232-c98e-4da2-a91d-6f32ed95ec44 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:11.600451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2232-c98e-4da2-a91d-6f32ed95ec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:11.601000 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2232-c98e-4da2-a91d-6f32ed95ec44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:11.602362 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b2232-c98e-4da2-a91d-6f32ed95ec44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:11.604815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b2232-c98e-4da2-a91d-6f32ed95ec44 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:11.631153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 865/1737] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:11.632253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b2232-c98e-4da2-a91d-6f32ed95ec44 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:11.642267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d0b2232-c98e-4da2-a91d-6f32ed95ec44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:11.749092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaf95d-94c6-4efe-84bb-8252b9ac6d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:11.750283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaf95d-94c6-4efe-84bb-8252b9ac6d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:11.750283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaf95d-94c6-4efe-84bb-8252b9ac6d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:11.750483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaf95d-94c6-4efe-84bb-8252b9ac6d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:11.752618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aaf95d-94c6-4efe-84bb-8252b9ac6d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:11.755031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aaf95d-94c6-4efe-84bb-8252b9ac6d54 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:11.820513 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 873/1738] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:11 2022] POST /identity/v3/projects => generated 407 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:11.821727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaf95d-94c6-4efe-84bb-8252b9ac6d54 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:11.842504 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:11.866397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b2232-c98e-4da2-a91d-6f32ed95ec44 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:11.933038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaf95d-94c6-4efe-84bb-8252b9ac6d54 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:11.938669 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a713e9-2fb5-42ec-8d80-21138a94c28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:11.939891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a713e9-2fb5-42ec-8d80-21138a94c28e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:11.940702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a713e9-2fb5-42ec-8d80-21138a94c28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:11.941197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a713e9-2fb5-42ec-8d80-21138a94c28e admin admin] PATH_INFO: `/v3/projects/5786656a30fa4762ad6e9ceb49eccc78/users/d7f93a8eccf94cdb8b9cbc883760c68c/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:11.943542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a713e9-2fb5-42ec-8d80-21138a94c28e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5786656a30fa4762ad6e9ceb49eccc78, user_id=d7f93a8eccf94cdb8b9cbc883760c68c, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:11.947382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a713e9-2fb5-42ec-8d80-21138a94c28e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:12.030421 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517e36f-bf10-4b8a-81d7-30373f1effda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:12.031317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517e36f-bf10-4b8a-81d7-30373f1effda service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:12.031602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517e36f-bf10-4b8a-81d7-30373f1effda service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:12.031917 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517e36f-bf10-4b8a-81d7-30373f1effda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:12.042491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 874/1739] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:11 2022] PUT /identity/v3/projects/5786656a30fa4762ad6e9ceb49eccc78/users/d7f93a8eccf94cdb8b9cbc883760c68c/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:12.047009 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a713e9-2fb5-42ec-8d80-21138a94c28e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:12.109748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517e36f-bf10-4b8a-81d7-30373f1effda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:12.111465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517e36f-bf10-4b8a-81d7-30373f1effda service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:12.137670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 866/1740] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:27:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:27:12.139254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15717c12-8ed3-4fcb-a628-b6a9abdfc387 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:12.139705 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15717c12-8ed3-4fcb-a628-b6a9abdfc387 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:12.139993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15717c12-8ed3-4fcb-a628-b6a9abdfc387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:12.301850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a713e9-2fb5-42ec-8d80-21138a94c28e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:12.316559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b83cb-7292-4d24-a5cd-4530e5f00230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:12.326854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b83cb-7292-4d24-a5cd-4530e5f00230 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:12.329501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b83cb-7292-4d24-a5cd-4530e5f00230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:12.330270 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b83cb-7292-4d24-a5cd-4530e5f00230 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:12.331437 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b83cb-7292-4d24-a5cd-4530e5f00230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:12.334348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b83cb-7292-4d24-a5cd-4530e5f00230 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:12.334516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:12.359686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-15717c12-8ed3-4fcb-a628-b6a9abdfc387 None None] MFA Rules not processed for user `d7f93a8eccf94cdb8b9cbc883760c68c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:12.370732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-15717c12-8ed3-4fcb-a628-b6a9abdfc387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:12.407695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 875/1741] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:12 2022] POST /identity/v3/users => generated 304 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:12.411465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b83cb-7292-4d24-a5cd-4530e5f00230 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:12.456589 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b83cb-7292-4d24-a5cd-4530e5f00230 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:12.480617 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa6d64-36dd-48b0-a096-6c564d7f0f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:12.481322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa6d64-36dd-48b0-a096-6c564d7f0f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:12.481600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa6d64-36dd-48b0-a096-6c564d7f0f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:12.481874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa6d64-36dd-48b0-a096-6c564d7f0f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:12.482617 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa6d64-36dd-48b0-a096-6c564d7f0f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:12.484258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa6d64-36dd-48b0-a096-6c564d7f0f08 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:12.514783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 876/1742] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:12.516163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa6d64-36dd-48b0-a096-6c564d7f0f08 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:12.548838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa6d64-36dd-48b0-a096-6c564d7f0f08 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:12.559288 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041c43f-3d76-4b07-92d2-e045be53272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:12.560165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041c43f-3d76-4b07-92d2-e045be53272e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:12.560443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041c43f-3d76-4b07-92d2-e045be53272e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:12.560749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041c43f-3d76-4b07-92d2-e045be53272e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:12.561481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041c43f-3d76-4b07-92d2-e045be53272e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:12.563168 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041c43f-3d76-4b07-92d2-e045be53272e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:12.618612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 877/1743] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:12.619292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041c43f-3d76-4b07-92d2-e045be53272e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:12.697263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041c43f-3d76-4b07-92d2-e045be53272e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:12.714429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695a347-e1ee-4639-a2ea-ca7287739683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:12.719688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695a347-e1ee-4639-a2ea-ca7287739683 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:12.719974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695a347-e1ee-4639-a2ea-ca7287739683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:12.720254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695a347-e1ee-4639-a2ea-ca7287739683 admin admin] PATH_INFO: `/v3/projects/598cbfa473ac4e4cae373547bd8872fc/users/03b883c981824716a680c7cd6aed0c60/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:12.759080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 867/1744] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 621 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:12.761767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15717c12-8ed3-4fcb-a628-b6a9abdfc387 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:12.773386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-15717c12-8ed3-4fcb-a628-b6a9abdfc387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:12.784202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695a347-e1ee-4639-a2ea-ca7287739683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598cbfa473ac4e4cae373547bd8872fc, user_id=03b883c981824716a680c7cd6aed0c60, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:12.787160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695a347-e1ee-4639-a2ea-ca7287739683 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:12.807587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15717c12-8ed3-4fcb-a628-b6a9abdfc387 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:12.830494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 878/1745] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:12 2022] PUT /identity/v3/projects/598cbfa473ac4e4cae373547bd8872fc/users/03b883c981824716a680c7cd6aed0c60/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:12.836519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695a347-e1ee-4639-a2ea-ca7287739683 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:12.839717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c695a347-e1ee-4639-a2ea-ca7287739683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:12.982835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:12.983744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:12.984020 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:12.984301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8 admin admin] PATH_INFO: `/v3/projects/44febdfb6e984150b3dea1a3cecb91a5` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:12.986774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44febdfb6e984150b3dea1a3cecb91a5)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:12.987370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:12.988777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:12.999036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695a347-e1ee-4639-a2ea-ca7287739683 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:13.007457 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d3fe1-5109-4947-b1b3-428140d0112c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:13.008065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d3fe1-5109-4947-b1b3-428140d0112c service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:13.008345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d3fe1-5109-4947-b1b3-428140d0112c service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:13.008642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d3fe1-5109-4947-b1b3-428140d0112c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:13.113975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44febdfb6e984150b3dea1a3cecb91a5', 'request_id': 'req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:13.127968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44febdfb6e984150b3dea1a3cecb91a5', 'request_id': 'req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:13.139608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44febdfb6e984150b3dea1a3cecb91a5', 'request_id': 'req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:13.184286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d3fe1-5109-4947-b1b3-428140d0112c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:13.188704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d3fe1-5109-4947-b1b3-428140d0112c service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:13.190215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8 admin admin] The token cache is being invalidate because project 44febdfb6e984150b3dea1a3cecb91a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:13.193785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:13.196163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-96c930ec-72a9-410b-a2d3-c4ac8dd7c6b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:13.204938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 868/1746] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:12 2022] DELETE /identity/v3/projects/44febdfb6e984150b3dea1a3cecb91a5 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:13.212933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31d50f-1b6a-4d85-8d70-41f35da144d4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:13.212933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31d50f-1b6a-4d85-8d70-41f35da144d4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:13.215176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31d50f-1b6a-4d85-8d70-41f35da144d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:13.233722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 879/1747] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:13.235736 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d3fe1-5109-4947-b1b3-428140d0112c service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:13.263038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d3fe1-5109-4947-b1b3-428140d0112c service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:13.334580 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ae31d50f-1b6a-4d85-8d70-41f35da144d4 None None] MFA Rules not processed for user `03b883c981824716a680c7cd6aed0c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:13.342992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ae31d50f-1b6a-4d85-8d70-41f35da144d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:13.436344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:13.585654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:13.588871 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:13.588871 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:13.588871 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] PATH_INFO: `/v3/users/0decc46f9e4f44d192acd61e92d0b31f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:13.596701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0decc46f9e4f44d192acd61e92d0b31f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:13.609290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:13.624397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 869/1748] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:13.625343 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31d50f-1b6a-4d85-8d70-41f35da144d4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:13.632324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ae31d50f-1b6a-4d85-8d70-41f35da144d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:13.776088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0decc46f9e4f44d192acd61e92d0b31f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:13.779141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31d50f-1b6a-4d85-8d70-41f35da144d4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:13.788474 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625277db-85bb-4f29-b8dd-ca3efb4ce310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:13.789870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625277db-85bb-4f29-b8dd-ca3efb4ce310 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:13.790813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625277db-85bb-4f29-b8dd-ca3efb4ce310 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:13.791026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625277db-85bb-4f29-b8dd-ca3efb4ce310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:13.805024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0decc46f9e4f44d192acd61e92d0b31f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:13.815290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-625277db-85bb-4f29-b8dd-ca3efb4ce310 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:13.851303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0decc46f9e4f44d192acd61e92d0b31f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:13.852682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0decc46f9e4f44d192acd61e92d0b31f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:13.860010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0decc46f9e4f44d192acd61e92d0b31f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:13.895016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 880/1749] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:13 2022] DELETE /identity/v3/users/0decc46f9e4f44d192acd61e92d0b31f => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:13.897198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:13.909337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:13.971710 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625277db-85bb-4f29-b8dd-ca3efb4ce310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:13.973509 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625277db-85bb-4f29-b8dd-ca3efb4ce310 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:13.974110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:13.994140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 870/1750] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:14.158493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ce677-1d9a-4dc1-ad83-7b36c6234500 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:14.204730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b994205-b4a9-4f6c-94ec-840072098e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:14.211341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b994205-b4a9-4f6c-94ec-840072098e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:14.212707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b994205-b4a9-4f6c-94ec-840072098e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:14.213441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b994205-b4a9-4f6c-94ec-840072098e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:14.216450 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b994205-b4a9-4f6c-94ec-840072098e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:14.224642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b994205-b4a9-4f6c-94ec-840072098e18 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:14.337622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625277db-85bb-4f29-b8dd-ca3efb4ce310 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:14.340259 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-625277db-85bb-4f29-b8dd-ca3efb4ce310 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:14.345430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 881/1751] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:13 2022] POST /identity/v3/projects => generated 409 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:14.375980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625277db-85bb-4f29-b8dd-ca3efb4ce310 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:14.653459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8baee-ec0d-4a86-867e-6026d8240df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:14.654758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8baee-ec0d-4a86-867e-6026d8240df2 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:14.656334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8baee-ec0d-4a86-867e-6026d8240df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:14.656810 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8baee-ec0d-4a86-867e-6026d8240df2 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:14.657886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8baee-ec0d-4a86-867e-6026d8240df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:14.669207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8baee-ec0d-4a86-867e-6026d8240df2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:14.744967 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b994205-b4a9-4f6c-94ec-840072098e18 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:14.745530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 871/1752] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:14 2022] POST /identity/v3/users => generated 311 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:14.759479 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b994205-b4a9-4f6c-94ec-840072098e18 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:14.773842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2572d09-592d-48d4-9d90-1e62912e6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:14.776054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2572d09-592d-48d4-9d90-1e62912e6730 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:14.777522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2572d09-592d-48d4-9d90-1e62912e6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:14.777522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2572d09-592d-48d4-9d90-1e62912e6730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:14.779216 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2572d09-592d-48d4-9d90-1e62912e6730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:14.782725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2572d09-592d-48d4-9d90-1e62912e6730 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:14.819384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 882/1753] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:14.823902 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8baee-ec0d-4a86-867e-6026d8240df2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:14.830458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:14.846835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8baee-ec0d-4a86-867e-6026d8240df2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:14.870346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d776a90-6f52-4e99-b22a-d2b521f5544a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:14.871459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d776a90-6f52-4e99-b22a-d2b521f5544a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:14.871855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d776a90-6f52-4e99-b22a-d2b521f5544a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:14.872241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d776a90-6f52-4e99-b22a-d2b521f5544a admin admin] PATH_INFO: `/v3/projects/63a4eb98fb6745489fe7ea3d205efe2e/users/63ad5c3c006e403e84e0fdd3e42bc0c8/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:14.916458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d776a90-6f52-4e99-b22a-d2b521f5544a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a4eb98fb6745489fe7ea3d205efe2e, user_id=63ad5c3c006e403e84e0fdd3e42bc0c8, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:14.921593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d776a90-6f52-4e99-b22a-d2b521f5544a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:14.991879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 872/1754] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:14 2022] PUT /identity/v3/projects/63a4eb98fb6745489fe7ea3d205efe2e/users/63ad5c3c006e403e84e0fdd3e42bc0c8/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:15.003552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2572d09-592d-48d4-9d90-1e62912e6730 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:15.031352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2572d09-592d-48d4-9d90-1e62912e6730 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:15.110342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d776a90-6f52-4e99-b22a-d2b521f5544a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:15.113225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4d776a90-6f52-4e99-b22a-d2b521f5544a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:15.165356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808299e7-6bf0-4859-a3df-acf22ea41d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:15.166353 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808299e7-6bf0-4859-a3df-acf22ea41d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:15.166561 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808299e7-6bf0-4859-a3df-acf22ea41d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:15.167208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808299e7-6bf0-4859-a3df-acf22ea41d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:15.168204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808299e7-6bf0-4859-a3df-acf22ea41d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:15.170414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808299e7-6bf0-4859-a3df-acf22ea41d5a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:15.193781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 883/1755] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:15.197164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808299e7-6bf0-4859-a3df-acf22ea41d5a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:15.214173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808299e7-6bf0-4859-a3df-acf22ea41d5a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:15.226592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07b3c1-e54d-4034-b84a-4b872a760acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:15.235134 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07b3c1-e54d-4034-b84a-4b872a760acb admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:15.236422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07b3c1-e54d-4034-b84a-4b872a760acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:15.239100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07b3c1-e54d-4034-b84a-4b872a760acb admin admin] PATH_INFO: `/v3/projects/63a4eb98fb6745489fe7ea3d205efe2e/users/63ad5c3c006e403e84e0fdd3e42bc0c8/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:15.251326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07b3c1-e54d-4034-b84a-4b872a760acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a4eb98fb6745489fe7ea3d205efe2e, user_id=63ad5c3c006e403e84e0fdd3e42bc0c8, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:15.267245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07b3c1-e54d-4034-b84a-4b872a760acb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:15.324800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 884/1756] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:15 2022] PUT /identity/v3/projects/63a4eb98fb6745489fe7ea3d205efe2e/users/63ad5c3c006e403e84e0fdd3e42bc0c8/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:15.335871 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99022e24-a080-4156-b7ad-b7b25b60c96b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:15.336631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99022e24-a080-4156-b7ad-b7b25b60c96b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:15.337152 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99022e24-a080-4156-b7ad-b7b25b60c96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:15.385095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d776a90-6f52-4e99-b22a-d2b521f5544a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:15.408274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-99022e24-a080-4156-b7ad-b7b25b60c96b None None] MFA Rules not processed for user `63ad5c3c006e403e84e0fdd3e42bc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:15.415041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-99022e24-a080-4156-b7ad-b7b25b60c96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:15.630689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7fa5d-e8af-45e6-802a-df51e2df142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:15.636704 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7fa5d-e8af-45e6-802a-df51e2df142b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:15.637015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7fa5d-e8af-45e6-802a-df51e2df142b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:15.637508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7fa5d-e8af-45e6-802a-df51e2df142b admin admin] PATH_INFO: `/v3/projects/1fc3edbdc4a04378814ccb4bf4b63d53` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:15.649163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7fa5d-e8af-45e6-802a-df51e2df142b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc3edbdc4a04378814ccb4bf4b63d53)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:15.653121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7fa5d-e8af-45e6-802a-df51e2df142b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:15.668973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:15.702064 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 885/1757] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:15 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:15.717527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99022e24-a080-4156-b7ad-b7b25b60c96b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:15.723641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-99022e24-a080-4156-b7ad-b7b25b60c96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:15.879239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-68a7fa5d-e8af-45e6-802a-df51e2df142b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc3edbdc4a04378814ccb4bf4b63d53', 'request_id': 'req-68a7fa5d-e8af-45e6-802a-df51e2df142b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:15.912348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-68a7fa5d-e8af-45e6-802a-df51e2df142b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc3edbdc4a04378814ccb4bf4b63d53', 'request_id': 'req-68a7fa5d-e8af-45e6-802a-df51e2df142b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:15.925319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-68a7fa5d-e8af-45e6-802a-df51e2df142b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc3edbdc4a04378814ccb4bf4b63d53', 'request_id': 'req-68a7fa5d-e8af-45e6-802a-df51e2df142b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:15.950102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-68a7fa5d-e8af-45e6-802a-df51e2df142b admin admin] The token cache is being invalidate because project 1fc3edbdc4a04378814ccb4bf4b63d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:15.950865 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-68a7fa5d-e8af-45e6-802a-df51e2df142b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:15.951884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-68a7fa5d-e8af-45e6-802a-df51e2df142b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:15.958023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 873/1758] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:15 2022] DELETE /identity/v3/projects/1fc3edbdc4a04378814ccb4bf4b63d53 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:15.960199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820af7-2398-43bb-b4ca-5f847713cd88 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:15.969726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820af7-2398-43bb-b4ca-5f847713cd88 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:15.970517 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820af7-2398-43bb-b4ca-5f847713cd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:15.982280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99022e24-a080-4156-b7ad-b7b25b60c96b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:16.022991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ee820af7-2398-43bb-b4ca-5f847713cd88 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:16.024965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ee820af7-2398-43bb-b4ca-5f847713cd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:16.040548 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:16.112079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be635648-7851-4b20-ba97-fec9892edff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:16.112626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be635648-7851-4b20-ba97-fec9892edff4 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:16.112884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 874/1759] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:16.113373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be635648-7851-4b20-ba97-fec9892edff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:16.113373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be635648-7851-4b20-ba97-fec9892edff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:16.115714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-be635648-7851-4b20-ba97-fec9892edff4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:16.122132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adebd5-a119-4727-be8c-217572d5ed07 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:16.122430 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adebd5-a119-4727-be8c-217572d5ed07 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:16.122777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adebd5-a119-4727-be8c-217572d5ed07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:16.148906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f7adebd5-a119-4727-be8c-217572d5ed07 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:16.150352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f7adebd5-a119-4727-be8c-217572d5ed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:16.169410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 875/1760] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:16.170472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adebd5-a119-4727-be8c-217572d5ed07 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:16.210879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adebd5-a119-4727-be8c-217572d5ed07 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:16.233260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa80e96-6b12-4933-a696-2c28e8feb89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:16.234863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa80e96-6b12-4933-a696-2c28e8feb89c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:16.236161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa80e96-6b12-4933-a696-2c28e8feb89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:16.237322 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa80e96-6b12-4933-a696-2c28e8feb89c admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:16.238489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa80e96-6b12-4933-a696-2c28e8feb89c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:16.245154 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa80e96-6b12-4933-a696-2c28e8feb89c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:16.251597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa80e96-6b12-4933-a696-2c28e8feb89c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:16.325366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 876/1761] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:16.325366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb009f25-855e-49ca-a357-740949bfb114 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:16.325366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb009f25-855e-49ca-a357-740949bfb114 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:16.326996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb009f25-855e-49ca-a357-740949bfb114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:16.361232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be635648-7851-4b20-ba97-fec9892edff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:16.363158 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be635648-7851-4b20-ba97-fec9892edff4 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:16.376980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fb009f25-855e-49ca-a357-740949bfb114 None None] MFA Rules not processed for user `06a267cec6fb4dbea619f0a77b5674dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:16.379324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fb009f25-855e-49ca-a357-740949bfb114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:16.402013 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 886/1762] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:15 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:16.404964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be635648-7851-4b20-ba97-fec9892edff4 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:16.408292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-be635648-7851-4b20-ba97-fec9892edff4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:16.448256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be635648-7851-4b20-ba97-fec9892edff4 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:16.473047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:16.478268 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:16.481839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:16.482205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] PATH_INFO: `/v3/users/0b12e45fe00a4fb6bea6c5117f152833` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:16.486367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b12e45fe00a4fb6bea6c5117f152833)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:16.496449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:16.648352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 877/1763] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Jul 21 08:27:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:16.649611 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb009f25-855e-49ca-a357-740949bfb114 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:16.711650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb009f25-855e-49ca-a357-740949bfb114 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:16.735599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90f035-8185-4fa0-a986-fabc55668996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:16.736381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90f035-8185-4fa0-a986-fabc55668996 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:16.736814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90f035-8185-4fa0-a986-fabc55668996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:16.737446 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90f035-8185-4fa0-a986-fabc55668996 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:16.742805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90f035-8185-4fa0-a986-fabc55668996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:16.754643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b12e45fe00a4fb6bea6c5117f152833'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:16.757796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90f035-8185-4fa0-a986-fabc55668996 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:16.779474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b12e45fe00a4fb6bea6c5117f152833'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:16.805321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:16.858884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b12e45fe00a4fb6bea6c5117f152833'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:16.863489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 878/1764] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:16 2022] POST /identity/v3/projects => generated 357 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:16.864385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90f035-8185-4fa0-a986-fabc55668996 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:16.867098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b12e45fe00a4fb6bea6c5117f152833'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:16.868952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b12e45fe00a4fb6bea6c5117f152833'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:16.922645 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 887/1765] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:16 2022] DELETE /identity/v3/users/0b12e45fe00a4fb6bea6c5117f152833 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:16.922786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:16.925590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:17.035530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90f035-8185-4fa0-a986-fabc55668996 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:17.153302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:17.180908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ef715-2aaa-4cd1-9852-357b061a8d5e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:17.186615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576809d7-d802-4c22-b78b-9cde5ea98f87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:17.188295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576809d7-d802-4c22-b78b-9cde5ea98f87 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:17.188614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576809d7-d802-4c22-b78b-9cde5ea98f87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:17.188938 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576809d7-d802-4c22-b78b-9cde5ea98f87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:17.192254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-576809d7-d802-4c22-b78b-9cde5ea98f87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:17.258514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2c7dc-00ca-4a4e-bedd-a3137b769c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:17.259905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2c7dc-00ca-4a4e-bedd-a3137b769c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:17.260647 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2c7dc-00ca-4a4e-bedd-a3137b769c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:17.261181 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2c7dc-00ca-4a4e-bedd-a3137b769c29 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:17.263106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2c7dc-00ca-4a4e-bedd-a3137b769c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:17.274613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2c7dc-00ca-4a4e-bedd-a3137b769c29 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:17.345174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 879/1766] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:16 2022] POST /identity/v3/users => generated 279 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:17.350352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851808a1-a5c9-4d34-b31a-7f18173a6b24 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:17.353817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851808a1-a5c9-4d34-b31a-7f18173a6b24 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:17.354362 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851808a1-a5c9-4d34-b31a-7f18173a6b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:17.393068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-851808a1-a5c9-4d34-b31a-7f18173a6b24 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:17.394877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-851808a1-a5c9-4d34-b31a-7f18173a6b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:17.405296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 880/1767] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:17.409888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851808a1-a5c9-4d34-b31a-7f18173a6b24 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:17.412407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-851808a1-a5c9-4d34-b31a-7f18173a6b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:17.423294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576809d7-d802-4c22-b78b-9cde5ea98f87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:17.425412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576809d7-d802-4c22-b78b-9cde5ea98f87 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:17.442506 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 888/1768] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:17.444376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576809d7-d802-4c22-b78b-9cde5ea98f87 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:17.453941 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-576809d7-d802-4c22-b78b-9cde5ea98f87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:17.500793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576809d7-d802-4c22-b78b-9cde5ea98f87 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:17.533732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347077-0535-4fb5-804b-e9fbfd615c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:17.538160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347077-0535-4fb5-804b-e9fbfd615c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:17.539807 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347077-0535-4fb5-804b-e9fbfd615c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:17.541341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347077-0535-4fb5-804b-e9fbfd615c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:17.542148 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7347077-0535-4fb5-804b-e9fbfd615c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:17.543817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7347077-0535-4fb5-804b-e9fbfd615c2b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:17.606915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 889/1769] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:17.607833 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347077-0535-4fb5-804b-e9fbfd615c2b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:17.627392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851808a1-a5c9-4d34-b31a-7f18173a6b24 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:17.630381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b7347077-0535-4fb5-804b-e9fbfd615c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:17.654079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53aa58-efc8-49f1-a646-654a9588a034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:17.659700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53aa58-efc8-49f1-a646-654a9588a034 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:17.660156 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53aa58-efc8-49f1-a646-654a9588a034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:17.660758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53aa58-efc8-49f1-a646-654a9588a034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:17.672122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ca53aa58-efc8-49f1-a646-654a9588a034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:17.703483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347077-0535-4fb5-804b-e9fbfd615c2b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:17.709682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53aa58-efc8-49f1-a646-654a9588a034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:17.711743 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53aa58-efc8-49f1-a646-654a9588a034 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:17.720649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eec7e7-35de-4ae8-801c-3cb9442fae63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:17.726647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eec7e7-35de-4ae8-801c-3cb9442fae63 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:17.727569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eec7e7-35de-4ae8-801c-3cb9442fae63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:17.727865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eec7e7-35de-4ae8-801c-3cb9442fae63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:17.740418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 881/1770] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:17.741689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53aa58-efc8-49f1-a646-654a9588a034 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:17.781097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eec7e7-35de-4ae8-801c-3cb9442fae63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:17.784163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eec7e7-35de-4ae8-801c-3cb9442fae63 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:17.784884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53aa58-efc8-49f1-a646-654a9588a034 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:17.806186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34b53e-a9e6-4327-a243-473e924f57dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:17.807242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34b53e-a9e6-4327-a243-473e924f57dc admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:17.807744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34b53e-a9e6-4327-a243-473e924f57dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:17.808383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34b53e-a9e6-4327-a243-473e924f57dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:17.813459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34b53e-a9e6-4327-a243-473e924f57dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:17.815710 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34b53e-a9e6-4327-a243-473e924f57dc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:17.834708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 890/1771] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:17.848678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 882/1772] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:17.853980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eec7e7-35de-4ae8-801c-3cb9442fae63 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:17.883154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eec7e7-35de-4ae8-801c-3cb9442fae63 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:17.901117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69272c-9812-4d5e-a74f-a038bda17fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:17.904912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69272c-9812-4d5e-a74f-a038bda17fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:17.906199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69272c-9812-4d5e-a74f-a038bda17fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:17.907225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69272c-9812-4d5e-a74f-a038bda17fad admin admin] PATH_INFO: `/v3/projects/0eba41d34fde4bd0b11906f2546797c9/users/7123493be5a243e285ddb78c49c020a6/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:17.957794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69272c-9812-4d5e-a74f-a038bda17fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eba41d34fde4bd0b11906f2546797c9, user_id=7123493be5a243e285ddb78c49c020a6, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:17.968545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69272c-9812-4d5e-a74f-a038bda17fad admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:18.032788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb61380-e018-4a1e-876b-79143e753d95 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:18.033499 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb61380-e018-4a1e-876b-79143e753d95 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:18.035104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb61380-e018-4a1e-876b-79143e753d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:18.044103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 891/1773] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:17 2022] PUT /identity/v3/projects/0eba41d34fde4bd0b11906f2546797c9/users/7123493be5a243e285ddb78c49c020a6/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:18.139039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0bb61380-e018-4a1e-876b-79143e753d95 None None] MFA Rules not processed for user `7123493be5a243e285ddb78c49c020a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:18.148065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0bb61380-e018-4a1e-876b-79143e753d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:18.390480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 883/1774] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:18 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:18.395797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69272c-9812-4d5e-a74f-a038bda17fad admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:18.684100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:18.758499 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69272c-9812-4d5e-a74f-a038bda17fad admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:18.763471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eed8be-9768-4a0a-9fd8-659bdaece3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:18.764207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eed8be-9768-4a0a-9fd8-659bdaece3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:18.764589 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eed8be-9768-4a0a-9fd8-659bdaece3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:18.765543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eed8be-9768-4a0a-9fd8-659bdaece3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:18.766221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eed8be-9768-4a0a-9fd8-659bdaece3b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:18.768469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eed8be-9768-4a0a-9fd8-659bdaece3b0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:18.774549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb61380-e018-4a1e-876b-79143e753d95 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:18.776050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0bb61380-e018-4a1e-876b-79143e753d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:18.799425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb61380-e018-4a1e-876b-79143e753d95 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:18.827352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:18.828757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:18.829374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:18.829653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] PATH_INFO: `/v3/projects/f4f66b6ee09a47119611699e030ca277` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:18.831830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f66b6ee09a47119611699e030ca277)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:18.834046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:18.839830 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 892/1775] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:18 2022] POST /identity/v3/projects => generated 355 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:18.841443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eed8be-9768-4a0a-9fd8-659bdaece3b0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:18.963504 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:19.008240 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f66b6ee09a47119611699e030ca277', 'request_id': 'req-d23c0ec8-6779-4c71-a103-1f4024828253'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:19.034568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f66b6ee09a47119611699e030ca277', 'request_id': 'req-d23c0ec8-6779-4c71-a103-1f4024828253'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:19.045278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f66b6ee09a47119611699e030ca277', 'request_id': 'req-d23c0ec8-6779-4c71-a103-1f4024828253'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:19.055482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eed8be-9768-4a0a-9fd8-659bdaece3b0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:19.074893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] The token cache is being invalidate because project f4f66b6ee09a47119611699e030ca277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:19.081633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:19.083190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:19.095584 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 884/1776] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:18 2022] DELETE /identity/v3/projects/f4f66b6ee09a47119611699e030ca277 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:19.100078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:19.102727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:19.248062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c319ee9-7f45-499f-8aa4-6d0f0e94a692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:19.248858 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c319ee9-7f45-499f-8aa4-6d0f0e94a692 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:19.249144 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c319ee9-7f45-499f-8aa4-6d0f0e94a692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:19.249419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c319ee9-7f45-499f-8aa4-6d0f0e94a692 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:19.252053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c319ee9-7f45-499f-8aa4-6d0f0e94a692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:19.255476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c319ee9-7f45-499f-8aa4-6d0f0e94a692 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:19.260225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c0ec8-6779-4c71-a103-1f4024828253 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:19.272134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:19.273315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:19.273581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:19.273859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] PATH_INFO: `/v3/users/04eccad969594b13a8db9c72b2b732b1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:19.275352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] RBAC: Authorizing `identity:delete_user(user_id=04eccad969594b13a8db9c72b2b732b1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:19.278739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:19.297671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 893/1777] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:18 2022] POST /identity/v3/users => generated 284 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:19.302096 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c319ee9-7f45-499f-8aa4-6d0f0e94a692 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:19.309592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3c319ee9-7f45-499f-8aa4-6d0f0e94a692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:19.332566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c319ee9-7f45-499f-8aa4-6d0f0e94a692 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:19.351943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99607054-7fe8-4306-b20a-0d8cd84f5f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:19.352691 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99607054-7fe8-4306-b20a-0d8cd84f5f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:19.353018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99607054-7fe8-4306-b20a-0d8cd84f5f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:19.353299 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99607054-7fe8-4306-b20a-0d8cd84f5f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:19.354747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99607054-7fe8-4306-b20a-0d8cd84f5f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:19.361680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99607054-7fe8-4306-b20a-0d8cd84f5f3d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:19.376835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04eccad969594b13a8db9c72b2b732b1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:19.387245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 894/1778] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:27:19.392201 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99607054-7fe8-4306-b20a-0d8cd84f5f3d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:19.396917 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04eccad969594b13a8db9c72b2b732b1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:19.414192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99607054-7fe8-4306-b20a-0d8cd84f5f3d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:19.427283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ececae-5d78-4634-a63f-3717b3fe5a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:19.428224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ececae-5d78-4634-a63f-3717b3fe5a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:19.428529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ececae-5d78-4634-a63f-3717b3fe5a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:19.428815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ececae-5d78-4634-a63f-3717b3fe5a6c admin admin] PATH_INFO: `/v3/projects/89577944e9af432b8788a4dfe226fe46/users/d6fa886f023c4be8ad30c732a7f00f11/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:19.431504 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04eccad969594b13a8db9c72b2b732b1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:19.458930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04eccad969594b13a8db9c72b2b732b1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:19.459755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04eccad969594b13a8db9c72b2b732b1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:19.466692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ececae-5d78-4634-a63f-3717b3fe5a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=89577944e9af432b8788a4dfe226fe46, user_id=d6fa886f023c4be8ad30c732a7f00f11, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:19.469380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 885/1779] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:19 2022] DELETE /identity/v3/users/04eccad969594b13a8db9c72b2b732b1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:19.469505 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ececae-5d78-4634-a63f-3717b3fe5a6c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:19.493978 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 895/1780] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:19 2022] PUT /identity/v3/projects/89577944e9af432b8788a4dfe226fe46/users/d6fa886f023c4be8ad30c732a7f00f11/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:19.495300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:19.499434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:19.562906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:19.641766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16838-b90c-43cc-b00e-801e765f785a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:19.731327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75993a9a-f0e9-4881-b6b7-ad5ddcaee7b8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:19.733224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75993a9a-f0e9-4881-b6b7-ad5ddcaee7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:19.734810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75993a9a-f0e9-4881-b6b7-ad5ddcaee7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:19.874550 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-75993a9a-f0e9-4881-b6b7-ad5ddcaee7b8 None None] MFA Rules not processed for user `2fc696f590374358aee6e70563219321`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:19.881504 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-75993a9a-f0e9-4881-b6b7-ad5ddcaee7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:19.965254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36970eee-70c2-4d3b-94e3-19488d304543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:19.965987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36970eee-70c2-4d3b-94e3-19488d304543 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:19.966297 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36970eee-70c2-4d3b-94e3-19488d304543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:19.966577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36970eee-70c2-4d3b-94e3-19488d304543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:19.967497 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36970eee-70c2-4d3b-94e3-19488d304543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:19.973784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36970eee-70c2-4d3b-94e3-19488d304543 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:19.984670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:20.016358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 886/1781] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 522 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:20.021496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36970eee-70c2-4d3b-94e3-19488d304543 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:20.046991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36970eee-70c2-4d3b-94e3-19488d304543 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:20.063115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da16fa-4f4a-459f-8816-e1f36bd4ad5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:20.064262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da16fa-4f4a-459f-8816-e1f36bd4ad5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:20.064744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da16fa-4f4a-459f-8816-e1f36bd4ad5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:20.064869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da16fa-4f4a-459f-8816-e1f36bd4ad5e admin admin] PATH_INFO: `/v3/projects/89577944e9af432b8788a4dfe226fe46/users/d6fa886f023c4be8ad30c732a7f00f11/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:20.070178 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da16fa-4f4a-459f-8816-e1f36bd4ad5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89577944e9af432b8788a4dfe226fe46, user_id=d6fa886f023c4be8ad30c732a7f00f11, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:20.073158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da16fa-4f4a-459f-8816-e1f36bd4ad5e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:20.120657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 887/1782] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:20 2022] PUT /identity/v3/projects/89577944e9af432b8788a4dfe226fe46/users/d6fa886f023c4be8ad30c732a7f00f11/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:20.128094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2798ab1-3e10-4bbc-b727-cbc795de5791 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:20.128432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2798ab1-3e10-4bbc-b727-cbc795de5791 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:20.128751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2798ab1-3e10-4bbc-b727-cbc795de5791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:20.237268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e2798ab1-3e10-4bbc-b727-cbc795de5791 None None] MFA Rules not processed for user `d6fa886f023c4be8ad30c732a7f00f11`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:20.240637 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e2798ab1-3e10-4bbc-b727-cbc795de5791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:20.250943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 896/1783] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:20.253434 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75993a9a-f0e9-4881-b6b7-ad5ddcaee7b8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:20.260075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-75993a9a-f0e9-4881-b6b7-ad5ddcaee7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:20.293242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75993a9a-f0e9-4881-b6b7-ad5ddcaee7b8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:20.447741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:20.448800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:20.449683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:20.449996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] PATH_INFO: `/v3/users/fe8f23790d64477384cd77c002db1bfd` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:20.452147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8f23790d64477384cd77c002db1bfd)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:20.461932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:20.507686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 888/1784] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:20 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:20.508814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2798ab1-3e10-4bbc-b727-cbc795de5791 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:20.513451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e2798ab1-3e10-4bbc-b727-cbc795de5791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:20.584565 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8f23790d64477384cd77c002db1bfd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:20.602277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8f23790d64477384cd77c002db1bfd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:20.668307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8f23790d64477384cd77c002db1bfd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:20.670436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8f23790d64477384cd77c002db1bfd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:20.692964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8f23790d64477384cd77c002db1bfd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:20.733143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 897/1785] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:20 2022] DELETE /identity/v3/users/fe8f23790d64477384cd77c002db1bfd => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:20.735609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:20.741224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:20.759365 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:20.806596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2798ab1-3e10-4bbc-b727-cbc795de5791 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:20.869094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:20.914274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52183a28-db87-4c0d-84df-d439fcb8d69c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:20.923099 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157f147-1111-43e5-9f60-4a1933b5096f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:20.924132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157f147-1111-43e5-9f60-4a1933b5096f service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:20.924446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157f147-1111-43e5-9f60-4a1933b5096f service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:20.924829 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157f147-1111-43e5-9f60-4a1933b5096f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:20.927761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9157f147-1111-43e5-9f60-4a1933b5096f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:21.029962 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034deb4-a9e4-476f-bb7c-a9771c6e03b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:21.030843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034deb4-a9e4-476f-bb7c-a9771c6e03b6 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:21.031131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034deb4-a9e4-476f-bb7c-a9771c6e03b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:21.031411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034deb4-a9e4-476f-bb7c-a9771c6e03b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:21.045317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9034deb4-a9e4-476f-bb7c-a9771c6e03b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:21.170465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157f147-1111-43e5-9f60-4a1933b5096f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:21.179841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157f147-1111-43e5-9f60-4a1933b5096f service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:21.207684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 898/1786] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:20 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:21.210918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157f147-1111-43e5-9f60-4a1933b5096f service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:21.216164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9157f147-1111-43e5-9f60-4a1933b5096f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:21.301167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034deb4-a9e4-476f-bb7c-a9771c6e03b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:21.303129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034deb4-a9e4-476f-bb7c-a9771c6e03b6 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:21.315981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 889/1787] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:21.317844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684e88-c84b-40a0-952a-b094756c72d2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:21.318168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684e88-c84b-40a0-952a-b094756c72d2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:21.318512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684e88-c84b-40a0-952a-b094756c72d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:21.352608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-79684e88-c84b-40a0-952a-b094756c72d2 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:21.355682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-79684e88-c84b-40a0-952a-b094756c72d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:21.571600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157f147-1111-43e5-9f60-4a1933b5096f service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:21.608324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:21.609433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:21.609718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:21.609997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] PATH_INFO: `/v3/projects/d84824c091aa4684934a24c5c1b69c69` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:21.618129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 890/1788] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:21.625454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79684e88-c84b-40a0-952a-b094756c72d2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:21.629130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84824c091aa4684934a24c5c1b69c69)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:21.631677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:21.704960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79684e88-c84b-40a0-952a-b094756c72d2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:21.720215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442ae4-4e39-4274-8bd3-f0e5c9e5b135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:21.721081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442ae4-4e39-4274-8bd3-f0e5c9e5b135 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:21.721463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442ae4-4e39-4274-8bd3-f0e5c9e5b135 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:21.721707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442ae4-4e39-4274-8bd3-f0e5c9e5b135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:21.727607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e5442ae4-4e39-4274-8bd3-f0e5c9e5b135 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:21.856257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:21.961552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84824c091aa4684934a24c5c1b69c69', 'request_id': 'req-49835491-6592-4c6d-983e-ef23a85568e7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:21.983866 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84824c091aa4684934a24c5c1b69c69', 'request_id': 'req-49835491-6592-4c6d-983e-ef23a85568e7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:22.003896 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84824c091aa4684934a24c5c1b69c69', 'request_id': 'req-49835491-6592-4c6d-983e-ef23a85568e7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:22.044372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] The token cache is being invalidate because project d84824c091aa4684934a24c5c1b69c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:22.046930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:22.048508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:22.055686 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 899/1789] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:21 2022] DELETE /identity/v3/projects/d84824c091aa4684934a24c5c1b69c69 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:22.061176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:22.066511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:22.086187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442ae4-4e39-4274-8bd3-f0e5c9e5b135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:22.087700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442ae4-4e39-4274-8bd3-f0e5c9e5b135 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:22.147439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 891/1790] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:21 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:22.158587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be4e1e-15e7-4ca7-9a5c-313f4b48f34c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:22.159149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be4e1e-15e7-4ca7-9a5c-313f4b48f34c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:22.159503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be4e1e-15e7-4ca7-9a5c-313f4b48f34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:22.234460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:22.279842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c1be4e1e-15e7-4ca7-9a5c-313f4b48f34c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:22.281239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c1be4e1e-15e7-4ca7-9a5c-313f4b48f34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:22.440936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49835491-6592-4c6d-983e-ef23a85568e7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:22.473038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb714d-768d-4521-a0e5-3f519dfa8980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:22.476808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb714d-768d-4521-a0e5-3f519dfa8980 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:22.477102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb714d-768d-4521-a0e5-3f519dfa8980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:22.481231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb714d-768d-4521-a0e5-3f519dfa8980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:22.492278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-60eb714d-768d-4521-a0e5-3f519dfa8980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:22.581892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 892/1791] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:22.588316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feccdf-ac8d-4544-9adc-28e281c0183e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:22.588642 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feccdf-ac8d-4544-9adc-28e281c0183e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:22.588928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feccdf-ac8d-4544-9adc-28e281c0183e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:22.654757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-99feccdf-ac8d-4544-9adc-28e281c0183e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:22.656298 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-99feccdf-ac8d-4544-9adc-28e281c0183e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:22.689948 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 893/1792] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:22.696091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99feccdf-ac8d-4544-9adc-28e281c0183e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:22.717257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99feccdf-ac8d-4544-9adc-28e281c0183e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:22.737472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935ee63-2ca2-4d84-8e48-99cf82a24940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:22.739203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935ee63-2ca2-4d84-8e48-99cf82a24940 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:22.739511 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935ee63-2ca2-4d84-8e48-99cf82a24940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:22.739787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935ee63-2ca2-4d84-8e48-99cf82a24940 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:22.740887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935ee63-2ca2-4d84-8e48-99cf82a24940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:22.741200 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935ee63-2ca2-4d84-8e48-99cf82a24940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:22.743074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935ee63-2ca2-4d84-8e48-99cf82a24940 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:22.787243 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 894/1793] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:27:22.793800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935ee63-2ca2-4d84-8e48-99cf82a24940 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:22.814633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935ee63-2ca2-4d84-8e48-99cf82a24940 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:22.838995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4bee7-c2b3-4ec3-bfeb-1e39d9a4375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:22.839941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4bee7-c2b3-4ec3-bfeb-1e39d9a4375c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:22.840273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4bee7-c2b3-4ec3-bfeb-1e39d9a4375c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:22.840757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4bee7-c2b3-4ec3-bfeb-1e39d9a4375c admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:22.841504 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4bee7-c2b3-4ec3-bfeb-1e39d9a4375c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:22.846438 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4bee7-c2b3-4ec3-bfeb-1e39d9a4375c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:22.950439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 895/1794] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:22 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:27:22.955147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4bee7-c2b3-4ec3-bfeb-1e39d9a4375c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:22.973413 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb714d-768d-4521-a0e5-3f519dfa8980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:22.985654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb714d-768d-4521-a0e5-3f519dfa8980 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:23.058372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 900/1795] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 998 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:23.223059 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4bee7-c2b3-4ec3-bfeb-1e39d9a4375c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:23.250808 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4ee4a-3446-4f97-8bee-41da8c75fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:23.252045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4ee4a-3446-4f97-8bee-41da8c75fff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:23.252334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4ee4a-3446-4f97-8bee-41da8c75fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:23.252637 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4ee4a-3446-4f97-8bee-41da8c75fff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:23.253372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4ee4a-3446-4f97-8bee-41da8c75fff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:23.255578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4ee4a-3446-4f97-8bee-41da8c75fff7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:23.315897 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 896/1796] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:22 2022] POST /identity/v3/users => generated 282 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:27:23.319956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb714d-768d-4521-a0e5-3f519dfa8980 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:23.337753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb714d-768d-4521-a0e5-3f519dfa8980 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:23.364648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96456-8972-4e4f-ba7f-8df69659ef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:23.365974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96456-8972-4e4f-ba7f-8df69659ef4b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:23.366538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96456-8972-4e4f-ba7f-8df69659ef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:23.367135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96456-8972-4e4f-ba7f-8df69659ef4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:23.370061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a96456-8972-4e4f-ba7f-8df69659ef4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:23.383831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a96456-8972-4e4f-ba7f-8df69659ef4b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:23.436754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4ee4a-3446-4f97-8bee-41da8c75fff7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:23.460655 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 901/1797] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:23.463624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4ee4a-3446-4f97-8bee-41da8c75fff7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:23.486660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6390ddc-69de-4c3f-b638-4fdfacee6c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:23.487379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6390ddc-69de-4c3f-b638-4fdfacee6c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:23.487658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6390ddc-69de-4c3f-b638-4fdfacee6c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:23.487924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6390ddc-69de-4c3f-b638-4fdfacee6c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:23.488746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6390ddc-69de-4c3f-b638-4fdfacee6c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:23.490519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6390ddc-69de-4c3f-b638-4fdfacee6c53 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:23.529653 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96456-8972-4e4f-ba7f-8df69659ef4b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:23.536329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 897/1798] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:23.548898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96456-8972-4e4f-ba7f-8df69659ef4b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:23.563072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e7f8c-6577-44c2-b366-6acc1e21c73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:23.564024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e7f8c-6577-44c2-b366-6acc1e21c73c admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:23.564304 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e7f8c-6577-44c2-b366-6acc1e21c73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:23.564622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e7f8c-6577-44c2-b366-6acc1e21c73c admin admin] PATH_INFO: `/v3/projects/1ad07fcdbb5e4dc08989dce6ab4913b2/users/9faf5c90b0a3487fa35f4462f7b7f7e5/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:23.622916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e7f8c-6577-44c2-b366-6acc1e21c73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad07fcdbb5e4dc08989dce6ab4913b2, user_id=9faf5c90b0a3487fa35f4462f7b7f7e5, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:23.629918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e7f8c-6577-44c2-b366-6acc1e21c73c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:23.660304 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4be1b-64ce-4bf9-8bea-769f9f6bff1f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:23.660923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4be1b-64ce-4bf9-8bea-769f9f6bff1f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:23.660923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4be1b-64ce-4bf9-8bea-769f9f6bff1f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:23.662428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 898/1799] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:27:23.678145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 902/1800] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:23 2022] PUT /identity/v3/projects/1ad07fcdbb5e4dc08989dce6ab4913b2/users/9faf5c90b0a3487fa35f4462f7b7f7e5/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:23.692943 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39b12f-e642-4422-8ee0-f631d9464096 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:23.693236 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39b12f-e642-4422-8ee0-f631d9464096 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:23.693499 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39b12f-e642-4422-8ee0-f631d9464096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:23.702790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:23.797434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4f39b12f-e642-4422-8ee0-f631d9464096 None None] MFA Rules not processed for user `9faf5c90b0a3487fa35f4462f7b7f7e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:23.813534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4f39b12f-e642-4422-8ee0-f631d9464096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:23.952317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc315-6534-4ac3-b5d8-32296c2c3a87 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:23.952633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc315-6534-4ac3-b5d8-32296c2c3a87 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:23.953019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc315-6534-4ac3-b5d8-32296c2c3a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:24.039815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f45dc315-6534-4ac3-b5d8-32296c2c3a87 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:24.043851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f45dc315-6534-4ac3-b5d8-32296c2c3a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:24.074965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 899/1801] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:23 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:24.092851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39b12f-e642-4422-8ee0-f631d9464096 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:24.320699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 903/1802] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:27:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:24.325538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39b12f-e642-4422-8ee0-f631d9464096 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:24.344122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b40da-16fb-461c-b6b9-04e76e3277a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:24.344973 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b40da-16fb-461c-b6b9-04e76e3277a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:24.345425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b40da-16fb-461c-b6b9-04e76e3277a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:24.345688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b40da-16fb-461c-b6b9-04e76e3277a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:24.346606 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b40da-16fb-461c-b6b9-04e76e3277a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:24.355665 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b40da-16fb-461c-b6b9-04e76e3277a7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:24.409002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc315-6534-4ac3-b5d8-32296c2c3a87 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:24.414709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 900/1803] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:24 2022] POST /identity/v3/projects => generated 361 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:24.427139 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc315-6534-4ac3-b5d8-32296c2c3a87 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:24.462501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b40da-16fb-461c-b6b9-04e76e3277a7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:24.464410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b31b40da-16fb-461c-b6b9-04e76e3277a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:24.511719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:24.600927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92cc0d-e4ae-4c4f-a292-e2439deb60cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:24.602792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92cc0d-e4ae-4c4f-a292-e2439deb60cd admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:24.604007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92cc0d-e4ae-4c4f-a292-e2439deb60cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:24.604479 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92cc0d-e4ae-4c4f-a292-e2439deb60cd admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:24.606863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92cc0d-e4ae-4c4f-a292-e2439deb60cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:24.611165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92cc0d-e4ae-4c4f-a292-e2439deb60cd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:24.659537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b40da-16fb-461c-b6b9-04e76e3277a7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:24.665852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 904/1804] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:24 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:24.666904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92cc0d-e4ae-4c4f-a292-e2439deb60cd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:24.679189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd61c4-0c3a-42b8-a5c5-3f98af605264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:24.679833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd61c4-0c3a-42b8-a5c5-3f98af605264 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:24.682972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd61c4-0c3a-42b8-a5c5-3f98af605264 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:24.682972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd61c4-0c3a-42b8-a5c5-3f98af605264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:24.688209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92cc0d-e4ae-4c4f-a292-e2439deb60cd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:24.701950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9e8b-6d68-44c6-8d0e-96c151e4b62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:24.703806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9e8b-6d68-44c6-8d0e-96c151e4b62a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:24.704085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9e8b-6d68-44c6-8d0e-96c151e4b62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:24.704357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9e8b-6d68-44c6-8d0e-96c151e4b62a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:24.705121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b9e8b-6d68-44c6-8d0e-96c151e4b62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:24.706537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd61c4-0c3a-42b8-a5c5-3f98af605264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:24.709495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd61c4-0c3a-42b8-a5c5-3f98af605264 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:24.712400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b9e8b-6d68-44c6-8d0e-96c151e4b62a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:24.751829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 901/1805] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:27:24.753175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 905/1806] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:24.754355 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd61c4-0c3a-42b8-a5c5-3f98af605264 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:24.768580 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:24.780664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd61c4-0c3a-42b8-a5c5-3f98af605264 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:24.793104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3dfa2-454d-48d6-83be-ceb8e4a25a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:24.796013 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3dfa2-454d-48d6-83be-ceb8e4a25a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:24.796189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3dfa2-454d-48d6-83be-ceb8e4a25a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:24.797650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3dfa2-454d-48d6-83be-ceb8e4a25a21 admin admin] PATH_INFO: `/v3/projects/198e666276d14373b5a6061e1f5a9ccc/users/ad74c3cb2e764cef8de021e28af23e69/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:24.807731 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9e8b-6d68-44c6-8d0e-96c151e4b62a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:24.812554 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b34b9e8b-6d68-44c6-8d0e-96c151e4b62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:24.851336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9e8b-6d68-44c6-8d0e-96c151e4b62a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:24.875802 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:24.876758 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:24.877028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:24.880806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] PATH_INFO: `/v3/projects/ea64c92edd4241b0a0671b55ad7ebd6c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:24.885885 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3dfa2-454d-48d6-83be-ceb8e4a25a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198e666276d14373b5a6061e1f5a9ccc, user_id=ad74c3cb2e764cef8de021e28af23e69, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:24.887979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea64c92edd4241b0a0671b55ad7ebd6c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:24.892725 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3dfa2-454d-48d6-83be-ceb8e4a25a21 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:24.896097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:24.940147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 902/1807] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:24 2022] PUT /identity/v3/projects/198e666276d14373b5a6061e1f5a9ccc/users/ad74c3cb2e764cef8de021e28af23e69/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:24.944597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3dfa2-454d-48d6-83be-ceb8e4a25a21 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:25.052076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea64c92edd4241b0a0671b55ad7ebd6c', 'request_id': 'req-13d843ee-0801-4d26-9b94-79d297349a25'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.090218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea64c92edd4241b0a0671b55ad7ebd6c', 'request_id': 'req-13d843ee-0801-4d26-9b94-79d297349a25'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.122911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea64c92edd4241b0a0671b55ad7ebd6c', 'request_id': 'req-13d843ee-0801-4d26-9b94-79d297349a25'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.147440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3dfa2-454d-48d6-83be-ceb8e4a25a21 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:25.176711 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] The token cache is being invalidate because project ea64c92edd4241b0a0671b55ad7ebd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:25.178189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.181231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.184310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 906/1808] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:24 2022] DELETE /identity/v3/projects/ea64c92edd4241b0a0671b55ad7ebd6c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:25.190562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:25.197385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:25.334113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e395d01-9d30-492b-9659-1d9ea74c4d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:25.336137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e395d01-9d30-492b-9659-1d9ea74c4d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:25.337791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e395d01-9d30-492b-9659-1d9ea74c4d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:25.338269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e395d01-9d30-492b-9659-1d9ea74c4d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:25.339197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e395d01-9d30-492b-9659-1d9ea74c4d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:25.342596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e395d01-9d30-492b-9659-1d9ea74c4d01 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:25.367532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 903/1809] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:25.370671 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e395d01-9d30-492b-9659-1d9ea74c4d01 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:25.376179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3e395d01-9d30-492b-9659-1d9ea74c4d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:25.411266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e395d01-9d30-492b-9659-1d9ea74c4d01 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:25.427969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6a693-18ee-4301-a19f-815de34b7e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:25.429684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a693-18ee-4301-a19f-815de34b7e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:25.429684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a693-18ee-4301-a19f-815de34b7e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:25.429684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a693-18ee-4301-a19f-815de34b7e43 admin admin] PATH_INFO: `/v3/projects/198e666276d14373b5a6061e1f5a9ccc/users/ad74c3cb2e764cef8de021e28af23e69/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:25.451325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6a693-18ee-4301-a19f-815de34b7e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198e666276d14373b5a6061e1f5a9ccc, user_id=ad74c3cb2e764cef8de021e28af23e69, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:25.454295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6a693-18ee-4301-a19f-815de34b7e43 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:25.518972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d843ee-0801-4d26-9b94-79d297349a25 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:25.522320 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 904/1810] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:25 2022] PUT /identity/v3/projects/198e666276d14373b5a6061e1f5a9ccc/users/ad74c3cb2e764cef8de021e28af23e69/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:25.523546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6a693-18ee-4301-a19f-815de34b7e43 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:25.526344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2aa6a693-18ee-4301-a19f-815de34b7e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:25.618386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6a693-18ee-4301-a19f-815de34b7e43 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:25.623573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741513a-e713-41a7-b6fc-2d0420215265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:25.624482 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741513a-e713-41a7-b6fc-2d0420215265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:25.624964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741513a-e713-41a7-b6fc-2d0420215265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:25.625247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741513a-e713-41a7-b6fc-2d0420215265 admin admin] PATH_INFO: `/v3/users/03b883c981824716a680c7cd6aed0c60` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:25.626517 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741513a-e713-41a7-b6fc-2d0420215265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b883c981824716a680c7cd6aed0c60)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:25.628904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741513a-e713-41a7-b6fc-2d0420215265 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:25.644695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:25.647571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:25.712171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4741513a-e713-41a7-b6fc-2d0420215265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b883c981824716a680c7cd6aed0c60'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.730410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4741513a-e713-41a7-b6fc-2d0420215265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b883c981824716a680c7cd6aed0c60'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.733272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b66d3-af6c-4e1e-9a74-04432bc2be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:25.734265 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b66d3-af6c-4e1e-9a74-04432bc2be5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:25.734552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b66d3-af6c-4e1e-9a74-04432bc2be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:25.734831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b66d3-af6c-4e1e-9a74-04432bc2be5d admin admin] PATH_INFO: `/v3/users/d7f93a8eccf94cdb8b9cbc883760c68c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:25.744647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b66d3-af6c-4e1e-9a74-04432bc2be5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f93a8eccf94cdb8b9cbc883760c68c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:25.748677 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4741513a-e713-41a7-b6fc-2d0420215265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b883c981824716a680c7cd6aed0c60'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.755007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b66d3-af6c-4e1e-9a74-04432bc2be5d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:25.771859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4741513a-e713-41a7-b6fc-2d0420215265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b883c981824716a680c7cd6aed0c60'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.773298 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4741513a-e713-41a7-b6fc-2d0420215265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b883c981824716a680c7cd6aed0c60'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.790893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 905/1811] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:25 2022] DELETE /identity/v3/users/03b883c981824716a680c7cd6aed0c60 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:25.798483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625fad9-a466-4cf6-8f3e-8c1b188b4aca None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:25.799230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625fad9-a466-4cf6-8f3e-8c1b188b4aca None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:25.799927 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625fad9-a466-4cf6-8f3e-8c1b188b4aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:25.862239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3625fad9-a466-4cf6-8f3e-8c1b188b4aca None None] MFA Rules not processed for user `ad74c3cb2e764cef8de021e28af23e69`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:25.864431 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3625fad9-a466-4cf6-8f3e-8c1b188b4aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:25.869721 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7c2b66d3-af6c-4e1e-9a74-04432bc2be5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f93a8eccf94cdb8b9cbc883760c68c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.884764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7c2b66d3-af6c-4e1e-9a74-04432bc2be5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f93a8eccf94cdb8b9cbc883760c68c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.909478 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7c2b66d3-af6c-4e1e-9a74-04432bc2be5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f93a8eccf94cdb8b9cbc883760c68c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.911037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7c2b66d3-af6c-4e1e-9a74-04432bc2be5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f93a8eccf94cdb8b9cbc883760c68c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.912528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7c2b66d3-af6c-4e1e-9a74-04432bc2be5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f93a8eccf94cdb8b9cbc883760c68c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:25.951443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 907/1812] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:25 2022] DELETE /identity/v3/users/d7f93a8eccf94cdb8b9cbc883760c68c => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:25.953255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35eb42-17ab-4745-8ddd-90590549edf5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:25.953596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35eb42-17ab-4745-8ddd-90590549edf5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:25.953879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35eb42-17ab-4745-8ddd-90590549edf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:26.005621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6f35eb42-17ab-4745-8ddd-90590549edf5 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:26.009732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6f35eb42-17ab-4745-8ddd-90590549edf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:26.081191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 906/1813] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:25 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:26.084993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625fad9-a466-4cf6-8f3e-8c1b188b4aca None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:26.090662 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3625fad9-a466-4cf6-8f3e-8c1b188b4aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:26.204630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 908/1814] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:26.281250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35eb42-17ab-4745-8ddd-90590549edf5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:26.282837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6f35eb42-17ab-4745-8ddd-90590549edf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:26.308211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625fad9-a466-4cf6-8f3e-8c1b188b4aca None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:26.394897 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:26.493730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35eb42-17ab-4745-8ddd-90590549edf5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:26.495009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec74a-9ca2-4cdf-8d49-87a9ba26ae02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:26.495888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec74a-9ca2-4cdf-8d49-87a9ba26ae02 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:26.497846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec74a-9ca2-4cdf-8d49-87a9ba26ae02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:26.498339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec74a-9ca2-4cdf-8d49-87a9ba26ae02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:26.513662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749b930-f6fa-4711-9141-cdaf34d16f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:26.518234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749b930-f6fa-4711-9141-cdaf34d16f8e service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:26.518522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749b930-f6fa-4711-9141-cdaf34d16f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:26.518797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749b930-f6fa-4711-9141-cdaf34d16f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:26.574611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749b930-f6fa-4711-9141-cdaf34d16f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:26.577403 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749b930-f6fa-4711-9141-cdaf34d16f8e service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:26.596568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:26.609121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 909/1815] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:26.680155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec74a-9ca2-4cdf-8d49-87a9ba26ae02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:26.682264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec74a-9ca2-4cdf-8d49-87a9ba26ae02 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:26.702171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 907/1816] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:26 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:26.876856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749b930-f6fa-4711-9141-cdaf34d16f8e service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:26.888261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749b930-f6fa-4711-9141-cdaf34d16f8e service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:26.896247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9318-79fb-4516-96dd-921f56a91ef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:26.897287 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9318-79fb-4516-96dd-921f56a91ef4 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:26.897782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9318-79fb-4516-96dd-921f56a91ef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:26.898228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9318-79fb-4516-96dd-921f56a91ef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:26.901376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-33cb9318-79fb-4516-96dd-921f56a91ef4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:27.096748 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb9318-79fb-4516-96dd-921f56a91ef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:27.100654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb9318-79fb-4516-96dd-921f56a91ef4 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:27.154071 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 910/1817] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:26 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:27.981338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30463739-f23e-4507-9d06-fb9731afa76d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:27.981951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30463739-f23e-4507-9d06-fb9731afa76d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:27.981951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30463739-f23e-4507-9d06-fb9731afa76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:28.106756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-30463739-f23e-4507-9d06-fb9731afa76d None None] MFA Rules not processed for user `402c84b80e4b4996af901e79bf82c4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:28.117286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-30463739-f23e-4507-9d06-fb9731afa76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:28.180998 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9318-79fb-4516-96dd-921f56a91ef4 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:28.183441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-33cb9318-79fb-4516-96dd-921f56a91ef4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:28.223687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9318-79fb-4516-96dd-921f56a91ef4 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:28.241803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:28.245388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:28.245723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:28.246008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a admin admin] PATH_INFO: `/v3/projects/598cbfa473ac4e4cae373547bd8872fc` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:28.254808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a admin admin] RBAC: Authorizing `identity:delete_project(project_id=598cbfa473ac4e4cae373547bd8872fc)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:28.265482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:28.359992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 908/1818] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:28.430525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598cbfa473ac4e4cae373547bd8872fc', 'request_id': 'req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:28.451966 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598cbfa473ac4e4cae373547bd8872fc', 'request_id': 'req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:28.466367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598cbfa473ac4e4cae373547bd8872fc', 'request_id': 'req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:28.504795 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a admin admin] The token cache is being invalidate because project 598cbfa473ac4e4cae373547bd8872fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:28.505135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:28.508562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-78702d9b-b2fa-43ca-9e2f-9ec493e8905a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:28.514378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 911/1819] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:28 2022] DELETE /identity/v3/projects/598cbfa473ac4e4cae373547bd8872fc => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:28.518938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30463739-f23e-4507-9d06-fb9731afa76d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:28.545755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30463739-f23e-4507-9d06-fb9731afa76d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:28.552684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22487c-50b3-4de7-8372-3d8284fa8208 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:28.553159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22487c-50b3-4de7-8372-3d8284fa8208 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:28.553694 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22487c-50b3-4de7-8372-3d8284fa8208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:28.616469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9c22487c-50b3-4de7-8372-3d8284fa8208 None None] MFA Rules not processed for user `2fc696f590374358aee6e70563219321`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:28.622708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9c22487c-50b3-4de7-8372-3d8284fa8208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:28.650452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:28.651444 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:28.651791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:28.652190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] PATH_INFO: `/v3/users/63ad5c3c006e403e84e0fdd3e42bc0c8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:28.653539 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ad5c3c006e403e84e0fdd3e42bc0c8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:28.655703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:28.670766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:28.750553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ad5c3c006e403e84e0fdd3e42bc0c8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:28.768509 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ad5c3c006e403e84e0fdd3e42bc0c8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:28.788543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ad5c3c006e403e84e0fdd3e42bc0c8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:28.799686 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 912/1820] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:28.800862 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22487c-50b3-4de7-8372-3d8284fa8208 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:28.807729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9c22487c-50b3-4de7-8372-3d8284fa8208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:28.820434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ad5c3c006e403e84e0fdd3e42bc0c8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:28.821858 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ad5c3c006e403e84e0fdd3e42bc0c8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:28.833383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 909/1821] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:28 2022] DELETE /identity/v3/users/63ad5c3c006e403e84e0fdd3e42bc0c8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:28.855859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:28.974373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22487c-50b3-4de7-8372-3d8284fa8208 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:28.995069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:28.996791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:29.180152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90ae47-9d94-445d-a226-6726b8aa1dc4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:29.197279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037380c-f493-45b7-8493-0af249eab273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:29.198235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037380c-f493-45b7-8493-0af249eab273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:29.198554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037380c-f493-45b7-8493-0af249eab273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:29.198994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037380c-f493-45b7-8493-0af249eab273 admin admin] PATH_INFO: `/v3/projects/5786656a30fa4762ad6e9ceb49eccc78` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:29.201140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037380c-f493-45b7-8493-0af249eab273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5786656a30fa4762ad6e9ceb49eccc78)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:29.203354 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037380c-f493-45b7-8493-0af249eab273 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:29.274663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbf4b1-d938-4c0d-92e8-aa9157d1b152 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:29.279684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbf4b1-d938-4c0d-92e8-aa9157d1b152 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:29.279901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbf4b1-d938-4c0d-92e8-aa9157d1b152 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:29.281175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbf4b1-d938-4c0d-92e8-aa9157d1b152 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:29.286770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-64bbf4b1-d938-4c0d-92e8-aa9157d1b152 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:29.341075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3037380c-f493-45b7-8493-0af249eab273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5786656a30fa4762ad6e9ceb49eccc78', 'request_id': 'req-3037380c-f493-45b7-8493-0af249eab273'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:29.365302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3037380c-f493-45b7-8493-0af249eab273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5786656a30fa4762ad6e9ceb49eccc78', 'request_id': 'req-3037380c-f493-45b7-8493-0af249eab273'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:29.384900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3037380c-f493-45b7-8493-0af249eab273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5786656a30fa4762ad6e9ceb49eccc78', 'request_id': 'req-3037380c-f493-45b7-8493-0af249eab273'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:29.406327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3037380c-f493-45b7-8493-0af249eab273 admin admin] The token cache is being invalidate because project 5786656a30fa4762ad6e9ceb49eccc78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:29.406649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbf4b1-d938-4c0d-92e8-aa9157d1b152 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:29.407183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3037380c-f493-45b7-8493-0af249eab273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:29.408003 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3037380c-f493-45b7-8493-0af249eab273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:29.409267 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbf4b1-d938-4c0d-92e8-aa9157d1b152 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:29.410309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 910/1822] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:28 2022] DELETE /identity/v3/projects/5786656a30fa4762ad6e9ceb49eccc78 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:29.415247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04894399-ee79-4cb6-9c23-444aa7d9b04f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:29.415895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04894399-ee79-4cb6-9c23-444aa7d9b04f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:29.416316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04894399-ee79-4cb6-9c23-444aa7d9b04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:29.429748 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 913/1823] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:29.446632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-04894399-ee79-4cb6-9c23-444aa7d9b04f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:29.447884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-04894399-ee79-4cb6-9c23-444aa7d9b04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:29.473498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:29.557247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 911/1824] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:29.565560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c2537-74c8-4791-a498-851b5ce3065e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:29.566344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c2537-74c8-4791-a498-851b5ce3065e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:29.566903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c2537-74c8-4791-a498-851b5ce3065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:29.593723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-605c2537-74c8-4791-a498-851b5ce3065e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:29.595744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-605c2537-74c8-4791-a498-851b5ce3065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:29.615661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 914/1825] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:29.621302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04894399-ee79-4cb6-9c23-444aa7d9b04f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:29.638401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04894399-ee79-4cb6-9c23-444aa7d9b04f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:29.656616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1274d6-ff16-44b3-94bd-617da35fdbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:29.658408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1274d6-ff16-44b3-94bd-617da35fdbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:29.660039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1274d6-ff16-44b3-94bd-617da35fdbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:29.661102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1274d6-ff16-44b3-94bd-617da35fdbb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:29.664436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1274d6-ff16-44b3-94bd-617da35fdbb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:29.665542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1274d6-ff16-44b3-94bd-617da35fdbb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:29.673074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1274d6-ff16-44b3-94bd-617da35fdbb8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:29.711729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 912/1826] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:29.716327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c2537-74c8-4791-a498-851b5ce3065e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:29.731881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c2537-74c8-4791-a498-851b5ce3065e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:29.747405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318f084-83e7-4b5b-9fe8-284a7a4c0bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:29.748103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318f084-83e7-4b5b-9fe8-284a7a4c0bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:29.751640 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318f084-83e7-4b5b-9fe8-284a7a4c0bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:29.751640 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318f084-83e7-4b5b-9fe8-284a7a4c0bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:29.752192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318f084-83e7-4b5b-9fe8-284a7a4c0bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:29.758027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318f084-83e7-4b5b-9fe8-284a7a4c0bf9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:29.812694 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 915/1827] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:29 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:29.817409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1274d6-ff16-44b3-94bd-617da35fdbb8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:29.834228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1274d6-ff16-44b3-94bd-617da35fdbb8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:29.930793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318f084-83e7-4b5b-9fe8-284a7a4c0bf9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:29.932821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9318f084-83e7-4b5b-9fe8-284a7a4c0bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:29.970231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4726c-65e5-4d03-9308-f3351c51d351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:29.970881 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4726c-65e5-4d03-9308-f3351c51d351 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:29.971163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4726c-65e5-4d03-9308-f3351c51d351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:29.971443 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4726c-65e5-4d03-9308-f3351c51d351 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:29.972185 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4726c-65e5-4d03-9308-f3351c51d351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:29.982620 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4726c-65e5-4d03-9308-f3351c51d351 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:30.033114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 913/1828] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:29 2022] POST /identity/v3/users => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:30.034816 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4726c-65e5-4d03-9308-f3351c51d351 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:30.038358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:30.064874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4726c-65e5-4d03-9308-f3351c51d351 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:30.082304 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a426d-7a55-4af9-b0be-b051df879702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:30.083377 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a426d-7a55-4af9-b0be-b051df879702 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:30.083819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a426d-7a55-4af9-b0be-b051df879702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:30.084245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a426d-7a55-4af9-b0be-b051df879702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:30.085251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a426d-7a55-4af9-b0be-b051df879702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:30.087067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a426d-7a55-4af9-b0be-b051df879702 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:30.098700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 914/1829] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:30.114516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a426d-7a55-4af9-b0be-b051df879702 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:30.119636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318f084-83e7-4b5b-9fe8-284a7a4c0bf9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:30.135769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd69ae-5178-49de-a0eb-26342095d3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:30.136830 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd69ae-5178-49de-a0eb-26342095d3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:30.137235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd69ae-5178-49de-a0eb-26342095d3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:30.137744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd69ae-5178-49de-a0eb-26342095d3ba admin admin] PATH_INFO: `/v3/projects/63a4eb98fb6745489fe7ea3d205efe2e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:30.139447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd69ae-5178-49de-a0eb-26342095d3ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a4eb98fb6745489fe7ea3d205efe2e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:30.141379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a426d-7a55-4af9-b0be-b051df879702 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:30.148377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd69ae-5178-49de-a0eb-26342095d3ba admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:30.161259 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f223a4-2e5d-49cf-9cc1-07814922c402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:30.162079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f223a4-2e5d-49cf-9cc1-07814922c402 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:30.162537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f223a4-2e5d-49cf-9cc1-07814922c402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:30.162979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f223a4-2e5d-49cf-9cc1-07814922c402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:30.163888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f223a4-2e5d-49cf-9cc1-07814922c402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:30.165724 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f223a4-2e5d-49cf-9cc1-07814922c402 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:30.204234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 915/1830] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:30.216053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f223a4-2e5d-49cf-9cc1-07814922c402 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:30.241970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f223a4-2e5d-49cf-9cc1-07814922c402 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:30.249654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0edd69ae-5178-49de-a0eb-26342095d3ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a4eb98fb6745489fe7ea3d205efe2e', 'request_id': 'req-0edd69ae-5178-49de-a0eb-26342095d3ba'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:30.262193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0edd69ae-5178-49de-a0eb-26342095d3ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a4eb98fb6745489fe7ea3d205efe2e', 'request_id': 'req-0edd69ae-5178-49de-a0eb-26342095d3ba'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:30.271854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0edd69ae-5178-49de-a0eb-26342095d3ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a4eb98fb6745489fe7ea3d205efe2e', 'request_id': 'req-0edd69ae-5178-49de-a0eb-26342095d3ba'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:30.288766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0edd69ae-5178-49de-a0eb-26342095d3ba admin admin] The token cache is being invalidate because project 63a4eb98fb6745489fe7ea3d205efe2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:30.289858 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0edd69ae-5178-49de-a0eb-26342095d3ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:30.290718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0edd69ae-5178-49de-a0eb-26342095d3ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:30.293090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 916/1831] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:29 2022] DELETE /identity/v3/projects/63a4eb98fb6745489fe7ea3d205efe2e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:30.297929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74741b5-4a61-4c10-98d3-8369392ab672 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:30.298958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74741b5-4a61-4c10-98d3-8369392ab672 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:30.299386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74741b5-4a61-4c10-98d3-8369392ab672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:30.327024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c74741b5-4a61-4c10-98d3-8369392ab672 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:30.329715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c74741b5-4a61-4c10-98d3-8369392ab672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:30.397771 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19be8c-573f-454c-a7c7-844d22067130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:30.398715 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19be8c-573f-454c-a7c7-844d22067130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:30.398997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19be8c-573f-454c-a7c7-844d22067130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:30.399619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19be8c-573f-454c-a7c7-844d22067130 admin admin] PATH_INFO: `/v3/projects/1c72c1da8bb84367b27f246170f82bdf/users/e5d2ab5997c5433a8fd019cc71598ddb/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:30.433856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 917/1832] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:30.443262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a43d5-d31d-4e5f-8c60-3f8efa99d29a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:30.443563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a43d5-d31d-4e5f-8c60-3f8efa99d29a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:30.444440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a43d5-d31d-4e5f-8c60-3f8efa99d29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:30.444991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19be8c-573f-454c-a7c7-844d22067130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c72c1da8bb84367b27f246170f82bdf, user_id=e5d2ab5997c5433a8fd019cc71598ddb, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:30.454906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19be8c-573f-454c-a7c7-844d22067130 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:30.482807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:30.497861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 916/1833] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:30 2022] PUT /identity/v3/projects/1c72c1da8bb84367b27f246170f82bdf/users/e5d2ab5997c5433a8fd019cc71598ddb/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:30.507666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c64a43d5-d31d-4e5f-8c60-3f8efa99d29a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:30.510080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa03ce-2db7-4199-ad7e-829a0156bdcf None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:30.510370 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa03ce-2db7-4199-ad7e-829a0156bdcf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:30.510645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa03ce-2db7-4199-ad7e-829a0156bdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:30.512811 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c64a43d5-d31d-4e5f-8c60-3f8efa99d29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:30.574006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-74fa03ce-2db7-4199-ad7e-829a0156bdcf None None] MFA Rules not processed for user `e5d2ab5997c5433a8fd019cc71598ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:30.575764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-74fa03ce-2db7-4199-ad7e-829a0156bdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:30.641682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 918/1834] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:30.642736 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a43d5-d31d-4e5f-8c60-3f8efa99d29a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:30.648248 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:30.654720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a43d5-d31d-4e5f-8c60-3f8efa99d29a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:30.663398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef83d3-2f01-4e85-adce-98ec9a19f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:30.664688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef83d3-2f01-4e85-adce-98ec9a19f0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:30.666507 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef83d3-2f01-4e85-adce-98ec9a19f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:30.667704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef83d3-2f01-4e85-adce-98ec9a19f0ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:30.668612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef83d3-2f01-4e85-adce-98ec9a19f0ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:30.669687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef83d3-2f01-4e85-adce-98ec9a19f0ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:30.675448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef83d3-2f01-4e85-adce-98ec9a19f0ee admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:30.699024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 917/1835] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:30.701161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa03ce-2db7-4199-ad7e-829a0156bdcf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:30.703491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-74fa03ce-2db7-4199-ad7e-829a0156bdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:30.705507 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 919/1836] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:30.710493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef83d3-2f01-4e85-adce-98ec9a19f0ee admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:30.738321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa03ce-2db7-4199-ad7e-829a0156bdcf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:30.752774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b8eea-b521-4df5-8ae0-41d7310b442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:30.753622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b8eea-b521-4df5-8ae0-41d7310b442c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:30.753907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b8eea-b521-4df5-8ae0-41d7310b442c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:30.754339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b8eea-b521-4df5-8ae0-41d7310b442c admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:30.755570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b8eea-b521-4df5-8ae0-41d7310b442c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:30.759657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef83d3-2f01-4e85-adce-98ec9a19f0ee admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:30.766214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b8eea-b521-4df5-8ae0-41d7310b442c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:30.772860 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c2f7-ea8c-4b84-a864-3296eefd6b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:30.774402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c2f7-ea8c-4b84-a864-3296eefd6b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:30.775084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c2f7-ea8c-4b84-a864-3296eefd6b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:30.778124 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c2f7-ea8c-4b84-a864-3296eefd6b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:30.779545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5c2f7-ea8c-4b84-a864-3296eefd6b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:30.783234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5c2f7-ea8c-4b84-a864-3296eefd6b40 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:30.818991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 918/1837] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:30 2022] POST /identity/v3/projects => generated 399 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:30.823168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b8eea-b521-4df5-8ae0-41d7310b442c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:30.850650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 920/1838] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:30 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:30.851768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c2f7-ea8c-4b84-a864-3296eefd6b40 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:30.937548 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b8eea-b521-4df5-8ae0-41d7310b442c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:30.996448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c2f7-ea8c-4b84-a864-3296eefd6b40 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:31.019324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f1483-fe2b-445d-b926-94d84b7d46da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:31.019324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f1483-fe2b-445d-b926-94d84b7d46da admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:31.019324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f1483-fe2b-445d-b926-94d84b7d46da admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:31.019679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f1483-fe2b-445d-b926-94d84b7d46da admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:31.020378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f1483-fe2b-445d-b926-94d84b7d46da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:31.022120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f1483-fe2b-445d-b926-94d84b7d46da admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:31.076016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 921/1839] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:30 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:31.077486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f1483-fe2b-445d-b926-94d84b7d46da admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:31.081580 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16ffd9-afd4-4594-976e-b8a04f749f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:31.082279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16ffd9-afd4-4594-976e-b8a04f749f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:31.082609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16ffd9-afd4-4594-976e-b8a04f749f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:31.082880 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16ffd9-afd4-4594-976e-b8a04f749f8d admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:31.083591 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16ffd9-afd4-4594-976e-b8a04f749f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:31.086561 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16ffd9-afd4-4594-976e-b8a04f749f8d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:31.123885 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f1483-fe2b-445d-b926-94d84b7d46da admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:31.140912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098f56c-7368-427f-8f2f-bcab62dc32c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:31.142116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 919/1840] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:30 2022] POST /identity/v3/users => generated 306 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:31.144787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098f56c-7368-427f-8f2f-bcab62dc32c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:31.145135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098f56c-7368-427f-8f2f-bcab62dc32c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:31.145425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098f56c-7368-427f-8f2f-bcab62dc32c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:31.146380 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098f56c-7368-427f-8f2f-bcab62dc32c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:31.148075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098f56c-7368-427f-8f2f-bcab62dc32c5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:31.158363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16ffd9-afd4-4594-976e-b8a04f749f8d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:31.170874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:31.174461 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 922/1841] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:27:31.178823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098f56c-7368-427f-8f2f-bcab62dc32c5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:31.200091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16ffd9-afd4-4594-976e-b8a04f749f8d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:31.216653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e60643-1b47-4f32-99a6-de2f0f64cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:31.216653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e60643-1b47-4f32-99a6-de2f0f64cb67 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:31.216653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e60643-1b47-4f32-99a6-de2f0f64cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:31.216653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e60643-1b47-4f32-99a6-de2f0f64cb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:31.217031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e60643-1b47-4f32-99a6-de2f0f64cb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:31.217031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e60643-1b47-4f32-99a6-de2f0f64cb67 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:31.221396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098f56c-7368-427f-8f2f-bcab62dc32c5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:31.231998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 920/1842] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:31.233991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e60643-1b47-4f32-99a6-de2f0f64cb67 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:31.237012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bddb7c-5f2e-485b-97df-9aea25251d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:31.241685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bddb7c-5f2e-485b-97df-9aea25251d97 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:31.241685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bddb7c-5f2e-485b-97df-9aea25251d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:31.241685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bddb7c-5f2e-485b-97df-9aea25251d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:31.241685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bddb7c-5f2e-485b-97df-9aea25251d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:31.245242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bddb7c-5f2e-485b-97df-9aea25251d97 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:31.255025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e60643-1b47-4f32-99a6-de2f0f64cb67 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:31.266063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e492-ca97-46ef-ac2f-cda1df63957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:31.267062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e492-ca97-46ef-ac2f-cda1df63957d admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:31.267388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e492-ca97-46ef-ac2f-cda1df63957d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:31.267664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e492-ca97-46ef-ac2f-cda1df63957d admin admin] PATH_INFO: `/v3/projects/cb70ca18641044b7903bd22588073335/users/33c023ee921a47ecb97d2afc026bc85f/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:31.279969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 923/1843] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:31.284190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bddb7c-5f2e-485b-97df-9aea25251d97 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:31.311013 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72e492-ca97-46ef-ac2f-cda1df63957d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb70ca18641044b7903bd22588073335, user_id=33c023ee921a47ecb97d2afc026bc85f, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:31.313088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bddb7c-5f2e-485b-97df-9aea25251d97 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:31.315810 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72e492-ca97-46ef-ac2f-cda1df63957d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:31.325684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a2ef1-0b6b-448a-aa0a-f58076ef8fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:31.327595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a2ef1-0b6b-448a-aa0a-f58076ef8fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:31.327828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a2ef1-0b6b-448a-aa0a-f58076ef8fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:31.328082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a2ef1-0b6b-448a-aa0a-f58076ef8fb1 admin admin] PATH_INFO: `/v3/projects/58eb827a321f4200b604fabe074064ca/users/a999398fb6d843fa8fc9f6a2612b840d/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:31.349265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 921/1844] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:31 2022] PUT /identity/v3/projects/cb70ca18641044b7903bd22588073335/users/33c023ee921a47ecb97d2afc026bc85f/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:31.353378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e492-ca97-46ef-ac2f-cda1df63957d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:31.380054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a2ef1-0b6b-448a-aa0a-f58076ef8fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58eb827a321f4200b604fabe074064ca, user_id=a999398fb6d843fa8fc9f6a2612b840d, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:31.395583 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a2ef1-0b6b-448a-aa0a-f58076ef8fb1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:31.418945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 924/1845] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:31 2022] PUT /identity/v3/projects/58eb827a321f4200b604fabe074064ca/users/a999398fb6d843fa8fc9f6a2612b840d/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:31.424123 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e72886-82b9-46a1-86d0-7bc0bc2c1a82 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:31.424411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e72886-82b9-46a1-86d0-7bc0bc2c1a82 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:31.424717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e72886-82b9-46a1-86d0-7bc0bc2c1a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:31.476332 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-50e72886-82b9-46a1-86d0-7bc0bc2c1a82 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:31.477726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-50e72886-82b9-46a1-86d0-7bc0bc2c1a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:31.534965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e492-ca97-46ef-ac2f-cda1df63957d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:31.642896 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 925/1846] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:31.655069 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e72886-82b9-46a1-86d0-7bc0bc2c1a82 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:31.656998 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-50e72886-82b9-46a1-86d0-7bc0bc2c1a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:31.684147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:31.698074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83218-1b61-4e03-b1bb-dc2df0c0f5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:31.699273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83218-1b61-4e03-b1bb-dc2df0c0f5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:31.699702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83218-1b61-4e03-b1bb-dc2df0c0f5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:31.700160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83218-1b61-4e03-b1bb-dc2df0c0f5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:31.701351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f83218-1b61-4e03-b1bb-dc2df0c0f5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:31.703204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f83218-1b61-4e03-b1bb-dc2df0c0f5e6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:31.719864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 922/1847] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:31.725292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83218-1b61-4e03-b1bb-dc2df0c0f5e6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:31.739441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83218-1b61-4e03-b1bb-dc2df0c0f5e6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:31.746335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e788d55-8096-4892-a959-bfb08239cfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:31.747495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e788d55-8096-4892-a959-bfb08239cfff admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:31.747950 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e788d55-8096-4892-a959-bfb08239cfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:31.748367 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e788d55-8096-4892-a959-bfb08239cfff admin admin] PATH_INFO: `/v3/projects/cb70ca18641044b7903bd22588073335/users/33c023ee921a47ecb97d2afc026bc85f/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:31.751635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e788d55-8096-4892-a959-bfb08239cfff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb70ca18641044b7903bd22588073335, user_id=33c023ee921a47ecb97d2afc026bc85f, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:31.761108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e788d55-8096-4892-a959-bfb08239cfff admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:31.784938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 923/1848] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:31 2022] PUT /identity/v3/projects/cb70ca18641044b7903bd22588073335/users/33c023ee921a47ecb97d2afc026bc85f/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:31.795518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8747-f685-44dc-b08e-265bdc10f232 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:31.798051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8747-f685-44dc-b08e-265bdc10f232 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:31.798352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8747-f685-44dc-b08e-265bdc10f232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:31.814500 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e72886-82b9-46a1-86d0-7bc0bc2c1a82 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:31.842544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-663f8747-f685-44dc-b08e-265bdc10f232 None None] MFA Rules not processed for user `33c023ee921a47ecb97d2afc026bc85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:31.843873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-663f8747-f685-44dc-b08e-265bdc10f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:31.968767 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c304b99-f0a8-428b-9372-fb15ce52c293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:31.969749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c304b99-f0a8-428b-9372-fb15ce52c293 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:31.970037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c304b99-f0a8-428b-9372-fb15ce52c293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:31.970320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c304b99-f0a8-428b-9372-fb15ce52c293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:31.983498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:32.060351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 924/1849] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:32.079350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8747-f685-44dc-b08e-265bdc10f232 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:32.083282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-663f8747-f685-44dc-b08e-265bdc10f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:32.106802 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c304b99-f0a8-428b-9372-fb15ce52c293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:32.123657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c304b99-f0a8-428b-9372-fb15ce52c293 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:32.143423 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 926/1850] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:27:32.294038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8747-f685-44dc-b08e-265bdc10f232 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:32.310185 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159bf44-9d13-45e6-b15c-6a0ff715fe09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:32.311008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159bf44-9d13-45e6-b15c-6a0ff715fe09 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:32.311514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159bf44-9d13-45e6-b15c-6a0ff715fe09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:32.311796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159bf44-9d13-45e6-b15c-6a0ff715fe09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:32.340896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159bf44-9d13-45e6-b15c-6a0ff715fe09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:32.342381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159bf44-9d13-45e6-b15c-6a0ff715fe09 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:32.368565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 925/1851] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:32.506513 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c304b99-f0a8-428b-9372-fb15ce52c293 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:32.527311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c304b99-f0a8-428b-9372-fb15ce52c293 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:32.579917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76c1d6-187d-4aad-b940-69a380cf2227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:32.591920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76c1d6-187d-4aad-b940-69a380cf2227 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:32.592632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76c1d6-187d-4aad-b940-69a380cf2227 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:32.594136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76c1d6-187d-4aad-b940-69a380cf2227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:32.861401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76c1d6-187d-4aad-b940-69a380cf2227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:32.865607 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76c1d6-187d-4aad-b940-69a380cf2227 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:32.905624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 927/1852] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:33.682825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e3e2f-3a9c-4713-9310-f6ad3e22df76 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:33.683636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e3e2f-3a9c-4713-9310-f6ad3e22df76 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:33.684094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e3e2f-3a9c-4713-9310-f6ad3e22df76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:33.750631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-955e3e2f-3a9c-4713-9310-f6ad3e22df76 None None] MFA Rules not processed for user `a999398fb6d843fa8fc9f6a2612b840d`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:33.760411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-955e3e2f-3a9c-4713-9310-f6ad3e22df76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:33.978098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76c1d6-187d-4aad-b940-69a380cf2227 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:33.979005 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 926/1853] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:34.018767 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76c1d6-187d-4aad-b940-69a380cf2227 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:34.059266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654622c-d7f1-4db6-bde3-31752f0cfee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:34.059968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654622c-d7f1-4db6-bde3-31752f0cfee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:34.060256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654622c-d7f1-4db6-bde3-31752f0cfee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:34.060567 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654622c-d7f1-4db6-bde3-31752f0cfee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:34.061289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654622c-d7f1-4db6-bde3-31752f0cfee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:34.072204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654622c-d7f1-4db6-bde3-31752f0cfee3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:34.122641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:34.154993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e3e2f-3a9c-4713-9310-f6ad3e22df76 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:34.157985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 928/1854] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:33 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:34.183333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e3e2f-3a9c-4713-9310-f6ad3e22df76 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:34.325374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7588f9f-6b2e-4c99-9e30-f07a04a39df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:34.326511 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7588f9f-6b2e-4c99-9e30-f07a04a39df9 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:34.327024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7588f9f-6b2e-4c99-9e30-f07a04a39df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:34.327696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7588f9f-6b2e-4c99-9e30-f07a04a39df9 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:34.328915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7588f9f-6b2e-4c99-9e30-f07a04a39df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:34.331976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7588f9f-6b2e-4c99-9e30-f07a04a39df9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:34.362365 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 927/1855] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:34 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:34.367172 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654622c-d7f1-4db6-bde3-31752f0cfee3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:34.384940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654622c-d7f1-4db6-bde3-31752f0cfee3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:34.391187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab9a08-b7ca-47ae-b410-9a6f55464365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:34.392194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9a08-b7ca-47ae-b410-9a6f55464365 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:34.392857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9a08-b7ca-47ae-b410-9a6f55464365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:34.393454 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9a08-b7ca-47ae-b410-9a6f55464365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:34.394836 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab9a08-b7ca-47ae-b410-9a6f55464365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:34.397008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab9a08-b7ca-47ae-b410-9a6f55464365 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:34.416116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 929/1856] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:34.420085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7588f9f-6b2e-4c99-9e30-f07a04a39df9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:34.428952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:34.434926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7588f9f-6b2e-4c99-9e30-f07a04a39df9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:34.442063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cea69-0c6b-4c4d-b80e-cef9df299d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:34.443348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cea69-0c6b-4c4d-b80e-cef9df299d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:34.445261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cea69-0c6b-4c4d-b80e-cef9df299d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:34.446530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cea69-0c6b-4c4d-b80e-cef9df299d19 admin admin] PATH_INFO: `/v3/projects/adc249fcb6554ec1a34afdc1ee146e73/users/1f5f868ff5684560ba8a059d7384f4c8/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:34.474198 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cea69-0c6b-4c4d-b80e-cef9df299d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc249fcb6554ec1a34afdc1ee146e73, user_id=1f5f868ff5684560ba8a059d7384f4c8, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:34.478170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cea69-0c6b-4c4d-b80e-cef9df299d19 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:34.498478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 928/1857] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:34 2022] PUT /identity/v3/projects/adc249fcb6554ec1a34afdc1ee146e73/users/1f5f868ff5684560ba8a059d7384f4c8/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:34.504210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab9a08-b7ca-47ae-b410-9a6f55464365 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:34.517639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab9a08-b7ca-47ae-b410-9a6f55464365 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:34.591488 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb189-9dca-415e-9e5a-00c6a7a164be None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:34.591780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb189-9dca-415e-9e5a-00c6a7a164be None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:34.592958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb189-9dca-415e-9e5a-00c6a7a164be None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:34.595554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 929/1858] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:27:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:27:34.596945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6b35e-18be-4362-babe-a5c9214dab89 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:34.597395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6b35e-18be-4362-babe-a5c9214dab89 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:34.597862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6b35e-18be-4362-babe-a5c9214dab89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:34.640899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dad6b35e-18be-4362-babe-a5c9214dab89 None None] MFA Rules not processed for user `402c84b80e4b4996af901e79bf82c4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:34.642309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dad6b35e-18be-4362-babe-a5c9214dab89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:34.653437 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db10eb9-0b16-42f0-af7f-3d91a39aeba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:34.655472 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db10eb9-0b16-42f0-af7f-3d91a39aeba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:34.656116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db10eb9-0b16-42f0-af7f-3d91a39aeba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:34.656744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db10eb9-0b16-42f0-af7f-3d91a39aeba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:34.657831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db10eb9-0b16-42f0-af7f-3d91a39aeba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:34.660088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db10eb9-0b16-42f0-af7f-3d91a39aeba1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:34.679352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 930/1859] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:34.679352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ae16-9c90-4310-aa22-3bc1fafdc728 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:34.679352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ae16-9c90-4310-aa22-3bc1fafdc728 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:34.679352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ae16-9c90-4310-aa22-3bc1fafdc728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:34.718039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6d50ae16-9c90-4310-aa22-3bc1fafdc728 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:34.719189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6d50ae16-9c90-4310-aa22-3bc1fafdc728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:34.764705 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 930/1860] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:34.764705 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6b35e-18be-4362-babe-a5c9214dab89 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:34.782871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6b35e-18be-4362-babe-a5c9214dab89 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:34.794484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebdab9-34f6-42ce-9594-eb1a7943d7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:34.797190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebdab9-34f6-42ce-9594-eb1a7943d7e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:34.799571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebdab9-34f6-42ce-9594-eb1a7943d7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:34.799571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebdab9-34f6-42ce-9594-eb1a7943d7e7 admin admin] PATH_INFO: `/v3/projects/adc249fcb6554ec1a34afdc1ee146e73/users/1f5f868ff5684560ba8a059d7384f4c8/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:34.820448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebdab9-34f6-42ce-9594-eb1a7943d7e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc249fcb6554ec1a34afdc1ee146e73, user_id=1f5f868ff5684560ba8a059d7384f4c8, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:34.825983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebdab9-34f6-42ce-9594-eb1a7943d7e7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:34.854490 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 931/1861] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:34 2022] PUT /identity/v3/projects/adc249fcb6554ec1a34afdc1ee146e73/users/1f5f868ff5684560ba8a059d7384f4c8/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:34.930010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 931/1862] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:27:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:35.001863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebdab9-34f6-42ce-9594-eb1a7943d7e7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:35.013907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-afebdab9-34f6-42ce-9594-eb1a7943d7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:35.169931 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebdab9-34f6-42ce-9594-eb1a7943d7e7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:35.177607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc4066-addf-47c4-9f77-0332a84fd50f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:35.181109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc4066-addf-47c4-9f77-0332a84fd50f service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:35.181783 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc4066-addf-47c4-9f77-0332a84fd50f service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:35.182261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc4066-addf-47c4-9f77-0332a84fd50f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:35.199111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc4066-addf-47c4-9f77-0332a84fd50f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:35.202093 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc4066-addf-47c4-9f77-0332a84fd50f service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:35.224214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 932/1863] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:35.620008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50ae16-9c90-4310-aa22-3bc1fafdc728 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:35.621875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6d50ae16-9c90-4310-aa22-3bc1fafdc728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:35.638625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50ae16-9c90-4310-aa22-3bc1fafdc728 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:35.713724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:35.714882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:35.715162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:35.715442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] PATH_INFO: `/v3/users/9faf5c90b0a3487fa35f4462f7b7f7e5` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:35.716771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9faf5c90b0a3487fa35f4462f7b7f7e5)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:35.719102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:35.735350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=1,keystone:SELECT=98,keystone:DELETE=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:35.832089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9faf5c90b0a3487fa35f4462f7b7f7e5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:35.845977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9faf5c90b0a3487fa35f4462f7b7f7e5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:35.868559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9faf5c90b0a3487fa35f4462f7b7f7e5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:35.869340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9faf5c90b0a3487fa35f4462f7b7f7e5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:35.870044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9faf5c90b0a3487fa35f4462f7b7f7e5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:35.892952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 932/1864] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:35 2022] DELETE /identity/v3/users/9faf5c90b0a3487fa35f4462f7b7f7e5 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:35.897546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286cf13-68ee-4b4e-b875-f09c24da6554 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:35.898730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286cf13-68ee-4b4e-b875-f09c24da6554 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:35.899079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286cf13-68ee-4b4e-b875-f09c24da6554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:35.921555 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8286cf13-68ee-4b4e-b875-f09c24da6554 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:35.923088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8286cf13-68ee-4b4e-b875-f09c24da6554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:35.997413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:36.018721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 933/1865] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:36.030978 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:36.032853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:36.111013 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3c895-f820-4833-961d-fc26fe8610a9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:36.116546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82aea6-c0b6-4b36-ba3e-7e0ee6ba8f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:36.116786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82aea6-c0b6-4b36-ba3e-7e0ee6ba8f6d service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:36.117688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82aea6-c0b6-4b36-ba3e-7e0ee6ba8f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:36.117688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82aea6-c0b6-4b36-ba3e-7e0ee6ba8f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:36.129602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82aea6-c0b6-4b36-ba3e-7e0ee6ba8f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:36.131352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82aea6-c0b6-4b36-ba3e-7e0ee6ba8f6d service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:36.148859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 933/1866] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:36.989593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eaad1-3699-487b-a7fb-91b0a9161334 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:36.990106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eaad1-3699-487b-a7fb-91b0a9161334 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:36.990424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eaad1-3699-487b-a7fb-91b0a9161334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:37.045951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4a3eaad1-3699-487b-a7fb-91b0a9161334 None None] MFA Rules not processed for user `1f5f868ff5684560ba8a059d7384f4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:37.047276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4a3eaad1-3699-487b-a7fb-91b0a9161334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:37.206923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 934/1867] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:37.218641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3eaad1-3699-487b-a7fb-91b0a9161334 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:37.220232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78603c9b-1564-4077-8c76-a72539ced4b3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:37.220896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4a3eaad1-3699-487b-a7fb-91b0a9161334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:37.221319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78603c9b-1564-4077-8c76-a72539ced4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:37.221761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78603c9b-1564-4077-8c76-a72539ced4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:37.236203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3eaad1-3699-487b-a7fb-91b0a9161334 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:37.242759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:37.244627 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:37.244809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-78603c9b-1564-4077-8c76-a72539ced4b3 None None] MFA Rules not processed for user `a999398fb6d843fa8fc9f6a2612b840d`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:37.244946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:37.245227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] PATH_INFO: `/v3/projects/1ad07fcdbb5e4dc08989dce6ab4913b2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:37.246464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-78603c9b-1564-4077-8c76-a72539ced4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:37.246575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad07fcdbb5e4dc08989dce6ab4913b2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:37.249250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:37.326088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 934/1868] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:37.326656 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad07fcdbb5e4dc08989dce6ab4913b2', 'request_id': 'req-5bebd3f2-b6f4-41f8-81c2-975378aedd83'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:37.348245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad07fcdbb5e4dc08989dce6ab4913b2', 'request_id': 'req-5bebd3f2-b6f4-41f8-81c2-975378aedd83'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:37.353787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78603c9b-1564-4077-8c76-a72539ced4b3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:37.356308 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-78603c9b-1564-4077-8c76-a72539ced4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:37.359574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad07fcdbb5e4dc08989dce6ab4913b2', 'request_id': 'req-5bebd3f2-b6f4-41f8-81c2-975378aedd83'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:37.380940 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] The token cache is being invalidate because project 1ad07fcdbb5e4dc08989dce6ab4913b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:37.381670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:37.382558 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:37.384912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 935/1869] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:37 2022] DELETE /identity/v3/projects/1ad07fcdbb5e4dc08989dce6ab4913b2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:37.390817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:37.393105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:37.430421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:37.518966 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78603c9b-1564-4077-8c76-a72539ced4b3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:37.523436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebd3f2-b6f4-41f8-81c2-975378aedd83 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:37.529945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:37.530781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:37.531063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:37.531334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] PATH_INFO: `/v3/users/ad74c3cb2e764cef8de021e28af23e69` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:37.532607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad74c3cb2e764cef8de021e28af23e69)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:37.534727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:37.542889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:37.595991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc712e-8957-4258-905b-6b1a23fe96f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:37.596688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc712e-8957-4258-905b-6b1a23fe96f9 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:37.596969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc712e-8957-4258-905b-6b1a23fe96f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:37.597243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc712e-8957-4258-905b-6b1a23fe96f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:37.597553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad74c3cb2e764cef8de021e28af23e69'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:37.599057 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-05fc712e-8957-4258-905b-6b1a23fe96f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:37.607374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad74c3cb2e764cef8de021e28af23e69'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:37.616983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad74c3cb2e764cef8de021e28af23e69'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:37.644820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad74c3cb2e764cef8de021e28af23e69'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:37.645845 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad74c3cb2e764cef8de021e28af23e69'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:37.652844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 936/1870] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:37 2022] DELETE /identity/v3/users/ad74c3cb2e764cef8de021e28af23e69 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:37.671830 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc712e-8957-4258-905b-6b1a23fe96f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:37.673515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc712e-8957-4258-905b-6b1a23fe96f9 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:37.685441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 935/1871] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:27:38.118834 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:38.120333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:38.273692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2868468-1658-47ac-b6e1-07b605554346 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:38.288131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:38.288131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:38.288131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:38.288131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] PATH_INFO: `/v3/users/e5d2ab5997c5433a8fd019cc71598ddb` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:38.288479 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d2ab5997c5433a8fd019cc71598ddb)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:38.288479 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:38.377676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d2ab5997c5433a8fd019cc71598ddb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:38.398815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d2ab5997c5433a8fd019cc71598ddb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:38.412425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d2ab5997c5433a8fd019cc71598ddb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:38.442269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d2ab5997c5433a8fd019cc71598ddb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:38.443984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d2ab5997c5433a8fd019cc71598ddb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:38.456864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 937/1872] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:38 2022] DELETE /identity/v3/users/e5d2ab5997c5433a8fd019cc71598ddb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:38.461946 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1816d9-0397-4039-8f52-65b51b181710 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:38.462556 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1816d9-0397-4039-8f52-65b51b181710 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:38.462647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1816d9-0397-4039-8f52-65b51b181710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:38.498125 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6e1816d9-0397-4039-8f52-65b51b181710 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:38.498232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6e1816d9-0397-4039-8f52-65b51b181710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:38.639551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 936/1873] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:38.666436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:38.668070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:38.679511 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:38.809441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1816d9-0397-4039-8f52-65b51b181710 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:38.811435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6e1816d9-0397-4039-8f52-65b51b181710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:38.833976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdbf01-24f0-4e8f-b937-6272f9934ac7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:38.837244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1816d9-0397-4039-8f52-65b51b181710 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:38.845054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba38b5c-63ba-4842-82f3-e3797cc74dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:38.845750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba38b5c-63ba-4842-82f3-e3797cc74dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:38.846394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba38b5c-63ba-4842-82f3-e3797cc74dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:38.846394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba38b5c-63ba-4842-82f3-e3797cc74dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:38.853502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1215b-979a-4079-a5e0-a8036b35a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:38.854452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1215b-979a-4079-a5e0-a8036b35a093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:38.854671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1215b-979a-4079-a5e0-a8036b35a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:38.854950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1215b-979a-4079-a5e0-a8036b35a093 admin admin] PATH_INFO: `/v3/projects/198e666276d14373b5a6061e1f5a9ccc` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:38.863988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1215b-979a-4079-a5e0-a8036b35a093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=198e666276d14373b5a6061e1f5a9ccc)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:38.865999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1215b-979a-4079-a5e0-a8036b35a093 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:38.881539 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba38b5c-63ba-4842-82f3-e3797cc74dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:38.885418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba38b5c-63ba-4842-82f3-e3797cc74dd0 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:38.890538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:38.906713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 938/1874] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:38.953598 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-59d1215b-979a-4079-a5e0-a8036b35a093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198e666276d14373b5a6061e1f5a9ccc', 'request_id': 'req-59d1215b-979a-4079-a5e0-a8036b35a093'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:38.966042 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-59d1215b-979a-4079-a5e0-a8036b35a093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198e666276d14373b5a6061e1f5a9ccc', 'request_id': 'req-59d1215b-979a-4079-a5e0-a8036b35a093'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:38.974312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-59d1215b-979a-4079-a5e0-a8036b35a093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198e666276d14373b5a6061e1f5a9ccc', 'request_id': 'req-59d1215b-979a-4079-a5e0-a8036b35a093'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:38.989271 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-59d1215b-979a-4079-a5e0-a8036b35a093 admin admin] The token cache is being invalidate because project 198e666276d14373b5a6061e1f5a9ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:38.989672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-59d1215b-979a-4079-a5e0-a8036b35a093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:38.990672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-59d1215b-979a-4079-a5e0-a8036b35a093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:38.992940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 937/1875] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:38 2022] DELETE /identity/v3/projects/198e666276d14373b5a6061e1f5a9ccc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:38.997894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a524a-3b50-4314-b8b0-2c814ca73b46 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:38.998183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a524a-3b50-4314-b8b0-2c814ca73b46 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:38.998460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a524a-3b50-4314-b8b0-2c814ca73b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:39.045679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a63a524a-3b50-4314-b8b0-2c814ca73b46 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:39.047179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a63a524a-3b50-4314-b8b0-2c814ca73b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:39.203733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 939/1876] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:39.205067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0759-6fb7-43be-9e76-b16591c41a29 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:39.205368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0759-6fb7-43be-9e76-b16591c41a29 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:39.205652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0759-6fb7-43be-9e76-b16591c41a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:39.241141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0c0f0759-6fb7-43be-9e76-b16591c41a29 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:39.242541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0c0f0759-6fb7-43be-9e76-b16591c41a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:39.265546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 938/1877] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:39.269974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a524a-3b50-4314-b8b0-2c814ca73b46 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:39.286099 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a524a-3b50-4314-b8b0-2c814ca73b46 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:39.305078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f98a0-6b6e-4e76-8d5e-c211e5fcfcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:39.305382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f98a0-6b6e-4e76-8d5e-c211e5fcfcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:39.305665 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f98a0-6b6e-4e76-8d5e-c211e5fcfcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:39.305939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f98a0-6b6e-4e76-8d5e-c211e5fcfcc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:39.306691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f98a0-6b6e-4e76-8d5e-c211e5fcfcc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:39.307003 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f98a0-6b6e-4e76-8d5e-c211e5fcfcc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:39.309568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f98a0-6b6e-4e76-8d5e-c211e5fcfcc2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:39.340408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 940/1878] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:39.341289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f0759-6fb7-43be-9e76-b16591c41a29 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:39.351356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f0759-6fb7-43be-9e76-b16591c41a29 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:39.357526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371faccb-3d23-4593-be34-cad1360721f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:39.358563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371faccb-3d23-4593-be34-cad1360721f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:39.359173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371faccb-3d23-4593-be34-cad1360721f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:39.359648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371faccb-3d23-4593-be34-cad1360721f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:39.360857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371faccb-3d23-4593-be34-cad1360721f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:39.364021 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371faccb-3d23-4593-be34-cad1360721f3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:39.405431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 939/1879] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:39 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:39.409801 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f98a0-6b6e-4e76-8d5e-c211e5fcfcc2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:39.425153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f98a0-6b6e-4e76-8d5e-c211e5fcfcc2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:39.542262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4846c-5de9-45ff-8f7f-763d1ff0a610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:39.542457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4846c-5de9-45ff-8f7f-763d1ff0a610 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:39.542672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4846c-5de9-45ff-8f7f-763d1ff0a610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:39.542953 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4846c-5de9-45ff-8f7f-763d1ff0a610 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:39.543669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4846c-5de9-45ff-8f7f-763d1ff0a610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:39.547541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4846c-5de9-45ff-8f7f-763d1ff0a610 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:39.606508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 941/1880] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:39 2022] POST /identity/v3/users => generated 282 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:39.607110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371faccb-3d23-4593-be34-cad1360721f3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:39.624454 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371faccb-3d23-4593-be34-cad1360721f3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:39.634835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b426e-bfa7-4c7e-aba1-a0c8dcc98361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:39.637154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b426e-bfa7-4c7e-aba1-a0c8dcc98361 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:39.638053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b426e-bfa7-4c7e-aba1-a0c8dcc98361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:39.638539 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b426e-bfa7-4c7e-aba1-a0c8dcc98361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:39.640105 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b426e-bfa7-4c7e-aba1-a0c8dcc98361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:39.643300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b426e-bfa7-4c7e-aba1-a0c8dcc98361 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:39.670559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4846c-5de9-45ff-8f7f-763d1ff0a610 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:39.670985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 940/1881] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:39.682709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4846c-5de9-45ff-8f7f-763d1ff0a610 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:39.689067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6275c5a-1fba-4e42-bfc3-b83aec123150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:39.690110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6275c5a-1fba-4e42-bfc3-b83aec123150 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:39.690567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6275c5a-1fba-4e42-bfc3-b83aec123150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:39.691037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6275c5a-1fba-4e42-bfc3-b83aec123150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:39.692264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6275c5a-1fba-4e42-bfc3-b83aec123150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:39.694199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6275c5a-1fba-4e42-bfc3-b83aec123150 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:39.712377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b426e-bfa7-4c7e-aba1-a0c8dcc98361 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:39.713714 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 942/1882] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:27:39.725239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b426e-bfa7-4c7e-aba1-a0c8dcc98361 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:39.732844 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3d589-e783-4cfd-9698-fe9eda8f4305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:39.734089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3d589-e783-4cfd-9698-fe9eda8f4305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:39.734517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3d589-e783-4cfd-9698-fe9eda8f4305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:39.734915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3d589-e783-4cfd-9698-fe9eda8f4305 admin admin] PATH_INFO: `/v3/projects/ab9d1d0f87344d78bd0ccb13f18cc313/users/3577e5c60e3e4de1a5b0e305ff7fdae0/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:39.790929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3d589-e783-4cfd-9698-fe9eda8f4305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab9d1d0f87344d78bd0ccb13f18cc313, user_id=3577e5c60e3e4de1a5b0e305ff7fdae0, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:39.799012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3d589-e783-4cfd-9698-fe9eda8f4305 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:39.862967 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 941/1883] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:39 2022] PUT /identity/v3/projects/ab9d1d0f87344d78bd0ccb13f18cc313/users/3577e5c60e3e4de1a5b0e305ff7fdae0/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:39.878517 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a049de-405b-4329-a432-4b3dbca78ad4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:39.878719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a049de-405b-4329-a432-4b3dbca78ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:39.879018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a049de-405b-4329-a432-4b3dbca78ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:39.934981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-33a049de-405b-4329-a432-4b3dbca78ad4 None None] MFA Rules not processed for user `3577e5c60e3e4de1a5b0e305ff7fdae0`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:39.936142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:39.938095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-33a049de-405b-4329-a432-4b3dbca78ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:40.103174 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3d589-e783-4cfd-9698-fe9eda8f4305 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:40.105797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 943/1884] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:40.280270 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3d589-e783-4cfd-9698-fe9eda8f4305 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:40.289094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20c266-d925-4dd7-868a-66e7c5483b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:40.290370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20c266-d925-4dd7-868a-66e7c5483b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:40.290878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20c266-d925-4dd7-868a-66e7c5483b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:40.291349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20c266-d925-4dd7-868a-66e7c5483b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:40.292396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20c266-d925-4dd7-868a-66e7c5483b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:40.299562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20c266-d925-4dd7-868a-66e7c5483b3e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:40.333390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6c48e-d07d-401f-8d39-94a42b44e0db None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:40.333947 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6c48e-d07d-401f-8d39-94a42b44e0db None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:40.334164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6c48e-d07d-401f-8d39-94a42b44e0db None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:40.336740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 944/1885] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:27:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:27:40.368088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b40db-961f-430b-88ea-bb7e6c7f6e11 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:40.368472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b40db-961f-430b-88ea-bb7e6c7f6e11 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:40.369524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b40db-961f-430b-88ea-bb7e6c7f6e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:40.400458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 942/1886] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:40 2022] POST /identity/v3/projects => generated 365 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:40.403482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20c266-d925-4dd7-868a-66e7c5483b3e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:40.436183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-901b40db-961f-430b-88ea-bb7e6c7f6e11 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:40.437956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-901b40db-961f-430b-88ea-bb7e6c7f6e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:40.471286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:40.564464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20c266-d925-4dd7-868a-66e7c5483b3e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:40.571664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772bba8-da97-4802-9893-e25b51eedfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:40.572547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772bba8-da97-4802-9893-e25b51eedfcc admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:40.573161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772bba8-da97-4802-9893-e25b51eedfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:40.573538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772bba8-da97-4802-9893-e25b51eedfcc admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:40.574562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772bba8-da97-4802-9893-e25b51eedfcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:40.577426 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772bba8-da97-4802-9893-e25b51eedfcc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:40.609859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 943/1887] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:40 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:27:40.613555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772bba8-da97-4802-9893-e25b51eedfcc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:40.613646 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 945/1888] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:27:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:40.618466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b40db-961f-430b-88ea-bb7e6c7f6e11 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:40.618606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0772bba8-da97-4802-9893-e25b51eedfcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:40.643571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b40db-961f-430b-88ea-bb7e6c7f6e11 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:40.663781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703660-72d6-4cc9-b147-b0c5e2f2fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:40.663781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703660-72d6-4cc9-b147-b0c5e2f2fbdc admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:40.663781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703660-72d6-4cc9-b147-b0c5e2f2fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:40.663781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703660-72d6-4cc9-b147-b0c5e2f2fbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:40.664691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33703660-72d6-4cc9-b147-b0c5e2f2fbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:40.666381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33703660-72d6-4cc9-b147-b0c5e2f2fbdc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:40.667051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772bba8-da97-4802-9893-e25b51eedfcc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:40.692665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:40.693990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:40.695445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:40.695787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] PATH_INFO: `/v3/projects/1c72c1da8bb84367b27f246170f82bdf` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:40.701708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 946/1889] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:40.702768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c72c1da8bb84367b27f246170f82bdf)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:40.704209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703660-72d6-4cc9-b147-b0c5e2f2fbdc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:40.706170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:40.735626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703660-72d6-4cc9-b147-b0c5e2f2fbdc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:40.759376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6f5c4-4d32-4737-b8c3-34900e20d7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:40.760305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6f5c4-4d32-4737-b8c3-34900e20d7f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:40.760612 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6f5c4-4d32-4737-b8c3-34900e20d7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:40.760888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6f5c4-4d32-4737-b8c3-34900e20d7f6 admin admin] PATH_INFO: `/v3/projects/414c267235104e65900db5194c0a1ca3/users/0ee57d4215934a4e89a4bb6fc88876b9/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:40.785095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6f5c4-4d32-4737-b8c3-34900e20d7f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=414c267235104e65900db5194c0a1ca3, user_id=0ee57d4215934a4e89a4bb6fc88876b9, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:40.788949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6f5c4-4d32-4737-b8c3-34900e20d7f6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:40.808622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c72c1da8bb84367b27f246170f82bdf', 'request_id': 'req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:40.817744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 947/1890] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:40 2022] PUT /identity/v3/projects/414c267235104e65900db5194c0a1ca3/users/0ee57d4215934a4e89a4bb6fc88876b9/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:40.819893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6f5c4-4d32-4737-b8c3-34900e20d7f6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:40.827934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2fe6f5c4-4d32-4737-b8c3-34900e20d7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:40.837780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c72c1da8bb84367b27f246170f82bdf', 'request_id': 'req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:40.871002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c72c1da8bb84367b27f246170f82bdf', 'request_id': 'req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:40.903546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] The token cache is being invalidate because project 1c72c1da8bb84367b27f246170f82bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:40.903781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:40.907659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:40.912414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 944/1891] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:40 2022] DELETE /identity/v3/projects/1c72c1da8bb84367b27f246170f82bdf => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:40.913874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:40.918470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:40.972941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:41.042759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6f5c4-4d32-4737-b8c3-34900e20d7f6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:41.063576 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcb960-9052-4e12-9499-5aa912f8830c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:41.065259 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcb960-9052-4e12-9499-5aa912f8830c service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:41.065754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcb960-9052-4e12-9499-5aa912f8830c service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:41.066231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcb960-9052-4e12-9499-5aa912f8830c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:41.069358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b7dcb960-9052-4e12-9499-5aa912f8830c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:41.071550 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5215f-6cbb-4b78-b1bd-a61e9310a38e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:41.099156 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcb960-9052-4e12-9499-5aa912f8830c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:41.101911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcb960-9052-4e12-9499-5aa912f8830c service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:41.119893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:41.125920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 948/1892] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:41.127041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcb960-9052-4e12-9499-5aa912f8830c service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:41.130300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b7dcb960-9052-4e12-9499-5aa912f8830c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:41.173306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a325c-22c4-4cf5-b3a2-07b397df5131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:41.174006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a325c-22c4-4cf5-b3a2-07b397df5131 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:41.174286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a325c-22c4-4cf5-b3a2-07b397df5131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:41.175912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a325c-22c4-4cf5-b3a2-07b397df5131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:41.177701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a325c-22c4-4cf5-b3a2-07b397df5131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:41.181615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a325c-22c4-4cf5-b3a2-07b397df5131 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:41.203598 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 945/1893] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:41.209223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a325c-22c4-4cf5-b3a2-07b397df5131 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:41.237912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a325c-22c4-4cf5-b3a2-07b397df5131 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:41.243343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac958c41-fd86-4d45-8c0f-f3813f085c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:41.244071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcb960-9052-4e12-9499-5aa912f8830c service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:41.244192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958c41-fd86-4d45-8c0f-f3813f085c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:41.244614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958c41-fd86-4d45-8c0f-f3813f085c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:41.244896 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958c41-fd86-4d45-8c0f-f3813f085c06 admin admin] PATH_INFO: `/v3/projects/414c267235104e65900db5194c0a1ca3/users/0ee57d4215934a4e89a4bb6fc88876b9/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:41.248622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac958c41-fd86-4d45-8c0f-f3813f085c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=414c267235104e65900db5194c0a1ca3, user_id=0ee57d4215934a4e89a4bb6fc88876b9, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:41.251676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac958c41-fd86-4d45-8c0f-f3813f085c06 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:41.252300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:41.254242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:41.254579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:41.256072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] PATH_INFO: `/v3/users/33c023ee921a47ecb97d2afc026bc85f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:41.258785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=33c023ee921a47ecb97d2afc026bc85f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:41.265479 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:41.266202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 946/1894] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:41 2022] PUT /identity/v3/projects/414c267235104e65900db5194c0a1ca3/users/0ee57d4215934a4e89a4bb6fc88876b9/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:41.279005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af853-55fd-405c-95c9-35364e4e2e98 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:41.279316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af853-55fd-405c-95c9-35364e4e2e98 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:41.279595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af853-55fd-405c-95c9-35364e4e2e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:41.340062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8b9af853-55fd-405c-95c9-35364e4e2e98 None None] MFA Rules not processed for user `0ee57d4215934a4e89a4bb6fc88876b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:41.342094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8b9af853-55fd-405c-95c9-35364e4e2e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:41.377251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33c023ee921a47ecb97d2afc026bc85f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:41.388037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33c023ee921a47ecb97d2afc026bc85f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:41.402832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33c023ee921a47ecb97d2afc026bc85f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:41.443709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 947/1895] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:41.447836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33c023ee921a47ecb97d2afc026bc85f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:41.453489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33c023ee921a47ecb97d2afc026bc85f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:41.455687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9af853-55fd-405c-95c9-35364e4e2e98 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:41.457458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8b9af853-55fd-405c-95c9-35364e4e2e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:41.462046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 949/1896] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:41 2022] DELETE /identity/v3/users/33c023ee921a47ecb97d2afc026bc85f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:41.548073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9af853-55fd-405c-95c9-35364e4e2e98 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:41.626002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29f0c2-03cc-4a27-bf2d-f9406d04ac3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:41.628159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29f0c2-03cc-4a27-bf2d-f9406d04ac3c service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:41.628715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29f0c2-03cc-4a27-bf2d-f9406d04ac3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:41.629290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29f0c2-03cc-4a27-bf2d-f9406d04ac3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:41.633868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5f29f0c2-03cc-4a27-bf2d-f9406d04ac3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:41.669004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:41.735880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29f0c2-03cc-4a27-bf2d-f9406d04ac3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:41.737495 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29f0c2-03cc-4a27-bf2d-f9406d04ac3c service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:41.749549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 948/1897] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:27:41.842638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:41.844932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:41.867291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7f54b-4547-4530-b69f-f8e88bb463cf admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:41.877591 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459b224-fa1c-4316-819e-f5f23f612c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:41.885345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b224-fa1c-4316-819e-f5f23f612c6f service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:41.885863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b224-fa1c-4316-819e-f5f23f612c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:41.886281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b224-fa1c-4316-819e-f5f23f612c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:41.889616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d459b224-fa1c-4316-819e-f5f23f612c6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:42.057072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459b224-fa1c-4316-819e-f5f23f612c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:42.058674 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459b224-fa1c-4316-819e-f5f23f612c6f service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:42.089519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 950/1898] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:42.313962 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29f0c2-03cc-4a27-bf2d-f9406d04ac3c service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:42.315802 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5f29f0c2-03cc-4a27-bf2d-f9406d04ac3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:42.422202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29f0c2-03cc-4a27-bf2d-f9406d04ac3c service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:42.427851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:42.429043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:42.429415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:42.429794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] PATH_INFO: `/v3/users/7123493be5a243e285ddb78c49c020a6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:42.431142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7123493be5a243e285ddb78c49c020a6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:42.433558 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:42.528776 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7123493be5a243e285ddb78c49c020a6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:42.537634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7123493be5a243e285ddb78c49c020a6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:42.553179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7123493be5a243e285ddb78c49c020a6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:42.554033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7123493be5a243e285ddb78c49c020a6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:42.554940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7123493be5a243e285ddb78c49c020a6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:42.585867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 949/1899] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:42 2022] DELETE /identity/v3/users/7123493be5a243e285ddb78c49c020a6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:42.587680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77ccf5-577c-4c04-8e33-87f467de8309 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:42.588452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77ccf5-577c-4c04-8e33-87f467de8309 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:42.588674 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77ccf5-577c-4c04-8e33-87f467de8309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:42.598492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:42.620205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:42.625918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:42.666018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8b77ccf5-577c-4c04-8e33-87f467de8309 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:42.673185 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8b77ccf5-577c-4c04-8e33-87f467de8309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:42.747851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:42.810726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3a4ba-b69b-4311-8d98-d446e3ec09b6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:42.825964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6aa4d0-45af-4c5d-a735-3723a241435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:42.828008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6aa4d0-45af-4c5d-a735-3723a241435f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:42.829732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6aa4d0-45af-4c5d-a735-3723a241435f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:42.829732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6aa4d0-45af-4c5d-a735-3723a241435f admin admin] PATH_INFO: `/v3/projects/cb70ca18641044b7903bd22588073335` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:42.832979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6aa4d0-45af-4c5d-a735-3723a241435f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb70ca18641044b7903bd22588073335)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:42.837854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6aa4d0-45af-4c5d-a735-3723a241435f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:42.872220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 951/1900] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:42.917384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77ccf5-577c-4c04-8e33-87f467de8309 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:42.919255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8b77ccf5-577c-4c04-8e33-87f467de8309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:42.955733 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9e6aa4d0-45af-4c5d-a735-3723a241435f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb70ca18641044b7903bd22588073335', 'request_id': 'req-9e6aa4d0-45af-4c5d-a735-3723a241435f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:42.974083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9e6aa4d0-45af-4c5d-a735-3723a241435f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb70ca18641044b7903bd22588073335', 'request_id': 'req-9e6aa4d0-45af-4c5d-a735-3723a241435f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:42.987063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9e6aa4d0-45af-4c5d-a735-3723a241435f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb70ca18641044b7903bd22588073335', 'request_id': 'req-9e6aa4d0-45af-4c5d-a735-3723a241435f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:43.015273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9e6aa4d0-45af-4c5d-a735-3723a241435f admin admin] The token cache is being invalidate because project cb70ca18641044b7903bd22588073335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:43.016129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9e6aa4d0-45af-4c5d-a735-3723a241435f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:43.017560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9e6aa4d0-45af-4c5d-a735-3723a241435f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:43.020982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 950/1901] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:42 2022] DELETE /identity/v3/projects/cb70ca18641044b7903bd22588073335 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:43.026076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd380e87-873a-46d2-a712-1ff96d794853 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:43.026693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd380e87-873a-46d2-a712-1ff96d794853 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:43.027424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd380e87-873a-46d2-a712-1ff96d794853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:43.034345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77ccf5-577c-4c04-8e33-87f467de8309 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:43.060909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dd380e87-873a-46d2-a712-1ff96d794853 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:43.063927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dd380e87-873a-46d2-a712-1ff96d794853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:43.130214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cb448-7342-47fa-852f-a98ba4555de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:43.131335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cb448-7342-47fa-852f-a98ba4555de6 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:43.131828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cb448-7342-47fa-852f-a98ba4555de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:43.132396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cb448-7342-47fa-852f-a98ba4555de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:43.134831 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-213cb448-7342-47fa-852f-a98ba4555de6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:43.157481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 951/1902] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:43.167971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4733ed-36d1-4c37-835e-b31e509cc6c0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:43.168332 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4733ed-36d1-4c37-835e-b31e509cc6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:43.168564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4733ed-36d1-4c37-835e-b31e509cc6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:43.190715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1a4733ed-36d1-4c37-835e-b31e509cc6c0 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:43.191929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1a4733ed-36d1-4c37-835e-b31e509cc6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:43.206260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 952/1903] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:43.207914 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4733ed-36d1-4c37-835e-b31e509cc6c0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:43.219914 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4733ed-36d1-4c37-835e-b31e509cc6c0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:43.228357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7382d4-9de6-4e0f-b4b0-2971fb1719be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:43.229610 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7382d4-9de6-4e0f-b4b0-2971fb1719be admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:43.229996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7382d4-9de6-4e0f-b4b0-2971fb1719be admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:43.230397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7382d4-9de6-4e0f-b4b0-2971fb1719be admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:43.231251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7382d4-9de6-4e0f-b4b0-2971fb1719be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:43.231743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7382d4-9de6-4e0f-b4b0-2971fb1719be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:43.233647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7382d4-9de6-4e0f-b4b0-2971fb1719be admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:43.252583 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 953/1904] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:43.255970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cb448-7342-47fa-852f-a98ba4555de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:43.258365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7382d4-9de6-4e0f-b4b0-2971fb1719be admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:43.258470 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cb448-7342-47fa-852f-a98ba4555de6 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:43.271475 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7382d4-9de6-4e0f-b4b0-2971fb1719be admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:43.275010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 952/1905] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:43.276663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc346a59-7a6b-4b4b-8897-733951a35094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:43.278560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346a59-7a6b-4b4b-8897-733951a35094 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:43.278913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346a59-7a6b-4b4b-8897-733951a35094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:43.279367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346a59-7a6b-4b4b-8897-733951a35094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:43.280106 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc346a59-7a6b-4b4b-8897-733951a35094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:43.282741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc346a59-7a6b-4b4b-8897-733951a35094 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:43.327202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 954/1906] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:43 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:43.334348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cb448-7342-47fa-852f-a98ba4555de6 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:43.348782 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cb448-7342-47fa-852f-a98ba4555de6 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:43.355535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:43.445829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7a222-70ac-4e53-9452-54e3504675fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:43.446550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a222-70ac-4e53-9452-54e3504675fe admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:43.446933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a222-70ac-4e53-9452-54e3504675fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:43.447648 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a222-70ac-4e53-9452-54e3504675fe admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:43.448281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7a222-70ac-4e53-9452-54e3504675fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:43.461471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7a222-70ac-4e53-9452-54e3504675fe admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:43.520441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 953/1907] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:43 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:43.526692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc346a59-7a6b-4b4b-8897-733951a35094 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:43.540322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc346a59-7a6b-4b4b-8897-733951a35094 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:43.549805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72613d96-07cb-4707-bf6b-98c9d7ccc1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:43.552528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72613d96-07cb-4707-bf6b-98c9d7ccc1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:43.552528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72613d96-07cb-4707-bf6b-98c9d7ccc1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:43.552528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72613d96-07cb-4707-bf6b-98c9d7ccc1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:43.552528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72613d96-07cb-4707-bf6b-98c9d7ccc1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:43.557400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72613d96-07cb-4707-bf6b-98c9d7ccc1f6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:43.570792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 955/1908] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:43.574796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7a222-70ac-4e53-9452-54e3504675fe admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:43.587281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7a222-70ac-4e53-9452-54e3504675fe admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:43.594205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e81ecc-fe00-47c4-9850-6d3fae4c7f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:43.594946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e81ecc-fe00-47c4-9850-6d3fae4c7f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:43.595556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e81ecc-fe00-47c4-9850-6d3fae4c7f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:43.595845 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e81ecc-fe00-47c4-9850-6d3fae4c7f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:43.603105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e81ecc-fe00-47c4-9850-6d3fae4c7f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:43.605176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e81ecc-fe00-47c4-9850-6d3fae4c7f04 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:43.625713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 954/1909] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:43.626532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72613d96-07cb-4707-bf6b-98c9d7ccc1f6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:43.643650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72613d96-07cb-4707-bf6b-98c9d7ccc1f6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:43.657219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808a998-6de6-44f2-959d-c5abc3832cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:43.658651 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808a998-6de6-44f2-959d-c5abc3832cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:43.658945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808a998-6de6-44f2-959d-c5abc3832cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:43.659218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808a998-6de6-44f2-959d-c5abc3832cd1 admin admin] PATH_INFO: `/v3/projects/536e5b85061c482f96facb5746c7884f/users/abcb867ddbbd4be4a398748fa731f6df/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:43.664768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:43.688284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808a998-6de6-44f2-959d-c5abc3832cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536e5b85061c482f96facb5746c7884f, user_id=abcb867ddbbd4be4a398748fa731f6df, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:43.694407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808a998-6de6-44f2-959d-c5abc3832cd1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:43.726573 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 956/1910] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:43 2022] PUT /identity/v3/projects/536e5b85061c482f96facb5746c7884f/users/abcb867ddbbd4be4a398748fa731f6df/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:43.738687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e739-8362-4f9c-b889-95f18a06263a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:43.739155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e739-8362-4f9c-b889-95f18a06263a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:43.739277 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e739-8362-4f9c-b889-95f18a06263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:43.775475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ff76e739-8362-4f9c-b889-95f18a06263a None None] MFA Rules not processed for user `abcb867ddbbd4be4a398748fa731f6df`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:43.778873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ff76e739-8362-4f9c-b889-95f18a06263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:43.902163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 955/1911] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:43.907050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808a998-6de6-44f2-959d-c5abc3832cd1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:44.001405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808a998-6de6-44f2-959d-c5abc3832cd1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:44.007752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fd511-789d-4d85-8da8-96f69f5f25aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:44.008439 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fd511-789d-4d85-8da8-96f69f5f25aa admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:44.009604 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fd511-789d-4d85-8da8-96f69f5f25aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:44.010050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fd511-789d-4d85-8da8-96f69f5f25aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:44.010683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fd511-789d-4d85-8da8-96f69f5f25aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:44.012935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fd511-789d-4d85-8da8-96f69f5f25aa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:44.049381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 957/1912] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:43 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:44.051375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e739-8362-4f9c-b889-95f18a06263a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:44.063965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e739-8362-4f9c-b889-95f18a06263a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:44.145731 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b48f3-02c6-4dc1-b8c0-a321928f830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:44.146121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b48f3-02c6-4dc1-b8c0-a321928f830a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:44.146722 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b48f3-02c6-4dc1-b8c0-a321928f830a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:44.146722 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b48f3-02c6-4dc1-b8c0-a321928f830a admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:44.147566 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b48f3-02c6-4dc1-b8c0-a321928f830a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:44.149523 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b48f3-02c6-4dc1-b8c0-a321928f830a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:44.174382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 956/1913] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:44 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:44.177926 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fd511-789d-4d85-8da8-96f69f5f25aa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:44.189884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fd511-789d-4d85-8da8-96f69f5f25aa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:44.196268 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd5e97-124d-4192-a032-5a0091078f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:44.197566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5e97-124d-4192-a032-5a0091078f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:44.197566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5e97-124d-4192-a032-5a0091078f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:44.197566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5e97-124d-4192-a032-5a0091078f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:44.198277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd5e97-124d-4192-a032-5a0091078f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:44.200129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd5e97-124d-4192-a032-5a0091078f93 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:44.215512 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 958/1914] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:44.219911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b48f3-02c6-4dc1-b8c0-a321928f830a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:44.232073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b48f3-02c6-4dc1-b8c0-a321928f830a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:44.236963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b909d39-45eb-4de2-bb98-ea0cf8e8e2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:44.237893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b909d39-45eb-4de2-bb98-ea0cf8e8e2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:44.238242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b909d39-45eb-4de2-bb98-ea0cf8e8e2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:44.238514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b909d39-45eb-4de2-bb98-ea0cf8e8e2c7 admin admin] PATH_INFO: `/v3/projects/62442e85b57b4ef5aabc93242c5eeafd/users/7d44710c2291482b934d00e5c6a97b59/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:44.241293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:44.258639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b909d39-45eb-4de2-bb98-ea0cf8e8e2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62442e85b57b4ef5aabc93242c5eeafd, user_id=7d44710c2291482b934d00e5c6a97b59, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:44.261294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b909d39-45eb-4de2-bb98-ea0cf8e8e2c7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:44.281545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 957/1915] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:44 2022] PUT /identity/v3/projects/62442e85b57b4ef5aabc93242c5eeafd/users/7d44710c2291482b934d00e5c6a97b59/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:44.285900 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd5e97-124d-4192-a032-5a0091078f93 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:44.303701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd5e97-124d-4192-a032-5a0091078f93 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:44.385554 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354d071-847c-4e30-8556-05c968807240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:44.386348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354d071-847c-4e30-8556-05c968807240 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:44.386620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354d071-847c-4e30-8556-05c968807240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:44.386917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354d071-847c-4e30-8556-05c968807240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:44.387657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354d071-847c-4e30-8556-05c968807240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:44.389361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354d071-847c-4e30-8556-05c968807240 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:44.402694 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 959/1916] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:44.406887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b909d39-45eb-4de2-bb98-ea0cf8e8e2c7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:44.418109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b909d39-45eb-4de2-bb98-ea0cf8e8e2c7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:44.422896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a6ec6-e569-45c8-9483-f4d0e5c2988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:44.424862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a6ec6-e569-45c8-9483-f4d0e5c2988c admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:44.424862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a6ec6-e569-45c8-9483-f4d0e5c2988c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:44.424862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a6ec6-e569-45c8-9483-f4d0e5c2988c admin admin] PATH_INFO: `/v3/projects/62442e85b57b4ef5aabc93242c5eeafd/users/7d44710c2291482b934d00e5c6a97b59/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:44.426673 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a6ec6-e569-45c8-9483-f4d0e5c2988c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62442e85b57b4ef5aabc93242c5eeafd, user_id=7d44710c2291482b934d00e5c6a97b59, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:44.429427 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a6ec6-e569-45c8-9483-f4d0e5c2988c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:44.449558 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 958/1917] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:44 2022] PUT /identity/v3/projects/62442e85b57b4ef5aabc93242c5eeafd/users/7d44710c2291482b934d00e5c6a97b59/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:44.460394 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c5ae5-b6cd-40d2-910b-82433c4be193 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:44.460726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c5ae5-b6cd-40d2-910b-82433c4be193 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:44.461004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c5ae5-b6cd-40d2-910b-82433c4be193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:44.546355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3c9c5ae5-b6cd-40d2-910b-82433c4be193 None None] MFA Rules not processed for user `7d44710c2291482b934d00e5c6a97b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:44.551769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3c9c5ae5-b6cd-40d2-910b-82433c4be193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:44.577805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a6ec6-e569-45c8-9483-f4d0e5c2988c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:44.579753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e12a6ec6-e569-45c8-9483-f4d0e5c2988c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:44.634162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:44.691906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a6ec6-e569-45c8-9483-f4d0e5c2988c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:44.704930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 960/1918] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:44.706044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:44.708063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:44.708568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:44.709616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] PATH_INFO: `/v3/projects/0eba41d34fde4bd0b11906f2546797c9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:44.711502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eba41d34fde4bd0b11906f2546797c9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:44.713978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:44.719280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c5ae5-b6cd-40d2-910b-82433c4be193 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:44.721156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3c9c5ae5-b6cd-40d2-910b-82433c4be193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:44.821018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eba41d34fde4bd0b11906f2546797c9', 'request_id': 'req-005dc5b8-1be2-4619-95cf-0dff93e9032a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:44.842607 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c5ae5-b6cd-40d2-910b-82433c4be193 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:44.856948 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eba41d34fde4bd0b11906f2546797c9', 'request_id': 'req-005dc5b8-1be2-4619-95cf-0dff93e9032a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:44.873152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eba41d34fde4bd0b11906f2546797c9', 'request_id': 'req-005dc5b8-1be2-4619-95cf-0dff93e9032a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:44.908769 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] The token cache is being invalidate because project 0eba41d34fde4bd0b11906f2546797c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:44.909068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:44.909833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:44.912322 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 959/1919] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:44 2022] DELETE /identity/v3/projects/0eba41d34fde4bd0b11906f2546797c9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:44.916343 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:44.920955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:44.961402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b390d0-bd0a-43d3-ba8c-b14fe4c313de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:44.962232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b390d0-bd0a-43d3-ba8c-b14fe4c313de service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:44.962696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b390d0-bd0a-43d3-ba8c-b14fe4c313de service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:44.965097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b390d0-bd0a-43d3-ba8c-b14fe4c313de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:44.971425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-24b390d0-bd0a-43d3-ba8c-b14fe4c313de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:45.030573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005dc5b8-1be2-4619-95cf-0dff93e9032a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:45.035449 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:45.037375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:45.037657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:45.037930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] PATH_INFO: `/v3/users/d6fa886f023c4be8ad30c732a7f00f11` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:45.052282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6fa886f023c4be8ad30c732a7f00f11)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:45.058208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:45.064966 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:45.066602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b390d0-bd0a-43d3-ba8c-b14fe4c313de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:45.068215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b390d0-bd0a-43d3-ba8c-b14fe4c313de service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:45.092473 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 961/1920] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:45.196783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b390d0-bd0a-43d3-ba8c-b14fe4c313de service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:45.198273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-24b390d0-bd0a-43d3-ba8c-b14fe4c313de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:45.207242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6fa886f023c4be8ad30c732a7f00f11'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.214687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b390d0-bd0a-43d3-ba8c-b14fe4c313de service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:45.219515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cab6c-25d4-41de-b9a0-6e447c4a1283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:45.220760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cab6c-25d4-41de-b9a0-6e447c4a1283 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:45.221124 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cab6c-25d4-41de-b9a0-6e447c4a1283 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:45.221540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cab6c-25d4-41de-b9a0-6e447c4a1283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:45.225212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6fa886f023c4be8ad30c732a7f00f11'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.228681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fa2cab6c-25d4-41de-b9a0-6e447c4a1283 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:45.238161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6fa886f023c4be8ad30c732a7f00f11'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.272603 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6fa886f023c4be8ad30c732a7f00f11'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.274008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6fa886f023c4be8ad30c732a7f00f11'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.287659 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 960/1921] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:44 2022] DELETE /identity/v3/users/d6fa886f023c4be8ad30c732a7f00f11 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:45.327955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:45.339156 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:45.341185 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:45.352400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cab6c-25d4-41de-b9a0-6e447c4a1283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:45.354447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cab6c-25d4-41de-b9a0-6e447c4a1283 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:45.388444 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 962/1922] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:27:45.438336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcf16d-f799-40b3-a74d-cf021ff926d5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:45.443493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:45.444659 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:45.445008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:45.445476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] PATH_INFO: `/v3/users/3577e5c60e3e4de1a5b0e305ff7fdae0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:45.446877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3577e5c60e3e4de1a5b0e305ff7fdae0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:45.449155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:45.543420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3577e5c60e3e4de1a5b0e305ff7fdae0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.556575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3577e5c60e3e4de1a5b0e305ff7fdae0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.574396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3577e5c60e3e4de1a5b0e305ff7fdae0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.608339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3577e5c60e3e4de1a5b0e305ff7fdae0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.609502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3577e5c60e3e4de1a5b0e305ff7fdae0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.613563 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:45.625307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 961/1923] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:45 2022] DELETE /identity/v3/users/3577e5c60e3e4de1a5b0e305ff7fdae0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:45.629865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f163f-d8db-4ad4-a60c-87e933853271 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:45.630177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f163f-d8db-4ad4-a60c-87e933853271 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:45.631322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f163f-d8db-4ad4-a60c-87e933853271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:45.664734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-300f163f-d8db-4ad4-a60c-87e933853271 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:45.666253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-300f163f-d8db-4ad4-a60c-87e933853271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:45.769999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 963/1924] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:45.782136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:45.784111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:45.811613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f163f-d8db-4ad4-a60c-87e933853271 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:45.813657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-300f163f-d8db-4ad4-a60c-87e933853271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:45.831536 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f163f-d8db-4ad4-a60c-87e933853271 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:45.841078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:45.842337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:45.842906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:45.844374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] PATH_INFO: `/v3/users/abcb867ddbbd4be4a398748fa731f6df` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:45.845891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcb867ddbbd4be4a398748fa731f6df)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:45.848148 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:45.883409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2f10d-a2c5-40f7-8675-e3e2f19fd9a3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:45.896657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155b4a5-5af3-4d40-8c43-c6a471a115a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:45.897565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155b4a5-5af3-4d40-8c43-c6a471a115a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:45.897953 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155b4a5-5af3-4d40-8c43-c6a471a115a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:45.898371 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155b4a5-5af3-4d40-8c43-c6a471a115a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:45.917942 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155b4a5-5af3-4d40-8c43-c6a471a115a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:45.920476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155b4a5-5af3-4d40-8c43-c6a471a115a1 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:45.938204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 962/1925] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:45.952394 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcb867ddbbd4be4a398748fa731f6df'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.967838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcb867ddbbd4be4a398748fa731f6df'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.992964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcb867ddbbd4be4a398748fa731f6df'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.993758 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcb867ddbbd4be4a398748fa731f6df'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:45.994378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcb867ddbbd4be4a398748fa731f6df'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:46.033776 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 964/1926] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:45 2022] DELETE /identity/v3/users/abcb867ddbbd4be4a398748fa731f6df => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:46.042625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dd2d0-e196-467d-bbed-a1257bde0d19 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:46.047473 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dd2d0-e196-467d-bbed-a1257bde0d19 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:46.051092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dd2d0-e196-467d-bbed-a1257bde0d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:46.087998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8a1dd2d0-e196-467d-bbed-a1257bde0d19 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:46.090114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8a1dd2d0-e196-467d-bbed-a1257bde0d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:46.169125 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:46.171631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:46.221739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 963/1927] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:46.282341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:46.288387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253312a-dc30-48e5-b8a4-7969ba305d3e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:46.304402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:46.305531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:46.305867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:46.306096 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1 admin admin] PATH_INFO: `/v3/projects/89577944e9af432b8788a4dfe226fe46` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:46.308104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dd2d0-e196-467d-bbed-a1257bde0d19 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:46.309499 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8a1dd2d0-e196-467d-bbed-a1257bde0d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:46.310157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89577944e9af432b8788a4dfe226fe46)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:46.312244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:46.386107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dd2d0-e196-467d-bbed-a1257bde0d19 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:46.392266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe008056-c95a-48e7-bac8-637a99851cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:46.393483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe008056-c95a-48e7-bac8-637a99851cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:46.393825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe008056-c95a-48e7-bac8-637a99851cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:46.394106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe008056-c95a-48e7-bac8-637a99851cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:46.406456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe008056-c95a-48e7-bac8-637a99851cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:46.408088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe008056-c95a-48e7-bac8-637a99851cb5 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:46.428018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 964/1928] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:46.431216 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89577944e9af432b8788a4dfe226fe46', 'request_id': 'req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:46.443202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89577944e9af432b8788a4dfe226fe46', 'request_id': 'req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:46.452823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89577944e9af432b8788a4dfe226fe46', 'request_id': 'req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:46.465574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1 admin admin] The token cache is being invalidate because project 89577944e9af432b8788a4dfe226fe46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:46.465753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:46.466419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-47c18bcb-f27f-4cb2-afe5-d826a41e30c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:46.468540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 965/1929] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:46 2022] DELETE /identity/v3/projects/89577944e9af432b8788a4dfe226fe46 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:46.475339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd618c3-a96f-4ba7-ade7-6a4abba45071 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:46.475818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd618c3-a96f-4ba7-ade7-6a4abba45071 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:46.476095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd618c3-a96f-4ba7-ade7-6a4abba45071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:46.503409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ebd618c3-a96f-4ba7-ade7-6a4abba45071 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:46.504731 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ebd618c3-a96f-4ba7-ade7-6a4abba45071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:46.556394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:46.583495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 965/1930] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:46.591432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc54c-91ab-4455-ba9e-b2eb7839d481 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:46.591721 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc54c-91ab-4455-ba9e-b2eb7839d481 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:46.591999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc54c-91ab-4455-ba9e-b2eb7839d481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:46.620635 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-329cc54c-91ab-4455-ba9e-b2eb7839d481 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:46.621871 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-329cc54c-91ab-4455-ba9e-b2eb7839d481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:46.627675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd618c3-a96f-4ba7-ade7-6a4abba45071 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:46.629305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ebd618c3-a96f-4ba7-ade7-6a4abba45071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:46.648162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd618c3-a96f-4ba7-ade7-6a4abba45071 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:46.655427 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 966/1931] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:46.659864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:46.660960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:46.661247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:46.661445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc54c-91ab-4455-ba9e-b2eb7839d481 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:46.661546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] PATH_INFO: `/v3/projects/ab9d1d0f87344d78bd0ccb13f18cc313` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:46.662939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab9d1d0f87344d78bd0ccb13f18cc313)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:46.666296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:46.674794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc54c-91ab-4455-ba9e-b2eb7839d481 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:46.699458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bd6c3-be97-45f8-aea6-d8519f61bee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:46.700277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bd6c3-be97-45f8-aea6-d8519f61bee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:46.700434 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bd6c3-be97-45f8-aea6-d8519f61bee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:46.700726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bd6c3-be97-45f8-aea6-d8519f61bee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:46.701455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bd6c3-be97-45f8-aea6-d8519f61bee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:46.701749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bd6c3-be97-45f8-aea6-d8519f61bee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:46.703453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bd6c3-be97-45f8-aea6-d8519f61bee4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:46.720535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 967/1932] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:27:46.723728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bd6c3-be97-45f8-aea6-d8519f61bee4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:46.734205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bd6c3-be97-45f8-aea6-d8519f61bee4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:46.738557 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab9d1d0f87344d78bd0ccb13f18cc313', 'request_id': 'req-62165b94-8ed6-4fd0-a29e-9f4919bf66da'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:46.745486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab9d1d0f87344d78bd0ccb13f18cc313', 'request_id': 'req-62165b94-8ed6-4fd0-a29e-9f4919bf66da'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:46.751736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab9d1d0f87344d78bd0ccb13f18cc313', 'request_id': 'req-62165b94-8ed6-4fd0-a29e-9f4919bf66da'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:46.768113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] The token cache is being invalidate because project ab9d1d0f87344d78bd0ccb13f18cc313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:46.768678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:46.769666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:46.771613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 966/1933] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:46 2022] DELETE /identity/v3/projects/ab9d1d0f87344d78bd0ccb13f18cc313 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:46.775573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:46.777474 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:46.802982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc7c71-22a4-4de0-83bd-5d50d0a41643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:46.803990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc7c71-22a4-4de0-83bd-5d50d0a41643 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:46.804732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc7c71-22a4-4de0-83bd-5d50d0a41643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:46.805273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc7c71-22a4-4de0-83bd-5d50d0a41643 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:46.806190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc7c71-22a4-4de0-83bd-5d50d0a41643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:46.808447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc7c71-22a4-4de0-83bd-5d50d0a41643 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:46.848972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 968/1934] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:46 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:27:46.853499 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc7c71-22a4-4de0-83bd-5d50d0a41643 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:46.855356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3ccc7c71-22a4-4de0-83bd-5d50d0a41643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:46.865033 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62165b94-8ed6-4fd0-a29e-9f4919bf66da admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:46.938995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:46.957581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:46.959756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:46.960132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:46.960483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] PATH_INFO: `/v3/users/0ee57d4215934a4e89a4bb6fc88876b9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:46.962588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee57d4215934a4e89a4bb6fc88876b9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:46.965553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:46.972670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc7c71-22a4-4de0-83bd-5d50d0a41643 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:46.981279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286f6ce-ce44-4ca0-a9fd-09b89049360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:46.982455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286f6ce-ce44-4ca0-a9fd-09b89049360d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:46.982926 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286f6ce-ce44-4ca0-a9fd-09b89049360d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:46.983394 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286f6ce-ce44-4ca0-a9fd-09b89049360d admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:46.984124 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286f6ce-ce44-4ca0-a9fd-09b89049360d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:46.986399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286f6ce-ce44-4ca0-a9fd-09b89049360d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:46.994023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:47.028995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 969/1935] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:46 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:47.031006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286f6ce-ce44-4ca0-a9fd-09b89049360d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:47.033388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5286f6ce-ce44-4ca0-a9fd-09b89049360d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:47.045343 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee57d4215934a4e89a4bb6fc88876b9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.058152 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286f6ce-ce44-4ca0-a9fd-09b89049360d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:47.058762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee57d4215934a4e89a4bb6fc88876b9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.068486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee57d4215934a4e89a4bb6fc88876b9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.073333 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:47.076153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:47.076613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:47.077213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] PATH_INFO: `/v3/projects/536e5b85061c482f96facb5746c7884f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:47.078813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] RBAC: Authorizing `identity:delete_project(project_id=536e5b85061c482f96facb5746c7884f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:47.081506 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:47.082227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee57d4215934a4e89a4bb6fc88876b9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.082989 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee57d4215934a4e89a4bb6fc88876b9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.091135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 967/1936] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:46 2022] DELETE /identity/v3/users/0ee57d4215934a4e89a4bb6fc88876b9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:47.091961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:47.094519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:47.145420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536e5b85061c482f96facb5746c7884f', 'request_id': 'req-3adc6c5e-6112-485f-b62c-2c794c0a848e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.155705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536e5b85061c482f96facb5746c7884f', 'request_id': 'req-3adc6c5e-6112-485f-b62c-2c794c0a848e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.163864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536e5b85061c482f96facb5746c7884f', 'request_id': 'req-3adc6c5e-6112-485f-b62c-2c794c0a848e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.177152 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] The token cache is being invalidate because project 536e5b85061c482f96facb5746c7884f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:47.177444 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.178143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.178981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d54a2-fdad-4d1c-9b99-a1bc290aa35a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:47.180008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 970/1937] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:47 2022] DELETE /identity/v3/projects/536e5b85061c482f96facb5746c7884f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:47.183747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:47.185839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:47.248100 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a066b-3860-4ce2-9eeb-9056610f7851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:47.249252 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a066b-3860-4ce2-9eeb-9056610f7851 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:47.249252 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a066b-3860-4ce2-9eeb-9056610f7851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:47.249496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a066b-3860-4ce2-9eeb-9056610f7851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:47.250395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a066b-3860-4ce2-9eeb-9056610f7851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:47.252840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a066b-3860-4ce2-9eeb-9056610f7851 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:47.274542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc6c5e-6112-485f-b62c-2c794c0a848e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:47.276606 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 968/1938] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:47.279700 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:47.280600 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a066b-3860-4ce2-9eeb-9056610f7851 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:47.280740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:47.280936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:47.281214 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] PATH_INFO: `/v3/users/7d44710c2291482b934d00e5c6a97b59` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:47.282825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-207a066b-3860-4ce2-9eeb-9056610f7851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:47.284178 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d44710c2291482b934d00e5c6a97b59)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:47.286632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:47.299771 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a066b-3860-4ce2-9eeb-9056610f7851 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:47.306102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3c47b-ebc7-4102-9aef-d4f15229f0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:47.306986 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3c47b-ebc7-4102-9aef-d4f15229f0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:47.307266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3c47b-ebc7-4102-9aef-d4f15229f0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:47.307538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3c47b-ebc7-4102-9aef-d4f15229f0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:47.308278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3c47b-ebc7-4102-9aef-d4f15229f0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:47.309943 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3c47b-ebc7-4102-9aef-d4f15229f0e2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:47.321601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 969/1939] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:47.325495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3c47b-ebc7-4102-9aef-d4f15229f0e2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:47.339275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3c47b-ebc7-4102-9aef-d4f15229f0e2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:47.344843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a22767-4226-4571-89c3-b3071e0b344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:47.345802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a22767-4226-4571-89c3-b3071e0b344a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:47.346190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a22767-4226-4571-89c3-b3071e0b344a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:47.346367 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a22767-4226-4571-89c3-b3071e0b344a admin admin] PATH_INFO: `/v3/projects/a04fb6e772a44d65a5d3d84a4dccd7d4/users/6197194c6e554731a2eb75380d5146bd/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:47.367471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d44710c2291482b934d00e5c6a97b59'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.372925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a22767-4226-4571-89c3-b3071e0b344a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04fb6e772a44d65a5d3d84a4dccd7d4, user_id=6197194c6e554731a2eb75380d5146bd, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:47.376813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d44710c2291482b934d00e5c6a97b59'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.377350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a22767-4226-4571-89c3-b3071e0b344a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:47.386848 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:47.394125 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d44710c2291482b934d00e5c6a97b59'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.396143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d44710c2291482b934d00e5c6a97b59'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.397303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d44710c2291482b934d00e5c6a97b59'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.400736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 970/1940] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:47 2022] PUT /identity/v3/projects/a04fb6e772a44d65a5d3d84a4dccd7d4/users/6197194c6e554731a2eb75380d5146bd/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:47.412577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4674f1-30bf-4a22-b4f9-6fb257275bd4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:47.413083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4674f1-30bf-4a22-b4f9-6fb257275bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:47.413501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4674f1-30bf-4a22-b4f9-6fb257275bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:47.420114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:47.428004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 971/1941] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:47 2022] DELETE /identity/v3/users/7d44710c2291482b934d00e5c6a97b59 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:47.458089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1b4674f1-30bf-4a22-b4f9-6fb257275bd4 None None] MFA Rules not processed for user `6197194c6e554731a2eb75380d5146bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:47.460246 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1b4674f1-30bf-4a22-b4f9-6fb257275bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:47.544751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:47.547100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:47.612546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 971/1942] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:47.616946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4674f1-30bf-4a22-b4f9-6fb257275bd4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:47.621778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1b4674f1-30bf-4a22-b4f9-6fb257275bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:47.668365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd34df3-57cb-45ab-b69a-43dd0674e33a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:47.678293 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd252d28-abdd-42f7-86a4-d06a649e5f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:47.679352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd252d28-abdd-42f7-86a4-d06a649e5f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:47.679686 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd252d28-abdd-42f7-86a4-d06a649e5f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:47.679969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd252d28-abdd-42f7-86a4-d06a649e5f2e admin admin] PATH_INFO: `/v3/projects/414c267235104e65900db5194c0a1ca3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:47.682330 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd252d28-abdd-42f7-86a4-d06a649e5f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=414c267235104e65900db5194c0a1ca3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:47.686491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd252d28-abdd-42f7-86a4-d06a649e5f2e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:47.715655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4674f1-30bf-4a22-b4f9-6fb257275bd4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:47.722814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822d7a1-56e9-4f39-a766-b70e055df0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:47.729233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822d7a1-56e9-4f39-a766-b70e055df0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:47.730254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822d7a1-56e9-4f39-a766-b70e055df0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:47.730863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822d7a1-56e9-4f39-a766-b70e055df0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:47.731890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822d7a1-56e9-4f39-a766-b70e055df0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:47.740599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822d7a1-56e9-4f39-a766-b70e055df0e4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:47.766131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bd252d28-abdd-42f7-86a4-d06a649e5f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414c267235104e65900db5194c0a1ca3', 'request_id': 'req-bd252d28-abdd-42f7-86a4-d06a649e5f2e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.782253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bd252d28-abdd-42f7-86a4-d06a649e5f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414c267235104e65900db5194c0a1ca3', 'request_id': 'req-bd252d28-abdd-42f7-86a4-d06a649e5f2e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.784162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 972/1943] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:47 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:27:47.788240 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822d7a1-56e9-4f39-a766-b70e055df0e4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:47.790091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bd252d28-abdd-42f7-86a4-d06a649e5f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414c267235104e65900db5194c0a1ca3', 'request_id': 'req-bd252d28-abdd-42f7-86a4-d06a649e5f2e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.810218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bd252d28-abdd-42f7-86a4-d06a649e5f2e admin admin] The token cache is being invalidate because project 414c267235104e65900db5194c0a1ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:47.810402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bd252d28-abdd-42f7-86a4-d06a649e5f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.811430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bd252d28-abdd-42f7-86a4-d06a649e5f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:47.818437 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 972/1944] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:47 2022] DELETE /identity/v3/projects/414c267235104e65900db5194c0a1ca3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:47.821002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8953f6-e582-4548-b93d-c8ede396a787 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:47.825208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8953f6-e582-4548-b93d-c8ede396a787 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:47.825643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8953f6-e582-4548-b93d-c8ede396a787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:47.853202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1e8953f6-e582-4548-b93d-c8ede396a787 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:47.856712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1e8953f6-e582-4548-b93d-c8ede396a787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:47.890775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822d7a1-56e9-4f39-a766-b70e055df0e4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:47.898089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e9342-335c-49ae-9f4c-8609241c0ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:47.899117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e9342-335c-49ae-9f4c-8609241c0ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:47.899599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e9342-335c-49ae-9f4c-8609241c0ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:47.900107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e9342-335c-49ae-9f4c-8609241c0ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:47.901460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e9342-335c-49ae-9f4c-8609241c0ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:47.904677 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e9342-335c-49ae-9f4c-8609241c0ab9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:47.944668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 973/1945] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:47 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:27:47.945624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e9342-335c-49ae-9f4c-8609241c0ab9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:47.949914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3b7e9342-335c-49ae-9f4c-8609241c0ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:47.968259 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e9342-335c-49ae-9f4c-8609241c0ab9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:47.982508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ad0c3-87ae-4ccf-83c7-a308fb51b937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:47.982508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ad0c3-87ae-4ccf-83c7-a308fb51b937 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:47.982508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ad0c3-87ae-4ccf-83c7-a308fb51b937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:47.982508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ad0c3-87ae-4ccf-83c7-a308fb51b937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:47.983077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ad0c3-87ae-4ccf-83c7-a308fb51b937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:47.983152 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 973/1946] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:47.984122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ad0c3-87ae-4ccf-83c7-a308fb51b937 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:47.985376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:47.987717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e246f-d8b6-47b5-b7c0-1d63d73aba08 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:47.988041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e246f-d8b6-47b5-b7c0-1d63d73aba08 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:47.988352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e246f-d8b6-47b5-b7c0-1d63d73aba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.002552 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 974/1947] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:27:48.003683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ad0c3-87ae-4ccf-83c7-a308fb51b937 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:48.019897 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ad0c3-87ae-4ccf-83c7-a308fb51b937 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:48.026065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064233b-2023-4412-887b-44b5ab805c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:48.029610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064233b-2023-4412-887b-44b5ab805c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.029610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064233b-2023-4412-887b-44b5ab805c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.029610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064233b-2023-4412-887b-44b5ab805c95 admin admin] PATH_INFO: `/v3/projects/988be0d696744ce89048c77d7dc74b8c/users/ddc547bac3c84ff5bba63ed13c353077/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.038752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e66e246f-d8b6-47b5-b7c0-1d63d73aba08 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:48.040783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e66e246f-d8b6-47b5-b7c0-1d63d73aba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:48.050588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 974/1948] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:48.056753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e246f-d8b6-47b5-b7c0-1d63d73aba08 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:48.063172 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064233b-2023-4412-887b-44b5ab805c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988be0d696744ce89048c77d7dc74b8c, user_id=ddc547bac3c84ff5bba63ed13c353077, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:48.066705 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064233b-2023-4412-887b-44b5ab805c95 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:48.098371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e246f-d8b6-47b5-b7c0-1d63d73aba08 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:48.101429 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 975/1949] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:48 2022] PUT /identity/v3/projects/988be0d696744ce89048c77d7dc74b8c/users/ddc547bac3c84ff5bba63ed13c353077/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:48.103761 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064233b-2023-4412-887b-44b5ab805c95 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:48.117605 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:48.191102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02798da3-86d4-4767-959c-65520d60bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:48.192257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02798da3-86d4-4767-959c-65520d60bfab admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.192897 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02798da3-86d4-4767-959c-65520d60bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.192897 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02798da3-86d4-4767-959c-65520d60bfab admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.193701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02798da3-86d4-4767-959c-65520d60bfab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:48.194066 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02798da3-86d4-4767-959c-65520d60bfab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:48.196117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02798da3-86d4-4767-959c-65520d60bfab admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:48.210991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 975/1950] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:48.212135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02798da3-86d4-4767-959c-65520d60bfab admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:48.214155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-02798da3-86d4-4767-959c-65520d60bfab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:48.232111 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02798da3-86d4-4767-959c-65520d60bfab admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:48.238762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064233b-2023-4412-887b-44b5ab805c95 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:48.244101 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c8a74-d0a9-470b-977c-32d1235a0998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:48.244883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c8a74-d0a9-470b-977c-32d1235a0998 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.245162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c8a74-d0a9-470b-977c-32d1235a0998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.245436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c8a74-d0a9-470b-977c-32d1235a0998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.246182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c8a74-d0a9-470b-977c-32d1235a0998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:48.248351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c8a74-d0a9-470b-977c-32d1235a0998 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:48.254768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:48.255283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.255736 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.256020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] PATH_INFO: `/v3/projects/62442e85b57b4ef5aabc93242c5eeafd` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.257987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] RBAC: Authorizing `identity:delete_project(project_id=62442e85b57b4ef5aabc93242c5eeafd)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:48.259947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:48.260063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 976/1951] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:48.264358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c8a74-d0a9-470b-977c-32d1235a0998 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:48.276249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c8a74-d0a9-470b-977c-32d1235a0998 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:48.287228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462eee96-3622-4a33-b26d-99ed7daba019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:48.289241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462eee96-3622-4a33-b26d-99ed7daba019 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.289592 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462eee96-3622-4a33-b26d-99ed7daba019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.289804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462eee96-3622-4a33-b26d-99ed7daba019 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.290672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462eee96-3622-4a33-b26d-99ed7daba019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:48.292818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462eee96-3622-4a33-b26d-99ed7daba019 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:48.358148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 977/1952] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:48 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:48.362671 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462eee96-3622-4a33-b26d-99ed7daba019 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:48.367156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62442e85b57b4ef5aabc93242c5eeafd', 'request_id': 'req-64a2558c-580e-47bd-8bf3-8d55d50d353a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:48.381578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62442e85b57b4ef5aabc93242c5eeafd', 'request_id': 'req-64a2558c-580e-47bd-8bf3-8d55d50d353a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:48.392070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62442e85b57b4ef5aabc93242c5eeafd', 'request_id': 'req-64a2558c-580e-47bd-8bf3-8d55d50d353a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:48.410504 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] The token cache is being invalidate because project 62442e85b57b4ef5aabc93242c5eeafd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:48.411023 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:48.411900 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:48.417444 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 976/1953] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:48 2022] DELETE /identity/v3/projects/62442e85b57b4ef5aabc93242c5eeafd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:48.428822 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:48.435320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:48.499688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462eee96-3622-4a33-b26d-99ed7daba019 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:48.522666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62b5c0-ddbe-48fb-ae4f-9523254afecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:48.526235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b5c0-ddbe-48fb-ae4f-9523254afecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.527476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b5c0-ddbe-48fb-ae4f-9523254afecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.527987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b5c0-ddbe-48fb-ae4f-9523254afecb admin admin] PATH_INFO: `/v3/projects/988be0d696744ce89048c77d7dc74b8c/users/ddc547bac3c84ff5bba63ed13c353077/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.542922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62b5c0-ddbe-48fb-ae4f-9523254afecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=988be0d696744ce89048c77d7dc74b8c, user_id=ddc547bac3c84ff5bba63ed13c353077, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:48.550398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62b5c0-ddbe-48fb-ae4f-9523254afecb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:48.552295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2558c-580e-47bd-8bf3-8d55d50d353a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:48.561489 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f1a66-2ace-400c-af93-ed87f618d09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:48.563370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f1a66-2ace-400c-af93-ed87f618d09e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.563805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f1a66-2ace-400c-af93-ed87f618d09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.564077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f1a66-2ace-400c-af93-ed87f618d09e admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.565342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f1a66-2ace-400c-af93-ed87f618d09e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:48.568373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f1a66-2ace-400c-af93-ed87f618d09e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:48.581662 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 978/1954] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:48 2022] PUT /identity/v3/projects/988be0d696744ce89048c77d7dc74b8c/users/ddc547bac3c84ff5bba63ed13c353077/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:48.593135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b780501-234b-48e0-8e43-2ff24cbfb45c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.593556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b780501-234b-48e0-8e43-2ff24cbfb45c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.594472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b780501-234b-48e0-8e43-2ff24cbfb45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.605067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 977/1955] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:48 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:48.606079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce5134-9bee-48db-9153-0711517521a9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.606372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce5134-9bee-48db-9153-0711517521a9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.606920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce5134-9bee-48db-9153-0711517521a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.620428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4b780501-234b-48e0-8e43-2ff24cbfb45c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:48.622610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4b780501-234b-48e0-8e43-2ff24cbfb45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:48.660604 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7cce5134-9bee-48db-9153-0711517521a9 None None] MFA Rules not processed for user `ddc547bac3c84ff5bba63ed13c353077`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:48.661840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7cce5134-9bee-48db-9153-0711517521a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:48.672146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:48.727951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:48.789395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 979/1956] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:48.789395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b780501-234b-48e0-8e43-2ff24cbfb45c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:48.810765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b780501-234b-48e0-8e43-2ff24cbfb45c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:48.826313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1b115-dcd4-41a7-8490-6a87634ca4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:48.827204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1b115-dcd4-41a7-8490-6a87634ca4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.828163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1b115-dcd4-41a7-8490-6a87634ca4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.828474 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1b115-dcd4-41a7-8490-6a87634ca4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.829395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1b115-dcd4-41a7-8490-6a87634ca4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:48.831542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1b115-dcd4-41a7-8490-6a87634ca4a3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:48.837127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 978/1957] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:48.838809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9c952-cc7d-4e63-ba9a-c40d8543eb15 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.839966 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9c952-cc7d-4e63-ba9a-c40d8543eb15 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.840429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9c952-cc7d-4e63-ba9a-c40d8543eb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.852975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 980/1958] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:48.853863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1b115-dcd4-41a7-8490-6a87634ca4a3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:48.857489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-07e1b115-dcd4-41a7-8490-6a87634ca4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:48.863477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-84b9c952-cc7d-4e63-ba9a-c40d8543eb15 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:48.865102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-84b9c952-cc7d-4e63-ba9a-c40d8543eb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:48.875119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 979/1959] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:48.876174 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9c952-cc7d-4e63-ba9a-c40d8543eb15 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:48.887384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9c952-cc7d-4e63-ba9a-c40d8543eb15 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:48.895322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a6cf1-5602-495f-b449-ad106ca5ae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:48.896475 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a6cf1-5602-495f-b449-ad106ca5ae0a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.896475 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a6cf1-5602-495f-b449-ad106ca5ae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.896676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a6cf1-5602-495f-b449-ad106ca5ae0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.897472 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a6cf1-5602-495f-b449-ad106ca5ae0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:48.899860 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a6cf1-5602-495f-b449-ad106ca5ae0a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:48.912177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 980/1960] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:48.913257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a6cf1-5602-495f-b449-ad106ca5ae0a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:48.924889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a6cf1-5602-495f-b449-ad106ca5ae0a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:48.930672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e00b4-5128-405f-b09e-c825f75c24a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:48.931360 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e00b4-5128-405f-b09e-c825f75c24a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.931695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e00b4-5128-405f-b09e-c825f75c24a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.931961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e00b4-5128-405f-b09e-c825f75c24a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.932888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e00b4-5128-405f-b09e-c825f75c24a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:48.933280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e00b4-5128-405f-b09e-c825f75c24a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:48.935096 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e00b4-5128-405f-b09e-c825f75c24a5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:48.956894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 981/1961] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:48.957854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e00b4-5128-405f-b09e-c825f75c24a5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:48.961358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1b115-dcd4-41a7-8490-6a87634ca4a3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:48.965481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ea7cb-e071-4651-b208-544e80833868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:48.966217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ea7cb-e071-4651-b208-544e80833868 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.966568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ea7cb-e071-4651-b208-544e80833868 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.966910 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ea7cb-e071-4651-b208-544e80833868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:48.976963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ea7cb-e071-4651-b208-544e80833868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:48.978167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e00b4-5128-405f-b09e-c825f75c24a5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:48.978658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ea7cb-e071-4651-b208-544e80833868 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:48.983463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bed72-1d63-480c-9359-ae3a4da10e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:48.985670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bed72-1d63-480c-9359-ae3a4da10e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:48.985670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bed72-1d63-480c-9359-ae3a4da10e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:48.985670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bed72-1d63-480c-9359-ae3a4da10e41 admin admin] PATH_INFO: `/v3/projects/85e3af7dfb5041dd9728f14c697dacd9/users/54ea7b7eb5b24dbe8c79e1947336b1a8/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.002138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bed72-1d63-480c-9359-ae3a4da10e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e3af7dfb5041dd9728f14c697dacd9, user_id=54ea7b7eb5b24dbe8c79e1947336b1a8, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:49.005365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bed72-1d63-480c-9359-ae3a4da10e41 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:49.006631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 981/1962] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:49.010848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ea7cb-e071-4651-b208-544e80833868 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:49.036118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ea7cb-e071-4651-b208-544e80833868 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:49.037217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 982/1963] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:48 2022] PUT /identity/v3/projects/85e3af7dfb5041dd9728f14c697dacd9/users/54ea7b7eb5b24dbe8c79e1947336b1a8/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:49.049376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f2e3d-6624-4635-842a-2437b10fc55b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.050794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f2e3d-6624-4635-842a-2437b10fc55b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.051085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f2e3d-6624-4635-842a-2437b10fc55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.135117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5a0f2e3d-6624-4635-842a-2437b10fc55b None None] MFA Rules not processed for user `54ea7b7eb5b24dbe8c79e1947336b1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:49.144217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5a0f2e3d-6624-4635-842a-2437b10fc55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:49.179929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37371d-7177-4088-ac2b-311ba013a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:49.180485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37371d-7177-4088-ac2b-311ba013a847 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.180790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37371d-7177-4088-ac2b-311ba013a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.181061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37371d-7177-4088-ac2b-311ba013a847 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.181758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37371d-7177-4088-ac2b-311ba013a847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:49.183689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37371d-7177-4088-ac2b-311ba013a847 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:49.254824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 982/1964] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:49 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:49.259198 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37371d-7177-4088-ac2b-311ba013a847 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:49.328980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 983/1965] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:49.330190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f2e3d-6624-4635-842a-2437b10fc55b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:49.344206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f2e3d-6624-4635-842a-2437b10fc55b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:49.348261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:49.352331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37371d-7177-4088-ac2b-311ba013a847 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:49.354215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dd364-9883-4861-9c92-7a1fa87f82ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:49.354920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dd364-9883-4861-9c92-7a1fa87f82ad admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.355205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dd364-9883-4861-9c92-7a1fa87f82ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.355471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dd364-9883-4861-9c92-7a1fa87f82ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.356549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dd364-9883-4861-9c92-7a1fa87f82ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:49.358834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dd364-9883-4861-9c92-7a1fa87f82ad admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:49.359132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a3dbb-1fa8-4bf3-885c-692be5672e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:49.359727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a3dbb-1fa8-4bf3-885c-692be5672e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.360024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a3dbb-1fa8-4bf3-885c-692be5672e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.361486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a3dbb-1fa8-4bf3-885c-692be5672e6b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.362445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a3dbb-1fa8-4bf3-885c-692be5672e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:49.364877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a3dbb-1fa8-4bf3-885c-692be5672e6b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:49.396845 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 983/1966] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:49 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:27:49.397976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a3dbb-1fa8-4bf3-885c-692be5672e6b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:49.404712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 984/1967] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:49 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:49.407893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dd364-9883-4861-9c92-7a1fa87f82ad admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:49.409780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a3dbb-1fa8-4bf3-885c-692be5672e6b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:49.424287 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:49.480955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59f3aa-3770-4c2b-a068-dc7f927ac7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:49.481540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dd364-9883-4861-9c92-7a1fa87f82ad admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:49.481652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59f3aa-3770-4c2b-a068-dc7f927ac7af admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.481919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59f3aa-3770-4c2b-a068-dc7f927ac7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.482891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59f3aa-3770-4c2b-a068-dc7f927ac7af admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.483644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59f3aa-3770-4c2b-a068-dc7f927ac7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:49.485307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59f3aa-3770-4c2b-a068-dc7f927ac7af admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:49.487093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad386615-b14b-4c5c-8c41-5b2291ff3eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:49.487849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad386615-b14b-4c5c-8c41-5b2291ff3eda admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.488296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad386615-b14b-4c5c-8c41-5b2291ff3eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.488658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad386615-b14b-4c5c-8c41-5b2291ff3eda admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.489363 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad386615-b14b-4c5c-8c41-5b2291ff3eda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:49.491318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad386615-b14b-4c5c-8c41-5b2291ff3eda admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:49.500542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 984/1968] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:49.502690 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59f3aa-3770-4c2b-a068-dc7f927ac7af admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:49.514135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59f3aa-3770-4c2b-a068-dc7f927ac7af admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:49.518203 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 985/1969] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:49 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:49.522025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430ea81-6e8c-479c-b1b4-763ed3e68135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:49.523130 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430ea81-6e8c-479c-b1b4-763ed3e68135 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.523335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad386615-b14b-4c5c-8c41-5b2291ff3eda admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:49.523420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430ea81-6e8c-479c-b1b4-763ed3e68135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.523784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430ea81-6e8c-479c-b1b4-763ed3e68135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.524893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430ea81-6e8c-479c-b1b4-763ed3e68135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:49.527398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430ea81-6e8c-479c-b1b4-763ed3e68135 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:49.538891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad386615-b14b-4c5c-8c41-5b2291ff3eda admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:49.545399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a460c-9604-45e1-83b0-47fc8d1625bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:49.546426 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a460c-9604-45e1-83b0-47fc8d1625bf admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.546738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a460c-9604-45e1-83b0-47fc8d1625bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.547035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a460c-9604-45e1-83b0-47fc8d1625bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.547805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a460c-9604-45e1-83b0-47fc8d1625bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:49.552546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 985/1970] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:49.552850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a460c-9604-45e1-83b0-47fc8d1625bf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:49.558351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430ea81-6e8c-479c-b1b4-763ed3e68135 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:49.563848 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 986/1971] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:49.568614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a460c-9604-45e1-83b0-47fc8d1625bf admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:49.578057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430ea81-6e8c-479c-b1b4-763ed3e68135 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:49.583858 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a460c-9604-45e1-83b0-47fc8d1625bf admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:49.584616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557b567-b48b-4258-aa5d-d3960a1cb445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:49.585692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557b567-b48b-4258-aa5d-d3960a1cb445 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.588520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557b567-b48b-4258-aa5d-d3960a1cb445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.588520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557b567-b48b-4258-aa5d-d3960a1cb445 admin admin] PATH_INFO: `/v3/projects/7c5dd28316824771bb77770a7504cd19/users/094a12c9102349449c7d813b71073868/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.591531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75348ae9-fb02-4ca2-9938-1310e899ae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:49.592988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75348ae9-fb02-4ca2-9938-1310e899ae4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.593272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75348ae9-fb02-4ca2-9938-1310e899ae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.593542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75348ae9-fb02-4ca2-9938-1310e899ae4a admin admin] PATH_INFO: `/v3/projects/4f2ed57d7f8c4eca96c01ae97e460f0b/users/5d66888df0a84d3d949f56c0d473f088/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.615615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75348ae9-fb02-4ca2-9938-1310e899ae4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2ed57d7f8c4eca96c01ae97e460f0b, user_id=5d66888df0a84d3d949f56c0d473f088, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:49.618738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75348ae9-fb02-4ca2-9938-1310e899ae4a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:49.628319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557b567-b48b-4258-aa5d-d3960a1cb445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5dd28316824771bb77770a7504cd19, user_id=094a12c9102349449c7d813b71073868, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:49.631836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557b567-b48b-4258-aa5d-d3960a1cb445 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:49.641913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 987/1972] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:49 2022] PUT /identity/v3/projects/4f2ed57d7f8c4eca96c01ae97e460f0b/users/5d66888df0a84d3d949f56c0d473f088/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:49.643091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75348ae9-fb02-4ca2-9938-1310e899ae4a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:49.645519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-75348ae9-fb02-4ca2-9938-1310e899ae4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:49.662314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 986/1973] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:49 2022] PUT /identity/v3/projects/7c5dd28316824771bb77770a7504cd19/users/094a12c9102349449c7d813b71073868/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:49.663496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557b567-b48b-4258-aa5d-d3960a1cb445 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:49.749000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75348ae9-fb02-4ca2-9938-1310e899ae4a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:49.772218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557b567-b48b-4258-aa5d-d3960a1cb445 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:49.789266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2bb37-68df-4d4c-8df6-e26289528263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:49.790423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2bb37-68df-4d4c-8df6-e26289528263 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.790883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2bb37-68df-4d4c-8df6-e26289528263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.791369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2bb37-68df-4d4c-8df6-e26289528263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.792865 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2bb37-68df-4d4c-8df6-e26289528263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:49.794792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2bb37-68df-4d4c-8df6-e26289528263 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:49.817987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 987/1974] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:49.819802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ff395-dee3-44cb-ae09-d42941d0f5b0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.820093 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ff395-dee3-44cb-ae09-d42941d0f5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.820386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ff395-dee3-44cb-ae09-d42941d0f5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.865306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:49.866137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:49.866570 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:49.866851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] PATH_INFO: `/v3/users/6197194c6e554731a2eb75380d5146bd` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:49.868307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6197194c6e554731a2eb75380d5146bd)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:49.870333 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:49.880869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-460ff395-dee3-44cb-ae09-d42941d0f5b0 None None] MFA Rules not processed for user `094a12c9102349449c7d813b71073868`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:49.884939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-460ff395-dee3-44cb-ae09-d42941d0f5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:49.890969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:49.946985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:49.952626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6197194c6e554731a2eb75380d5146bd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:49.969418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6197194c6e554731a2eb75380d5146bd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:49.990821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6197194c6e554731a2eb75380d5146bd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:49.991650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6197194c6e554731a2eb75380d5146bd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:49.992504 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6197194c6e554731a2eb75380d5146bd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:50.027330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 988/1975] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:50.028402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ff395-dee3-44cb-ae09-d42941d0f5b0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:50.029787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-460ff395-dee3-44cb-ae09-d42941d0f5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:50.039926 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 988/1976] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:49 2022] DELETE /identity/v3/users/6197194c6e554731a2eb75380d5146bd => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:50.041358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:50.044059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:50.054305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ff395-dee3-44cb-ae09-d42941d0f5b0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:50.151644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc63553-c088-4f8a-8a85-5c5fc55f7b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:50.153342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc63553-c088-4f8a-8a85-5c5fc55f7b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:50.153618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc63553-c088-4f8a-8a85-5c5fc55f7b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:50.154171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc63553-c088-4f8a-8a85-5c5fc55f7b2d admin admin] PATH_INFO: `/v3/projects/4f2ed57d7f8c4eca96c01ae97e460f0b/users/5d66888df0a84d3d949f56c0d473f088/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:50.156575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc63553-c088-4f8a-8a85-5c5fc55f7b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2ed57d7f8c4eca96c01ae97e460f0b, user_id=5d66888df0a84d3d949f56c0d473f088, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:50.156704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91806e72-e8bc-4f0e-8364-4023ed61bfa9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:50.159435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc63553-c088-4f8a-8a85-5c5fc55f7b2d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:50.161775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b030c-39d2-4b3a-8ec8-171ee37f589c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:50.162650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b030c-39d2-4b3a-8ec8-171ee37f589c service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:50.163092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b030c-39d2-4b3a-8ec8-171ee37f589c service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:50.164113 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b030c-39d2-4b3a-8ec8-171ee37f589c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:50.181211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 989/1977] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:50 2022] PUT /identity/v3/projects/4f2ed57d7f8c4eca96c01ae97e460f0b/users/5d66888df0a84d3d949f56c0d473f088/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:50.184311 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640c2a3-4a94-4360-beae-b71d2aa8c746 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:50.188147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640c2a3-4a94-4360-beae-b71d2aa8c746 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:50.188849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640c2a3-4a94-4360-beae-b71d2aa8c746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:50.240903 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6640c2a3-4a94-4360-beae-b71d2aa8c746 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:50.244996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6640c2a3-4a94-4360-beae-b71d2aa8c746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:50.322313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b030c-39d2-4b3a-8ec8-171ee37f589c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:50.323828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b030c-39d2-4b3a-8ec8-171ee37f589c service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:50.348250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 989/1978] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:50.348836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 990/1979] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:50.354795 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559eae4-a8ae-432e-ac2a-00e4921dcd39 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:50.354795 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559eae4-a8ae-432e-ac2a-00e4921dcd39 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:50.355208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559eae4-a8ae-432e-ac2a-00e4921dcd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:50.361104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640c2a3-4a94-4360-beae-b71d2aa8c746 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:50.363157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6640c2a3-4a94-4360-beae-b71d2aa8c746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:50.410073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8559eae4-a8ae-432e-ac2a-00e4921dcd39 None None] MFA Rules not processed for user `5d66888df0a84d3d949f56c0d473f088`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:50.412017 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8559eae4-a8ae-432e-ac2a-00e4921dcd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:50.483653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640c2a3-4a94-4360-beae-b71d2aa8c746 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:50.487680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf85bb-5aeb-42fb-97f6-ae5e3e6e07f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:50.488549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf85bb-5aeb-42fb-97f6-ae5e3e6e07f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:50.488937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf85bb-5aeb-42fb-97f6-ae5e3e6e07f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:50.489315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf85bb-5aeb-42fb-97f6-ae5e3e6e07f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:50.491442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:50.504050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf85bb-5aeb-42fb-97f6-ae5e3e6e07f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:50.505247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf85bb-5aeb-42fb-97f6-ae5e3e6e07f3 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:50.516774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 991/1980] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:50.517521 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf85bb-5aeb-42fb-97f6-ae5e3e6e07f3 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:50.518802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6fbf85bb-5aeb-42fb-97f6-ae5e3e6e07f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:50.537592 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf85bb-5aeb-42fb-97f6-ae5e3e6e07f3 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:50.543857 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798fc71-4187-4673-8362-b2cc18dbbfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:50.544986 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798fc71-4187-4673-8362-b2cc18dbbfad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:50.545270 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798fc71-4187-4673-8362-b2cc18dbbfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:50.545961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798fc71-4187-4673-8362-b2cc18dbbfad admin admin] PATH_INFO: `/v3/users/094a12c9102349449c7d813b71073868` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:50.547462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798fc71-4187-4673-8362-b2cc18dbbfad admin admin] RBAC: Authorizing `identity:delete_user(user_id=094a12c9102349449c7d813b71073868)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:50.549461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798fc71-4187-4673-8362-b2cc18dbbfad admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:50.556765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:50.559845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 990/1981] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:50.576351 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559eae4-a8ae-432e-ac2a-00e4921dcd39 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:50.622585 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7798fc71-4187-4673-8362-b2cc18dbbfad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094a12c9102349449c7d813b71073868'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:50.636385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7798fc71-4187-4673-8362-b2cc18dbbfad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094a12c9102349449c7d813b71073868'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:50.650023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7798fc71-4187-4673-8362-b2cc18dbbfad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094a12c9102349449c7d813b71073868'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:50.650591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559eae4-a8ae-432e-ac2a-00e4921dcd39 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:50.654976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b1e9c-da5f-4a48-a73f-946def13f3bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:50.655749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b1e9c-da5f-4a48-a73f-946def13f3bc service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:50.656108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b1e9c-da5f-4a48-a73f-946def13f3bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:50.656395 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b1e9c-da5f-4a48-a73f-946def13f3bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:50.665658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7798fc71-4187-4673-8362-b2cc18dbbfad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094a12c9102349449c7d813b71073868'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:50.666411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7798fc71-4187-4673-8362-b2cc18dbbfad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094a12c9102349449c7d813b71073868'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:50.668361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b1e9c-da5f-4a48-a73f-946def13f3bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:50.670165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b1e9c-da5f-4a48-a73f-946def13f3bc service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:50.673225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 992/1982] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:50 2022] DELETE /identity/v3/users/094a12c9102349449c7d813b71073868 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:50.678225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9ca4-2d91-4f65-a62d-4bd39e1836a8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:50.678225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9ca4-2d91-4f65-a62d-4bd39e1836a8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:50.678645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9ca4-2d91-4f65-a62d-4bd39e1836a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:50.684805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 991/1983] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:50.699992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-322d9ca4-2d91-4f65-a62d-4bd39e1836a8 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:50.702233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-322d9ca4-2d91-4f65-a62d-4bd39e1836a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:50.839130 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 993/1984] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:50.869292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b1e9c-da5f-4a48-a73f-946def13f3bc service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:50.872693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7c2b1e9c-da5f-4a48-a73f-946def13f3bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:50.896448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b1e9c-da5f-4a48-a73f-946def13f3bc service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:50.991548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eabdb2-b240-4ae0-bb7e-8d88794543cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:50.993327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eabdb2-b240-4ae0-bb7e-8d88794543cb service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:50.994007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eabdb2-b240-4ae0-bb7e-8d88794543cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:50.994363 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eabdb2-b240-4ae0-bb7e-8d88794543cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:51.009635 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eabdb2-b240-4ae0-bb7e-8d88794543cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:51.011172 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eabdb2-b240-4ae0-bb7e-8d88794543cb service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:51.023520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 992/1985] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:51.040196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d9ca4-2d91-4f65-a62d-4bd39e1836a8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:51.043327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-322d9ca4-2d91-4f65-a62d-4bd39e1836a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:51.064205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d9ca4-2d91-4f65-a62d-4bd39e1836a8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:51.076629 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:51.080634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:51.080634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:51.080634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] PATH_INFO: `/v3/projects/a04fb6e772a44d65a5d3d84a4dccd7d4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:51.080634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04fb6e772a44d65a5d3d84a4dccd7d4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:51.082411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:51.155343 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04fb6e772a44d65a5d3d84a4dccd7d4', 'request_id': 'req-efe0c809-79a8-47ea-8155-42c8984c40f9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.162218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04fb6e772a44d65a5d3d84a4dccd7d4', 'request_id': 'req-efe0c809-79a8-47ea-8155-42c8984c40f9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.171514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04fb6e772a44d65a5d3d84a4dccd7d4', 'request_id': 'req-efe0c809-79a8-47ea-8155-42c8984c40f9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.202799 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] The token cache is being invalidate because project a04fb6e772a44d65a5d3d84a4dccd7d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:51.203111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.203807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.205925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 994/1986] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:51 2022] DELETE /identity/v3/projects/a04fb6e772a44d65a5d3d84a4dccd7d4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:51.210004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eabdb2-b240-4ae0-bb7e-8d88794543cb service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:51.220745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eabdb2-b240-4ae0-bb7e-8d88794543cb service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:51.336313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77b0d3-af34-4273-bd19-75c965468000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:51.337603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77b0d3-af34-4273-bd19-75c965468000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:51.338126 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77b0d3-af34-4273-bd19-75c965468000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:51.338890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77b0d3-af34-4273-bd19-75c965468000 admin admin] PATH_INFO: `/v3/users/ddc547bac3c84ff5bba63ed13c353077` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:51.340366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77b0d3-af34-4273-bd19-75c965468000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc547bac3c84ff5bba63ed13c353077)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:51.343116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77b0d3-af34-4273-bd19-75c965468000 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:51.396282 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:51.467886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a77b0d3-af34-4273-bd19-75c965468000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc547bac3c84ff5bba63ed13c353077'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.491208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a77b0d3-af34-4273-bd19-75c965468000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc547bac3c84ff5bba63ed13c353077'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.512904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a77b0d3-af34-4273-bd19-75c965468000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc547bac3c84ff5bba63ed13c353077'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.514204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a77b0d3-af34-4273-bd19-75c965468000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc547bac3c84ff5bba63ed13c353077'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.515828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a77b0d3-af34-4273-bd19-75c965468000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc547bac3c84ff5bba63ed13c353077'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.552930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 993/1987] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:51 2022] DELETE /identity/v3/users/ddc547bac3c84ff5bba63ed13c353077 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:51.599013 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:51.600958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:51.625440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c809-79a8-47ea-8155-42c8984c40f9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:51.634265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:51.768786 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:51.770168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:51.770624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:51.771037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f admin admin] PATH_INFO: `/v3/projects/7c5dd28316824771bb77770a7504cd19` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:51.773634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c5dd28316824771bb77770a7504cd19)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:51.775861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:51.856155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5dd28316824771bb77770a7504cd19', 'request_id': 'req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.864790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5dd28316824771bb77770a7504cd19', 'request_id': 'req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.873113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5dd28316824771bb77770a7504cd19', 'request_id': 'req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.904226 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f admin admin] The token cache is being invalidate because project 7c5dd28316824771bb77770a7504cd19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:51.907400 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.907400 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f1a5f96b-6b8b-4f75-b5a8-0781b715019f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:51.910608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 995/1988] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:51 2022] DELETE /identity/v3/projects/7c5dd28316824771bb77770a7504cd19 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:51.916160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677344a-3387-49dd-b653-e914c5231704 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:51.916573 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677344a-3387-49dd-b653-e914c5231704 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:51.916964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677344a-3387-49dd-b653-e914c5231704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:51.968818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9677344a-3387-49dd-b653-e914c5231704 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:51.970239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9677344a-3387-49dd-b653-e914c5231704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:52.130388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 994/1989] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:52.144229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf9043-6b4f-4318-b4df-4c1f05cf41fa None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:52.144816 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf9043-6b4f-4318-b4df-4c1f05cf41fa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:52.144938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf9043-6b4f-4318-b4df-4c1f05cf41fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:52.169486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-42cf9043-6b4f-4318-b4df-4c1f05cf41fa None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:52.171745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-42cf9043-6b4f-4318-b4df-4c1f05cf41fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:52.187760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677344a-3387-49dd-b653-e914c5231704 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:52.190661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 996/1990] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:52.191513 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf9043-6b4f-4318-b4df-4c1f05cf41fa None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:52.191753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9677344a-3387-49dd-b653-e914c5231704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:52.206954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf9043-6b4f-4318-b4df-4c1f05cf41fa None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:52.222909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2b1cb-26be-4454-ad1a-c63f6c1b9b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:52.224250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2b1cb-26be-4454-ad1a-c63f6c1b9b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:52.224595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677344a-3387-49dd-b653-e914c5231704 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:52.225105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2b1cb-26be-4454-ad1a-c63f6c1b9b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:52.225951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2b1cb-26be-4454-ad1a-c63f6c1b9b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:52.227013 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2b1cb-26be-4454-ad1a-c63f6c1b9b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:52.228748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2b1cb-26be-4454-ad1a-c63f6c1b9b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:52.231176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2b1cb-26be-4454-ad1a-c63f6c1b9b00 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:52.241608 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e67a23-f557-4090-b427-adbea93aabf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:52.242509 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e67a23-f557-4090-b427-adbea93aabf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:52.242789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e67a23-f557-4090-b427-adbea93aabf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:52.243066 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e67a23-f557-4090-b427-adbea93aabf6 admin admin] PATH_INFO: `/v3/projects/988be0d696744ce89048c77d7dc74b8c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:52.245458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e67a23-f557-4090-b427-adbea93aabf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988be0d696744ce89048c77d7dc74b8c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:52.249499 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e67a23-f557-4090-b427-adbea93aabf6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:52.274307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 997/1991] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:52.283235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2b1cb-26be-4454-ad1a-c63f6c1b9b00 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:52.366970 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6e67a23-f557-4090-b427-adbea93aabf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988be0d696744ce89048c77d7dc74b8c', 'request_id': 'req-e6e67a23-f557-4090-b427-adbea93aabf6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:52.385385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6e67a23-f557-4090-b427-adbea93aabf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988be0d696744ce89048c77d7dc74b8c', 'request_id': 'req-e6e67a23-f557-4090-b427-adbea93aabf6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:52.389080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2b1cb-26be-4454-ad1a-c63f6c1b9b00 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:52.395408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6e67a23-f557-4090-b427-adbea93aabf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988be0d696744ce89048c77d7dc74b8c', 'request_id': 'req-e6e67a23-f557-4090-b427-adbea93aabf6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:52.410769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6e67a23-f557-4090-b427-adbea93aabf6 admin admin] The token cache is being invalidate because project 988be0d696744ce89048c77d7dc74b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:52.411156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6e67a23-f557-4090-b427-adbea93aabf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:52.412812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6e67a23-f557-4090-b427-adbea93aabf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:52.421396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 995/1992] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:52 2022] DELETE /identity/v3/projects/988be0d696744ce89048c77d7dc74b8c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:52.423247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe5d9-cc42-45ee-9a70-8e110ea3ef2a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:52.423626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe5d9-cc42-45ee-9a70-8e110ea3ef2a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:52.424246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe5d9-cc42-45ee-9a70-8e110ea3ef2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:52.448905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-37fbe5d9-cc42-45ee-9a70-8e110ea3ef2a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:52.450494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-37fbe5d9-cc42-45ee-9a70-8e110ea3ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:52.488416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:52.542677 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b4922-6a5d-4a5d-963b-c1f017f92d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:52.543547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b4922-6a5d-4a5d-963b-c1f017f92d65 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:52.543976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b4922-6a5d-4a5d-963b-c1f017f92d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:52.544997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b4922-6a5d-4a5d-963b-c1f017f92d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:52.546510 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b4922-6a5d-4a5d-963b-c1f017f92d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:52.549932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b4922-6a5d-4a5d-963b-c1f017f92d65 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:52.592552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 996/1993] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:52.597968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625145de-92d5-4b0e-bb1f-bea97d3a4734 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:52.600185 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625145de-92d5-4b0e-bb1f-bea97d3a4734 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:52.600508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625145de-92d5-4b0e-bb1f-bea97d3a4734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:52.636206 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 998/1994] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:52 2022] POST /identity/v3/projects => generated 369 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:52.639202 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b4922-6a5d-4a5d-963b-c1f017f92d65 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:52.641752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-625145de-92d5-4b0e-bb1f-bea97d3a4734 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:52.642673 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-497b4922-6a5d-4a5d-963b-c1f017f92d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:52.643728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-625145de-92d5-4b0e-bb1f-bea97d3a4734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:52.655655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:52.745717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 997/1995] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:52.764187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625145de-92d5-4b0e-bb1f-bea97d3a4734 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:52.787600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625145de-92d5-4b0e-bb1f-bea97d3a4734 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:52.808292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0f8a3-95d8-4b42-950f-b154d8ca4bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:52.809020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0f8a3-95d8-4b42-950f-b154d8ca4bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:52.809303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0f8a3-95d8-4b42-950f-b154d8ca4bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:52.809578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0f8a3-95d8-4b42-950f-b154d8ca4bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:52.810352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0f8a3-95d8-4b42-950f-b154d8ca4bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:52.810659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0f8a3-95d8-4b42-950f-b154d8ca4bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:52.812296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0f8a3-95d8-4b42-950f-b154d8ca4bcc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:52.812792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b4922-6a5d-4a5d-963b-c1f017f92d65 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:52.823005 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f81a8-5918-48c7-a117-9e10fcc1c07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:52.825635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f81a8-5918-48c7-a117-9e10fcc1c07a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:52.826109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f81a8-5918-48c7-a117-9e10fcc1c07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:52.826615 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f81a8-5918-48c7-a117-9e10fcc1c07a admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:52.827709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f81a8-5918-48c7-a117-9e10fcc1c07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:52.845282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f81a8-5918-48c7-a117-9e10fcc1c07a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:52.854868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 998/1996] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:52.860072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0f8a3-95d8-4b42-950f-b154d8ca4bcc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:52.890824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0f8a3-95d8-4b42-950f-b154d8ca4bcc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:52.903521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e34d4-2775-4218-a06a-a5de34988bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:52.903521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e34d4-2775-4218-a06a-a5de34988bfa admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:52.903521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e34d4-2775-4218-a06a-a5de34988bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:52.903521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e34d4-2775-4218-a06a-a5de34988bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:52.903996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e34d4-2775-4218-a06a-a5de34988bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:52.904091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 999/1997] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:52 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:52.905628 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e34d4-2775-4218-a06a-a5de34988bfa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:52.907566 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f81a8-5918-48c7-a117-9e10fcc1c07a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:52.926633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f81a8-5918-48c7-a117-9e10fcc1c07a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:52.935268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde69de-ab6c-43e5-98c1-c9db2c62497f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:52.936432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde69de-ab6c-43e5-98c1-c9db2c62497f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:52.936842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde69de-ab6c-43e5-98c1-c9db2c62497f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:52.937028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde69de-ab6c-43e5-98c1-c9db2c62497f admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:52.937779 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde69de-ab6c-43e5-98c1-c9db2c62497f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:52.939439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde69de-ab6c-43e5-98c1-c9db2c62497f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:52.956802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1000/1998] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:52.957000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 999/1999] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:52 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:52.959519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde69de-ab6c-43e5-98c1-c9db2c62497f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:52.960151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e34d4-2775-4218-a06a-a5de34988bfa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:52.981032 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde69de-ab6c-43e5-98c1-c9db2c62497f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:53.107151 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7c56b-e003-419a-a59e-d5d201756fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:53.108407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7c56b-e003-419a-a59e-d5d201756fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:53.108732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7c56b-e003-419a-a59e-d5d201756fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:53.109068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7c56b-e003-419a-a59e-d5d201756fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:53.109915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7c56b-e003-419a-a59e-d5d201756fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:53.112240 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7c56b-e003-419a-a59e-d5d201756fa0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:53.136205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e34d4-2775-4218-a06a-a5de34988bfa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:53.144804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39bc08-8625-44ed-bf67-e78c773e8135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:53.146137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39bc08-8625-44ed-bf67-e78c773e8135 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:53.146575 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39bc08-8625-44ed-bf67-e78c773e8135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:53.147190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39bc08-8625-44ed-bf67-e78c773e8135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:53.148827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39bc08-8625-44ed-bf67-e78c773e8135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:53.152842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1001/2000] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:52 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:53.155394 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39bc08-8625-44ed-bf67-e78c773e8135 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:53.158796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7c56b-e003-419a-a59e-d5d201756fa0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:53.171514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1000/2001] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:53.172235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7c56b-e003-419a-a59e-d5d201756fa0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:53.176285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39bc08-8625-44ed-bf67-e78c773e8135 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:53.191859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15463d-1a74-44db-8f1a-fcff42880d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:53.192639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15463d-1a74-44db-8f1a-fcff42880d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:53.193096 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15463d-1a74-44db-8f1a-fcff42880d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:53.193319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39bc08-8625-44ed-bf67-e78c773e8135 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:53.193522 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15463d-1a74-44db-8f1a-fcff42880d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:53.194314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15463d-1a74-44db-8f1a-fcff42880d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:53.196428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15463d-1a74-44db-8f1a-fcff42880d4d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:53.200959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a78c1-d885-4927-ad63-04ef10c5ca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:53.203474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a78c1-d885-4927-ad63-04ef10c5ca3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:53.205004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a78c1-d885-4927-ad63-04ef10c5ca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:53.207558 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a78c1-d885-4927-ad63-04ef10c5ca3d admin admin] PATH_INFO: `/v3/projects/7fb75384290b411da5f3480e072af157/users/87ca34afdf7247f2a11a7ee8ca87b5b4/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:53.231052 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a78c1-d885-4927-ad63-04ef10c5ca3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb75384290b411da5f3480e072af157, user_id=87ca34afdf7247f2a11a7ee8ca87b5b4, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:53.231440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1002/2002] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:53.235500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15463d-1a74-44db-8f1a-fcff42880d4d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:53.244265 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a78c1-d885-4927-ad63-04ef10c5ca3d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:53.260976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:53.263077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15463d-1a74-44db-8f1a-fcff42880d4d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:53.266707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1001/2003] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:53 2022] PUT /identity/v3/projects/7fb75384290b411da5f3480e072af157/users/87ca34afdf7247f2a11a7ee8ca87b5b4/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:53.278530 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a78c1-d885-4927-ad63-04ef10c5ca3d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:53.294184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b00a78c1-d885-4927-ad63-04ef10c5ca3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:53.394802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e3071-3e5a-403d-9f15-01666d3b44a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:53.395512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e3071-3e5a-403d-9f15-01666d3b44a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:53.395795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e3071-3e5a-403d-9f15-01666d3b44a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:53.396078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e3071-3e5a-403d-9f15-01666d3b44a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:53.399966 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e3071-3e5a-403d-9f15-01666d3b44a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:53.404978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e3071-3e5a-403d-9f15-01666d3b44a0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:53.406595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:53.442194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1003/2004] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:27:53.443673 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a78c1-d885-4927-ad63-04ef10c5ca3d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:53.443816 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3024716-31f7-480c-a77e-774ef6616434 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:53.444075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3024716-31f7-480c-a77e-774ef6616434 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:53.444357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3024716-31f7-480c-a77e-774ef6616434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:53.449381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:53.450474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:53.450952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:53.451522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] PATH_INFO: `/v3/users/54ea7b7eb5b24dbe8c79e1947336b1a8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:53.453037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ea7b7eb5b24dbe8c79e1947336b1a8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:53.455224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:53.478560 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c3024716-31f7-480c-a77e-774ef6616434 None None] MFA Rules not processed for user `87ca34afdf7247f2a11a7ee8ca87b5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:53.479432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c3024716-31f7-480c-a77e-774ef6616434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:53.523586 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ea7b7eb5b24dbe8c79e1947336b1a8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:53.535235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ea7b7eb5b24dbe8c79e1947336b1a8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:53.549424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ea7b7eb5b24dbe8c79e1947336b1a8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:53.550196 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ea7b7eb5b24dbe8c79e1947336b1a8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:53.550865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ea7b7eb5b24dbe8c79e1947336b1a8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:53.566626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1002/2005] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:53 2022] DELETE /identity/v3/users/54ea7b7eb5b24dbe8c79e1947336b1a8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:53.568166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:53.571607 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:53.572520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1004/2006] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:53.574251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba44cc-9cdf-4f8c-81f5-85822fdfe096 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:53.574564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba44cc-9cdf-4f8c-81f5-85822fdfe096 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:53.574829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba44cc-9cdf-4f8c-81f5-85822fdfe096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:53.599423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-beba44cc-9cdf-4f8c-81f5-85822fdfe096 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:53.600698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-beba44cc-9cdf-4f8c-81f5-85822fdfe096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:53.658791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54bb55-8cd5-45cd-bf61-04563d9e145d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:53.665621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ad9c4-27d9-45f3-a736-0ff8dfca6b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:53.666540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ad9c4-27d9-45f3-a736-0ff8dfca6b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:53.666824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ad9c4-27d9-45f3-a736-0ff8dfca6b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:53.667100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ad9c4-27d9-45f3-a736-0ff8dfca6b03 admin admin] PATH_INFO: `/v3/projects/2bc59cb7c3ed4275a205d7039ec95c61/users/9c9608ad9af74226b07d97bc3b15f2a9/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:53.677527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1005/2007] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:53.677527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba44cc-9cdf-4f8c-81f5-85822fdfe096 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:53.677527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-beba44cc-9cdf-4f8c-81f5-85822fdfe096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:53.686931 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ad9c4-27d9-45f3-a736-0ff8dfca6b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc59cb7c3ed4275a205d7039ec95c61, user_id=9c9608ad9af74226b07d97bc3b15f2a9, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:53.690077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ad9c4-27d9-45f3-a736-0ff8dfca6b03 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:53.707104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1003/2008] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:53 2022] PUT /identity/v3/projects/2bc59cb7c3ed4275a205d7039ec95c61/users/9c9608ad9af74226b07d97bc3b15f2a9/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:53.708772 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ad9c4-27d9-45f3-a736-0ff8dfca6b03 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:53.717425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0c3ad9c4-27d9-45f3-a736-0ff8dfca6b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:53.725481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:53.769508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba44cc-9cdf-4f8c-81f5-85822fdfe096 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:53.788313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ad9c4-27d9-45f3-a736-0ff8dfca6b03 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:53.792325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601e62c-753f-46a4-b9e1-349b9dcce93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:53.793230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601e62c-753f-46a4-b9e1-349b9dcce93e service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:53.793521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601e62c-753f-46a4-b9e1-349b9dcce93e service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:53.793877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601e62c-753f-46a4-b9e1-349b9dcce93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:53.821678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:53.833288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34e678-a617-4da8-a829-c7ebb1a2028c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:53.834001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34e678-a617-4da8-a829-c7ebb1a2028c service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:53.834288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34e678-a617-4da8-a829-c7ebb1a2028c service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:53.834567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34e678-a617-4da8-a829-c7ebb1a2028c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:53.873708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601e62c-753f-46a4-b9e1-349b9dcce93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:53.875448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601e62c-753f-46a4-b9e1-349b9dcce93e service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:53.886741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1004/2009] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:53.888309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045dea-ea45-47f6-82d0-3815c9ab55cf None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:53.888626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045dea-ea45-47f6-82d0-3815c9ab55cf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:53.888937 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045dea-ea45-47f6-82d0-3815c9ab55cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:53.936629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e5045dea-ea45-47f6-82d0-3815c9ab55cf None None] MFA Rules not processed for user `9c9608ad9af74226b07d97bc3b15f2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:53.940050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e5045dea-ea45-47f6-82d0-3815c9ab55cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:53.943882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34e678-a617-4da8-a829-c7ebb1a2028c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:53.946066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34e678-a617-4da8-a829-c7ebb1a2028c service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:53.960093 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1006/2010] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:53.981896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34e678-a617-4da8-a829-c7ebb1a2028c service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:53.983961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-af34e678-a617-4da8-a829-c7ebb1a2028c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:54.004165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34e678-a617-4da8-a829-c7ebb1a2028c service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:54.012033 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62a806-f97b-4659-bbb2-cd917d708e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:54.014054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62a806-f97b-4659-bbb2-cd917d708e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:54.014181 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62a806-f97b-4659-bbb2-cd917d708e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:54.014493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62a806-f97b-4659-bbb2-cd917d708e81 admin admin] PATH_INFO: `/v3/users/87ca34afdf7247f2a11a7ee8ca87b5b4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:54.016472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62a806-f97b-4659-bbb2-cd917d708e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ca34afdf7247f2a11a7ee8ca87b5b4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:54.030095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62a806-f97b-4659-bbb2-cd917d708e81 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:54.093357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1005/2011] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:54.107176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5045dea-ea45-47f6-82d0-3815c9ab55cf None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:54.108714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e5045dea-ea45-47f6-82d0-3815c9ab55cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:54.124435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2b62a806-f97b-4659-bbb2-cd917d708e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ca34afdf7247f2a11a7ee8ca87b5b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:54.142137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2b62a806-f97b-4659-bbb2-cd917d708e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ca34afdf7247f2a11a7ee8ca87b5b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:54.152426 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2b62a806-f97b-4659-bbb2-cd917d708e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ca34afdf7247f2a11a7ee8ca87b5b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:54.167348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2b62a806-f97b-4659-bbb2-cd917d708e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ca34afdf7247f2a11a7ee8ca87b5b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:54.168105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2b62a806-f97b-4659-bbb2-cd917d708e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ca34afdf7247f2a11a7ee8ca87b5b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:54.176379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1007/2012] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:53 2022] DELETE /identity/v3/users/87ca34afdf7247f2a11a7ee8ca87b5b4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:54.180957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b94cc8-54aa-42d5-aa09-fa2ba3200c66 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:54.181459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b94cc8-54aa-42d5-aa09-fa2ba3200c66 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:54.181839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b94cc8-54aa-42d5-aa09-fa2ba3200c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:54.198919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:54.205602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f1b94cc8-54aa-42d5-aa09-fa2ba3200c66 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:54.207228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f1b94cc8-54aa-42d5-aa09-fa2ba3200c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:54.255472 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5045dea-ea45-47f6-82d0-3815c9ab55cf None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:54.331769 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1008/2013] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:54.346280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dfc0b-0d08-42a4-b896-176143c35810 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f9a6f6d6d840d6bc29fd0ab26ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:54.346876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dfc0b-0d08-42a4-b896-176143c35810 service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:54.347255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dfc0b-0d08-42a4-b896-176143c35810 service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:54.347408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b94cc8-54aa-42d5-aa09-fa2ba3200c66 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:54.347948 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dfc0b-0d08-42a4-b896-176143c35810 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:54.348924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f1b94cc8-54aa-42d5-aa09-fa2ba3200c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:54.351809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e32dfc0b-0d08-42a4-b896-176143c35810 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:54.370688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:54.448209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b94cc8-54aa-42d5-aa09-fa2ba3200c66 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:54.455706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a49b8-89d6-480d-8087-819914a2a871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:54.456752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dfc0b-0d08-42a4-b896-176143c35810 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:54.457493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a49b8-89d6-480d-8087-819914a2a871 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:54.457790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a49b8-89d6-480d-8087-819914a2a871 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:54.458089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a49b8-89d6-480d-8087-819914a2a871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:54.458226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dfc0b-0d08-42a4-b896-176143c35810 service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:54.472616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1006/2014] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:27:54.484262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a49b8-89d6-480d-8087-819914a2a871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:54.485783 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a49b8-89d6-480d-8087-819914a2a871 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:54.516956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1009/2015] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:27:54.739556 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dfc0b-0d08-42a4-b896-176143c35810 service glance] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:54.741128 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e32dfc0b-0d08-42a4-b896-176143c35810 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:54.766680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dfc0b-0d08-42a4-b896-176143c35810 service glance] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:54.777276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:54.780893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:54.782159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:54.782627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] PATH_INFO: `/v3/projects/85e3af7dfb5041dd9728f14c697dacd9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:54.789794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e3af7dfb5041dd9728f14c697dacd9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:54.793634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:54.919108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e3af7dfb5041dd9728f14c697dacd9', 'request_id': 'req-7f526308-88ce-4a23-a495-f17a8d269570'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:54.939152 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e3af7dfb5041dd9728f14c697dacd9', 'request_id': 'req-7f526308-88ce-4a23-a495-f17a8d269570'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:54.949979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e3af7dfb5041dd9728f14c697dacd9', 'request_id': 'req-7f526308-88ce-4a23-a495-f17a8d269570'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:54.981483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] The token cache is being invalidate because project 85e3af7dfb5041dd9728f14c697dacd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:54.983859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:54.985594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:54.989846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1007/2016] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:54 2022] DELETE /identity/v3/projects/85e3af7dfb5041dd9728f14c697dacd9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:54.995078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a49b8-89d6-480d-8087-819914a2a871 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:55.010480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a49b8-89d6-480d-8087-819914a2a871 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:55.162381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b37cf9-acdc-4f35-8650-36a0de093301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:55.163454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b37cf9-acdc-4f35-8650-36a0de093301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:55.163962 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b37cf9-acdc-4f35-8650-36a0de093301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:55.164307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b37cf9-acdc-4f35-8650-36a0de093301 admin admin] PATH_INFO: `/v3/users/5d66888df0a84d3d949f56c0d473f088` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:55.165987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b37cf9-acdc-4f35-8650-36a0de093301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d66888df0a84d3d949f56c0d473f088)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:55.168264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b37cf9-acdc-4f35-8650-36a0de093301 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:55.251415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b4b37cf9-acdc-4f35-8650-36a0de093301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d66888df0a84d3d949f56c0d473f088'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:55.264353 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b4b37cf9-acdc-4f35-8650-36a0de093301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d66888df0a84d3d949f56c0d473f088'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:55.277932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b4b37cf9-acdc-4f35-8650-36a0de093301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d66888df0a84d3d949f56c0d473f088'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:55.291873 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:55.293463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:55.311067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f526308-88ce-4a23-a495-f17a8d269570 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:55.321650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b4b37cf9-acdc-4f35-8650-36a0de093301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d66888df0a84d3d949f56c0d473f088'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:55.323850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b4b37cf9-acdc-4f35-8650-36a0de093301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d66888df0a84d3d949f56c0d473f088'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:55.326935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22867997-2aa0-441b-83be-025cad0efef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:55.327930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22867997-2aa0-441b-83be-025cad0efef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:55.328310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22867997-2aa0-441b-83be-025cad0efef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:55.328744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22867997-2aa0-441b-83be-025cad0efef8 admin admin] PATH_INFO: `/v3/projects/7fb75384290b411da5f3480e072af157` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:55.330323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22867997-2aa0-441b-83be-025cad0efef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb75384290b411da5f3480e072af157)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:55.332487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22867997-2aa0-441b-83be-025cad0efef8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:55.348728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1010/2017] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:54 2022] DELETE /identity/v3/users/5d66888df0a84d3d949f56c0d473f088 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:55.348992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:55.441665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-22867997-2aa0-441b-83be-025cad0efef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb75384290b411da5f3480e072af157', 'request_id': 'req-22867997-2aa0-441b-83be-025cad0efef8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:55.453012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-22867997-2aa0-441b-83be-025cad0efef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb75384290b411da5f3480e072af157', 'request_id': 'req-22867997-2aa0-441b-83be-025cad0efef8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:55.463407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-22867997-2aa0-441b-83be-025cad0efef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb75384290b411da5f3480e072af157', 'request_id': 'req-22867997-2aa0-441b-83be-025cad0efef8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:55.479663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-22867997-2aa0-441b-83be-025cad0efef8 admin admin] The token cache is being invalidate because project 7fb75384290b411da5f3480e072af157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:55.479961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-22867997-2aa0-441b-83be-025cad0efef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:55.480986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-22867997-2aa0-441b-83be-025cad0efef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:55.483078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1008/2018] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:55 2022] DELETE /identity/v3/projects/7fb75384290b411da5f3480e072af157 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:55.487756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d86c9-5fc9-4a0d-8612-ec6f688f4572 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:55.488154 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d86c9-5fc9-4a0d-8612-ec6f688f4572 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:55.488439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d86c9-5fc9-4a0d-8612-ec6f688f4572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:55.564999 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3e5d86c9-5fc9-4a0d-8612-ec6f688f4572 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:55.566320 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3e5d86c9-5fc9-4a0d-8612-ec6f688f4572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:55.615699 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:55.668103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1011/2019] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:55.676531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b6000-2f40-4004-9096-c706224a26aa None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:55.677009 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b6000-2f40-4004-9096-c706224a26aa None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:55.677380 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b6000-2f40-4004-9096-c706224a26aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:55.697370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4d6b6000-2f40-4004-9096-c706224a26aa None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:55.698628 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4d6b6000-2f40-4004-9096-c706224a26aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:55.708643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1009/2020] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:55.713448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d86c9-5fc9-4a0d-8612-ec6f688f4572 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:55.726415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d86c9-5fc9-4a0d-8612-ec6f688f4572 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:55.732108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf2fc9-573e-4b82-a02f-721f249373f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:55.732765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf2fc9-573e-4b82-a02f-721f249373f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:55.733421 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf2fc9-573e-4b82-a02f-721f249373f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:55.733421 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf2fc9-573e-4b82-a02f-721f249373f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:55.734052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf2fc9-573e-4b82-a02f-721f249373f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:55.734527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf2fc9-573e-4b82-a02f-721f249373f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:55.736270 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf2fc9-573e-4b82-a02f-721f249373f0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:55.751506 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1012/2021] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:55.755892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b6000-2f40-4004-9096-c706224a26aa None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:55.766615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b6000-2f40-4004-9096-c706224a26aa None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:55.773602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c7f8-6784-4833-ad7b-d772c0e0a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:55.774431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c7f8-6784-4833-ad7b-d772c0e0a34e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:55.774790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c7f8-6784-4833-ad7b-d772c0e0a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:55.775328 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c7f8-6784-4833-ad7b-d772c0e0a34e admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:55.776154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c7f8-6784-4833-ad7b-d772c0e0a34e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:55.778602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c7f8-6784-4833-ad7b-d772c0e0a34e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:55.797422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf2fc9-573e-4b82-a02f-721f249373f0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:55.799477 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1ddf2fc9-573e-4b82-a02f-721f249373f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:55.825429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1010/2022] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:55 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:55.826841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c7f8-6784-4833-ad7b-d772c0e0a34e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:55.849248 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf2fc9-573e-4b82-a02f-721f249373f0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:55.941494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c7f8-6784-4833-ad7b-d772c0e0a34e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:55.949733 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607fadc-621e-45f6-91cb-469c6de64235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:55.950637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607fadc-621e-45f6-91cb-469c6de64235 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:55.951130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607fadc-621e-45f6-91cb-469c6de64235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:55.951582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607fadc-621e-45f6-91cb-469c6de64235 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:55.952453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607fadc-621e-45f6-91cb-469c6de64235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:55.955449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607fadc-621e-45f6-91cb-469c6de64235 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:55.959288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6716b-97eb-4300-9749-877c0c069369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:55.960192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6716b-97eb-4300-9749-877c0c069369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:55.960469 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6716b-97eb-4300-9749-877c0c069369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:55.960787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6716b-97eb-4300-9749-877c0c069369 admin admin] PATH_INFO: `/v3/projects/4f2ed57d7f8c4eca96c01ae97e460f0b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:55.962208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6716b-97eb-4300-9749-877c0c069369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2ed57d7f8c4eca96c01ae97e460f0b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:55.964586 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6716b-97eb-4300-9749-877c0c069369 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:56.004200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1011/2023] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:55 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:56.009022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607fadc-621e-45f6-91cb-469c6de64235 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:56.032923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c3c6716b-97eb-4300-9749-877c0c069369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2ed57d7f8c4eca96c01ae97e460f0b', 'request_id': 'req-c3c6716b-97eb-4300-9749-877c0c069369'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:56.039517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607fadc-621e-45f6-91cb-469c6de64235 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:56.040702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c3c6716b-97eb-4300-9749-877c0c069369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2ed57d7f8c4eca96c01ae97e460f0b', 'request_id': 'req-c3c6716b-97eb-4300-9749-877c0c069369'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:56.058684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c3c6716b-97eb-4300-9749-877c0c069369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2ed57d7f8c4eca96c01ae97e460f0b', 'request_id': 'req-c3c6716b-97eb-4300-9749-877c0c069369'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:56.074918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c3c6716b-97eb-4300-9749-877c0c069369 admin admin] The token cache is being invalidate because project 4f2ed57d7f8c4eca96c01ae97e460f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:56.075572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c3c6716b-97eb-4300-9749-877c0c069369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:56.076230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c3c6716b-97eb-4300-9749-877c0c069369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:56.078254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1013/2024] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:55 2022] DELETE /identity/v3/projects/4f2ed57d7f8c4eca96c01ae97e460f0b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:56.089240 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2e8eb-1433-4f85-86b6-fbae30e733e7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.090433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2e8eb-1433-4f85-86b6-fbae30e733e7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.090721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2e8eb-1433-4f85-86b6-fbae30e733e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.114543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-18b2e8eb-1433-4f85-86b6-fbae30e733e7 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:56.115778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-18b2e8eb-1433-4f85-86b6-fbae30e733e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:56.169786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef53ec0-5154-4603-be57-dae6a02df8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:56.170795 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef53ec0-5154-4603-be57-dae6a02df8df admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.171321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef53ec0-5154-4603-be57-dae6a02df8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.171872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef53ec0-5154-4603-be57-dae6a02df8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.172823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef53ec0-5154-4603-be57-dae6a02df8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:56.174648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef53ec0-5154-4603-be57-dae6a02df8df admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:56.178155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:56.185226 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:56.214142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1012/2025] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:27:56.218200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef53ec0-5154-4603-be57-dae6a02df8df admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:56.219908 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9ef53ec0-5154-4603-be57-dae6a02df8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:56.223610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1014/2026] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:56.231868 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a025e-99c1-499c-b33b-3b608646581c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.232337 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a025e-99c1-499c-b33b-3b608646581c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.232648 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a025e-99c1-499c-b33b-3b608646581c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.248770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef53ec0-5154-4603-be57-dae6a02df8df admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:56.258387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a2128-d4fa-4e8c-95ee-cfedb14d4263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:56.259864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2128-d4fa-4e8c-95ee-cfedb14d4263 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.260316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2128-d4fa-4e8c-95ee-cfedb14d4263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.261083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2128-d4fa-4e8c-95ee-cfedb14d4263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.262377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a2128-d4fa-4e8c-95ee-cfedb14d4263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:56.264482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a2128-d4fa-4e8c-95ee-cfedb14d4263 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:56.273696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-017a025e-99c1-499c-b33b-3b608646581c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:56.277613 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-017a025e-99c1-499c-b33b-3b608646581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:56.289535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1013/2027] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:56.293263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a2128-d4fa-4e8c-95ee-cfedb14d4263 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:56.307515 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1015/2028] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:56.312350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a025e-99c1-499c-b33b-3b608646581c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:56.324314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a025e-99c1-499c-b33b-3b608646581c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:56.332803 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab07aa5-478f-4264-a9a1-b5c02ad78ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:56.334090 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab07aa5-478f-4264-a9a1-b5c02ad78ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.334416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab07aa5-478f-4264-a9a1-b5c02ad78ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.334786 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab07aa5-478f-4264-a9a1-b5c02ad78ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.336086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab07aa5-478f-4264-a9a1-b5c02ad78ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:56.336086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab07aa5-478f-4264-a9a1-b5c02ad78ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:56.338354 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab07aa5-478f-4264-a9a1-b5c02ad78ffd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:56.354671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a2128-d4fa-4e8c-95ee-cfedb14d4263 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:56.366297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ae6e4-a299-44ab-ab7e-299d760a5c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:56.367221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ae6e4-a299-44ab-ab7e-299d760a5c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.367498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ae6e4-a299-44ab-ab7e-299d760a5c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.372036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1016/2029] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:56.372194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ae6e4-a299-44ab-ab7e-299d760a5c1e admin admin] PATH_INFO: `/v3/projects/39aa989a96664115a4f9500fd8a214fb/users/fe91d55860434e63bd0d1d25f8de3715/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.373251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab07aa5-478f-4264-a9a1-b5c02ad78ffd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:56.393819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab07aa5-478f-4264-a9a1-b5c02ad78ffd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:56.409932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ae6e4-a299-44ab-ab7e-299d760a5c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39aa989a96664115a4f9500fd8a214fb, user_id=fe91d55860434e63bd0d1d25f8de3715, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:56.409932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ae6e4-a299-44ab-ab7e-299d760a5c1e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:56.410216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759cd50-0859-4161-afe3-6b1c1db863f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:56.410324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759cd50-0859-4161-afe3-6b1c1db863f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.410602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759cd50-0859-4161-afe3-6b1c1db863f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.410879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759cd50-0859-4161-afe3-6b1c1db863f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.411630 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759cd50-0859-4161-afe3-6b1c1db863f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:56.413759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759cd50-0859-4161-afe3-6b1c1db863f4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:56.436532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1014/2030] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:56 2022] PUT /identity/v3/projects/39aa989a96664115a4f9500fd8a214fb/users/fe91d55860434e63bd0d1d25f8de3715/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:56.447806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a978-0cfd-449a-bbb6-87db630b8bcb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.448218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a978-0cfd-449a-bbb6-87db630b8bcb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.449588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a978-0cfd-449a-bbb6-87db630b8bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.473641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1017/2031] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:56 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:56.480052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759cd50-0859-4161-afe3-6b1c1db863f4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:56.495766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fa33a978-0cfd-449a-bbb6-87db630b8bcb None None] MFA Rules not processed for user `fe91d55860434e63bd0d1d25f8de3715`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:56.497070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fa33a978-0cfd-449a-bbb6-87db630b8bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:56.619323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1015/2032] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:56.619584 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759cd50-0859-4161-afe3-6b1c1db863f4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:56.631302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a978-0cfd-449a-bbb6-87db630b8bcb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:56.633172 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fa33a978-0cfd-449a-bbb6-87db630b8bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:56.635186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b43c8-51e9-44de-9ab1-a15f822d4891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:56.636137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b43c8-51e9-44de-9ab1-a15f822d4891 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.636462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b43c8-51e9-44de-9ab1-a15f822d4891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.636795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b43c8-51e9-44de-9ab1-a15f822d4891 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.637625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b43c8-51e9-44de-9ab1-a15f822d4891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:56.640118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b43c8-51e9-44de-9ab1-a15f822d4891 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:56.699193 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1018/2033] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:56 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:56.703048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b43c8-51e9-44de-9ab1-a15f822d4891 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:56.736785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b43c8-51e9-44de-9ab1-a15f822d4891 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:56.760046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baae0bf-058c-46e9-9b21-6c26272392ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:56.761350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baae0bf-058c-46e9-9b21-6c26272392ab admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.761911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baae0bf-058c-46e9-9b21-6c26272392ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.762300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baae0bf-058c-46e9-9b21-6c26272392ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.764385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baae0bf-058c-46e9-9b21-6c26272392ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:56.767071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baae0bf-058c-46e9-9b21-6c26272392ab admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:56.775285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a978-0cfd-449a-bbb6-87db630b8bcb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:56.783787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cefa8-3afd-4dfe-9e10-6c2ac715d2b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:56.784521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cefa8-3afd-4dfe-9e10-6c2ac715d2b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.784876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cefa8-3afd-4dfe-9e10-6c2ac715d2b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.785210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cefa8-3afd-4dfe-9e10-6c2ac715d2b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.785677 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1019/2034] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:56.789786 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baae0bf-058c-46e9-9b21-6c26272392ab admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:56.798012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cefa8-3afd-4dfe-9e10-6c2ac715d2b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:56.804570 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cefa8-3afd-4dfe-9e10-6c2ac715d2b1 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:56.804781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baae0bf-058c-46e9-9b21-6c26272392ab admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:56.817313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1016/2035] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:56.823423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c6bf4-3fca-4d35-a1dc-60f298b57913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:56.824163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c6bf4-3fca-4d35-a1dc-60f298b57913 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.824450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c6bf4-3fca-4d35-a1dc-60f298b57913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.824838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c6bf4-3fca-4d35-a1dc-60f298b57913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.825643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c6bf4-3fca-4d35-a1dc-60f298b57913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:56.827337 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c6bf4-3fca-4d35-a1dc-60f298b57913 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:56.844764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1020/2036] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:56.846918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cefa8-3afd-4dfe-9e10-6c2ac715d2b1 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:56.854365 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c6bf4-3fca-4d35-a1dc-60f298b57913 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:56.866174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c6bf4-3fca-4d35-a1dc-60f298b57913 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:56.870901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cefa8-3afd-4dfe-9e10-6c2ac715d2b1 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:56.871070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f7b6a-a76e-4a4e-a42c-3e9b0ffaf0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:56.871955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f7b6a-a76e-4a4e-a42c-3e9b0ffaf0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.872241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f7b6a-a76e-4a4e-a42c-3e9b0ffaf0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.872543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f7b6a-a76e-4a4e-a42c-3e9b0ffaf0d1 admin admin] PATH_INFO: `/v3/users/fe91d55860434e63bd0d1d25f8de3715` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.874015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f7b6a-a76e-4a4e-a42c-3e9b0ffaf0d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe91d55860434e63bd0d1d25f8de3715)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:56.876384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f7b6a-a76e-4a4e-a42c-3e9b0ffaf0d1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:56.878698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b794b6-7c52-4104-8745-38f340fc0fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:56.880279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b794b6-7c52-4104-8745-38f340fc0fef admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.880740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b794b6-7c52-4104-8745-38f340fc0fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.881014 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b794b6-7c52-4104-8745-38f340fc0fef admin admin] PATH_INFO: `/v3/projects/5e49141748a64d7abb907a5ab083df6f/users/69824b7dd25f44d6a3d97ea9df816d6e/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.898725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b794b6-7c52-4104-8745-38f340fc0fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e49141748a64d7abb907a5ab083df6f, user_id=69824b7dd25f44d6a3d97ea9df816d6e, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:56.901407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b794b6-7c52-4104-8745-38f340fc0fef admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:56.921190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1017/2037] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:56 2022] PUT /identity/v3/projects/5e49141748a64d7abb907a5ab083df6f/users/69824b7dd25f44d6a3d97ea9df816d6e/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:56.934321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514ba23-ea8c-4a6c-b46a-909ff20eee5b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.934621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514ba23-ea8c-4a6c-b46a-909ff20eee5b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.934912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514ba23-ea8c-4a6c-b46a-909ff20eee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:56.938643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9b5f7b6a-a76e-4a4e-a42c-3e9b0ffaf0d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe91d55860434e63bd0d1d25f8de3715'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:56.950453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9b5f7b6a-a76e-4a4e-a42c-3e9b0ffaf0d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe91d55860434e63bd0d1d25f8de3715'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:56.960012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9b5f7b6a-a76e-4a4e-a42c-3e9b0ffaf0d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe91d55860434e63bd0d1d25f8de3715'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:56.965928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:56.974534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4514ba23-ea8c-4a6c-b46a-909ff20eee5b None None] MFA Rules not processed for user `69824b7dd25f44d6a3d97ea9df816d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:56.975981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9b5f7b6a-a76e-4a4e-a42c-3e9b0ffaf0d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe91d55860434e63bd0d1d25f8de3715'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:56.977959 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9b5f7b6a-a76e-4a4e-a42c-3e9b0ffaf0d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe91d55860434e63bd0d1d25f8de3715'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:56.979781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4514ba23-ea8c-4a6c-b46a-909ff20eee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:56.994576 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1021/2038] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:27:56 2022] DELETE /identity/v3/users/fe91d55860434e63bd0d1d25f8de3715 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:56.999092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf055e5-0355-4d3b-bad7-7fde292389a8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:56.999525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf055e5-0355-4d3b-bad7-7fde292389a8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:56.999918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf055e5-0355-4d3b-bad7-7fde292389a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:57.021204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:57.028246 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-daf055e5-0355-4d3b-bad7-7fde292389a8 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:57.029826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-daf055e5-0355-4d3b-bad7-7fde292389a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:57.106075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1018/2039] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:57.110507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1022/2040] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:57.111344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514ba23-ea8c-4a6c-b46a-909ff20eee5b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:57.112880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4514ba23-ea8c-4a6c-b46a-909ff20eee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:57.122498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf055e5-0355-4d3b-bad7-7fde292389a8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:57.124232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-daf055e5-0355-4d3b-bad7-7fde292389a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:57.186412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514ba23-ea8c-4a6c-b46a-909ff20eee5b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:57.192631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004ef78-524f-405b-a1f7-845f7287c47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:57.193440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004ef78-524f-405b-a1f7-845f7287c47e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:57.193782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004ef78-524f-405b-a1f7-845f7287c47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:57.194138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004ef78-524f-405b-a1f7-845f7287c47e admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:57.194890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004ef78-524f-405b-a1f7-845f7287c47e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:57.196921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004ef78-524f-405b-a1f7-845f7287c47e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:57.212290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf055e5-0355-4d3b-bad7-7fde292389a8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:57.216840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b96e3-7274-4184-a3b0-e26c45081e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:57.217607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b96e3-7274-4184-a3b0-e26c45081e33 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:57.217772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b96e3-7274-4184-a3b0-e26c45081e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:57.218013 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b96e3-7274-4184-a3b0-e26c45081e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:57.228445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b96e3-7274-4184-a3b0-e26c45081e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:57.229995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b96e3-7274-4184-a3b0-e26c45081e33 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:57.230403 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1019/2041] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:57 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:27:57.234029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004ef78-524f-405b-a1f7-845f7287c47e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:57.241113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1023/2042] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:27:57.308522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004ef78-524f-405b-a1f7-845f7287c47e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:57.322397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e949a4-f2e2-40bb-94e6-fef874758d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:57.323161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e949a4-f2e2-40bb-94e6-fef874758d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:57.323504 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e949a4-f2e2-40bb-94e6-fef874758d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:57.323829 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e949a4-f2e2-40bb-94e6-fef874758d5a admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:57.324924 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e949a4-f2e2-40bb-94e6-fef874758d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:57.326976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e949a4-f2e2-40bb-94e6-fef874758d5a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:57.350958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1020/2043] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:57 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:27:57.360388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b96e3-7274-4184-a3b0-e26c45081e33 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:57.371157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b96e3-7274-4184-a3b0-e26c45081e33 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:57.377370 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72ded-0e64-4340-8d9d-c0c6df2fc150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:57.380115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72ded-0e64-4340-8d9d-c0c6df2fc150 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:57.380654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72ded-0e64-4340-8d9d-c0c6df2fc150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:57.380960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72ded-0e64-4340-8d9d-c0c6df2fc150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:57.382109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be72ded-0e64-4340-8d9d-c0c6df2fc150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:57.383963 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be72ded-0e64-4340-8d9d-c0c6df2fc150 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:57.396545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1024/2044] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:57.400761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e949a4-f2e2-40bb-94e6-fef874758d5a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:57.411449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e949a4-f2e2-40bb-94e6-fef874758d5a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:57.416302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f866e-cc18-4f13-8a3c-b2d59eee7c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:57.417260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f866e-cc18-4f13-8a3c-b2d59eee7c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:57.417670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f866e-cc18-4f13-8a3c-b2d59eee7c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:57.417975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f866e-cc18-4f13-8a3c-b2d59eee7c38 admin admin] PATH_INFO: `/v3/projects/b6c29d02fa5c411197e29bd00e83eb6f/users/8ce06f888ad64b7d9e9a4b9797ad9e0b/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:57.444718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f866e-cc18-4f13-8a3c-b2d59eee7c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c29d02fa5c411197e29bd00e83eb6f, user_id=8ce06f888ad64b7d9e9a4b9797ad9e0b, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:57.447798 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f866e-cc18-4f13-8a3c-b2d59eee7c38 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:57.466365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1021/2045] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:57 2022] PUT /identity/v3/projects/b6c29d02fa5c411197e29bd00e83eb6f/users/8ce06f888ad64b7d9e9a4b9797ad9e0b/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:57.470137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72ded-0e64-4340-8d9d-c0c6df2fc150 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:57.482317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72ded-0e64-4340-8d9d-c0c6df2fc150 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:57.554398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07787731-8ffc-4e7d-a642-cc7e46dba8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:57.555092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07787731-8ffc-4e7d-a642-cc7e46dba8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:57.555376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07787731-8ffc-4e7d-a642-cc7e46dba8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:57.555744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07787731-8ffc-4e7d-a642-cc7e46dba8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:57.556481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07787731-8ffc-4e7d-a642-cc7e46dba8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:57.558184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07787731-8ffc-4e7d-a642-cc7e46dba8d6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:57.568639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1025/2046] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:57.572804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f866e-cc18-4f13-8a3c-b2d59eee7c38 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:57.584390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f866e-cc18-4f13-8a3c-b2d59eee7c38 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:57.589549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d03e6-56aa-41d3-9ed6-d1afffde379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:57.590518 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d03e6-56aa-41d3-9ed6-d1afffde379d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:57.590940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d03e6-56aa-41d3-9ed6-d1afffde379d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:57.591133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d03e6-56aa-41d3-9ed6-d1afffde379d admin admin] PATH_INFO: `/v3/projects/b6c29d02fa5c411197e29bd00e83eb6f/users/8ce06f888ad64b7d9e9a4b9797ad9e0b/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:57.593191 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d03e6-56aa-41d3-9ed6-d1afffde379d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c29d02fa5c411197e29bd00e83eb6f, user_id=8ce06f888ad64b7d9e9a4b9797ad9e0b, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:57.595863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d03e6-56aa-41d3-9ed6-d1afffde379d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:57.599594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:57.618295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1022/2047] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:57 2022] PUT /identity/v3/projects/b6c29d02fa5c411197e29bd00e83eb6f/users/8ce06f888ad64b7d9e9a4b9797ad9e0b/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:57.638418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61794054-aa91-4dca-810e-d795c1f0a050 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:57.639368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61794054-aa91-4dca-810e-d795c1f0a050 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:57.640686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61794054-aa91-4dca-810e-d795c1f0a050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:57.677015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d03e6-56aa-41d3-9ed6-d1afffde379d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:57.693480 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9a7d03e6-56aa-41d3-9ed6-d1afffde379d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:57.699379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-61794054-aa91-4dca-810e-d795c1f0a050 None None] MFA Rules not processed for user `8ce06f888ad64b7d9e9a4b9797ad9e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:57.700788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-61794054-aa91-4dca-810e-d795c1f0a050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:57.705667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:57.805791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1026/2048] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:57.812251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61794054-aa91-4dca-810e-d795c1f0a050 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:57.814899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-61794054-aa91-4dca-810e-d795c1f0a050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:57.815153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d03e6-56aa-41d3-9ed6-d1afffde379d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:57.820785 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:57.821788 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:57.822964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:57.824060 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b admin admin] PATH_INFO: `/v3/projects/39aa989a96664115a4f9500fd8a214fb` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:57.825974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=39aa989a96664115a4f9500fd8a214fb)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:57.828284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:57.886755 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39aa989a96664115a4f9500fd8a214fb', 'request_id': 'req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:57.893632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61794054-aa91-4dca-810e-d795c1f0a050 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:57.902777 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39aa989a96664115a4f9500fd8a214fb', 'request_id': 'req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:57.914210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39aa989a96664115a4f9500fd8a214fb', 'request_id': 'req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:57.939544 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b admin admin] The token cache is being invalidate because project 39aa989a96664115a4f9500fd8a214fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:27:57.939544 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:57.939544 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-99a5f3c5-3b17-423d-bc13-86c8b482ed3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:27:57.939544 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1023/2049] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:27:57 2022] DELETE /identity/v3/projects/39aa989a96664115a4f9500fd8a214fb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:27:57.943421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b922fe-65cc-4ac6-95d3-aa13459e19b6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:57.943698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b922fe-65cc-4ac6-95d3-aa13459e19b6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:57.944003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b922fe-65cc-4ac6-95d3-aa13459e19b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:57.976562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-12b922fe-65cc-4ac6-95d3-aa13459e19b6 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:57.977841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-12b922fe-65cc-4ac6-95d3-aa13459e19b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:57.998564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2196d47-d4b2-4b4d-849f-82df126e064a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:57.999396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2196d47-d4b2-4b4d-849f-82df126e064a service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:57.999774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2196d47-d4b2-4b4d-849f-82df126e064a service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:58.000146 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2196d47-d4b2-4b4d-849f-82df126e064a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:58.002130 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b2196d47-d4b2-4b4d-849f-82df126e064a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:58.064725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1024/2050] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:58.067768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172cfd5-d6d6-4471-8423-b038ae1bbb0c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:58.068300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172cfd5-d6d6-4471-8423-b038ae1bbb0c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:58.068791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172cfd5-d6d6-4471-8423-b038ae1bbb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:58.091003 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2196d47-d4b2-4b4d-849f-82df126e064a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:58.092576 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2196d47-d4b2-4b4d-849f-82df126e064a service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:58.094266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8172cfd5-d6d6-4471-8423-b038ae1bbb0c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:58.095488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8172cfd5-d6d6-4471-8423-b038ae1bbb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:58.103156 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1027/2051] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:58.105695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1025/2052] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:27:58.110703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2196d47-d4b2-4b4d-849f-82df126e064a service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:58.125238 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2196d47-d4b2-4b4d-849f-82df126e064a service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:58.130784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331656a-0078-41cf-876b-a53ad4b4d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:58.131592 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331656a-0078-41cf-876b-a53ad4b4d70b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:58.131975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331656a-0078-41cf-876b-a53ad4b4d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:58.132346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331656a-0078-41cf-876b-a53ad4b4d70b admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:58.133218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331656a-0078-41cf-876b-a53ad4b4d70b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:27:58.133637 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331656a-0078-41cf-876b-a53ad4b4d70b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:58.135359 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331656a-0078-41cf-876b-a53ad4b4d70b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:58.144221 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:58.155060 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1028/2053] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:27:58.159853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172cfd5-d6d6-4471-8423-b038ae1bbb0c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:58.174659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172cfd5-d6d6-4471-8423-b038ae1bbb0c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:58.181553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c321a8e-f066-4d4c-822c-ed95ec6bde1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:58.182770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c321a8e-f066-4d4c-822c-ed95ec6bde1b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:58.184028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c321a8e-f066-4d4c-822c-ed95ec6bde1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:58.184321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c321a8e-f066-4d4c-822c-ed95ec6bde1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:58.185239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c321a8e-f066-4d4c-822c-ed95ec6bde1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:58.189136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c321a8e-f066-4d4c-822c-ed95ec6bde1b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:58.218316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:27:58.245559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1026/2054] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:27:58 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:27:58.246664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331656a-0078-41cf-876b-a53ad4b4d70b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:58.259427 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331656a-0078-41cf-876b-a53ad4b4d70b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:58.350483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972d45-591b-43ab-887f-5def0a3712c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:58.351225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972d45-591b-43ab-887f-5def0a3712c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:58.351521 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972d45-591b-43ab-887f-5def0a3712c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:58.351784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972d45-591b-43ab-887f-5def0a3712c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:58.352524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de972d45-591b-43ab-887f-5def0a3712c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:58.354500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de972d45-591b-43ab-887f-5def0a3712c7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:58.379151 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1029/2055] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:27:58 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:27:58.383392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c321a8e-f066-4d4c-822c-ed95ec6bde1b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:58.393882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c321a8e-f066-4d4c-822c-ed95ec6bde1b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:58.399205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1568-8056-4edf-b7dc-53f2ada82598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:58.399949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1568-8056-4edf-b7dc-53f2ada82598 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:58.400230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1568-8056-4edf-b7dc-53f2ada82598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:58.400525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1568-8056-4edf-b7dc-53f2ada82598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:58.401264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e1568-8056-4edf-b7dc-53f2ada82598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:58.403034 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e1568-8056-4edf-b7dc-53f2ada82598 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:58.416136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1027/2056] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:27:58.420904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972d45-591b-43ab-887f-5def0a3712c7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:58.434841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972d45-591b-43ab-887f-5def0a3712c7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:58.440012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6ecc7-2241-422c-a1d5-a5500f8390d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:58.440759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6ecc7-2241-422c-a1d5-a5500f8390d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:58.441185 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6ecc7-2241-422c-a1d5-a5500f8390d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:58.441357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6ecc7-2241-422c-a1d5-a5500f8390d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:58.442031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6ecc7-2241-422c-a1d5-a5500f8390d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:58.443660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6ecc7-2241-422c-a1d5-a5500f8390d0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:58.459045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1030/2057] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:27:58.460289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1568-8056-4edf-b7dc-53f2ada82598 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:58.480610 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1568-8056-4edf-b7dc-53f2ada82598 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:58.486149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a60ff3-d104-4404-85c3-6f8a4ebe9d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:58.487959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a60ff3-d104-4404-85c3-6f8a4ebe9d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:58.488417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a60ff3-d104-4404-85c3-6f8a4ebe9d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:58.488936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a60ff3-d104-4404-85c3-6f8a4ebe9d4f admin admin] PATH_INFO: `/v3/projects/605630ab17a04907bc7f5c916a3f4603/users/66c7e12c0b5a42aa80742e69bfa7bbf8/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:58.506399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a60ff3-d104-4404-85c3-6f8a4ebe9d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=605630ab17a04907bc7f5c916a3f4603, user_id=66c7e12c0b5a42aa80742e69bfa7bbf8, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:58.509747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a60ff3-d104-4404-85c3-6f8a4ebe9d4f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:58.539980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1028/2058] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:27:58 2022] PUT /identity/v3/projects/605630ab17a04907bc7f5c916a3f4603/users/66c7e12c0b5a42aa80742e69bfa7bbf8/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:27:58.545800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7390cd-5edc-4133-abd6-58db4716482d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:58.546202 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7390cd-5edc-4133-abd6-58db4716482d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:58.546677 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7390cd-5edc-4133-abd6-58db4716482d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:58.568666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2a7390cd-5edc-4133-abd6-58db4716482d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:58.570391 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2a7390cd-5edc-4133-abd6-58db4716482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:58.636464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1031/2059] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:58.648907 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a60ff3-d104-4404-85c3-6f8a4ebe9d4f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:58.650770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-92a60ff3-d104-4404-85c3-6f8a4ebe9d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:58.711389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a60ff3-d104-4404-85c3-6f8a4ebe9d4f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:58.715180 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4491f-e5f9-4b1f-a2fa-17354277bb49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:58.715840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4491f-e5f9-4b1f-a2fa-17354277bb49 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:58.716110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4491f-e5f9-4b1f-a2fa-17354277bb49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:58.716414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4491f-e5f9-4b1f-a2fa-17354277bb49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:58.729818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4491f-e5f9-4b1f-a2fa-17354277bb49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:58.731295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4491f-e5f9-4b1f-a2fa-17354277bb49 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:58.741500 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1029/2060] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:27:59.551568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d46525-d609-46c3-837a-3fa2a969a754 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:59.552097 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d46525-d609-46c3-837a-3fa2a969a754 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:59.552097 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d46525-d609-46c3-837a-3fa2a969a754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:59.603946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-50d46525-d609-46c3-837a-3fa2a969a754 None None] MFA Rules not processed for user `66c7e12c0b5a42aa80742e69bfa7bbf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:27:59.603946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-50d46525-d609-46c3-837a-3fa2a969a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:59.696105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1032/2061] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:27:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:27:59.710123 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4491f-e5f9-4b1f-a2fa-17354277bb49 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:27:59.711624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f8e4491f-e5f9-4b1f-a2fa-17354277bb49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:27:59.813784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4491f-e5f9-4b1f-a2fa-17354277bb49 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:27:59.820124 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e0844-6b0e-4d0c-98e0-b873bfbf1344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:27:59.821216 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e0844-6b0e-4d0c-98e0-b873bfbf1344 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:27:59.821631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e0844-6b0e-4d0c-98e0-b873bfbf1344 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:27:59.822006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e0844-6b0e-4d0c-98e0-b873bfbf1344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:27:59.834550 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e0844-6b0e-4d0c-98e0-b873bfbf1344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:27:59.836898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e0844-6b0e-4d0c-98e0-b873bfbf1344 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:27:59.860449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1030/2062] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:27:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:01.029430 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d46525-d609-46c3-837a-3fa2a969a754 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:01.032901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-50d46525-d609-46c3-837a-3fa2a969a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:01.050972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d46525-d609-46c3-837a-3fa2a969a754 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:01.055190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a7e4d-7327-48ef-952d-869d4ba9b834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:01.056086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7e4d-7327-48ef-952d-869d4ba9b834 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:01.057094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7e4d-7327-48ef-952d-869d4ba9b834 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:01.057450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7e4d-7327-48ef-952d-869d4ba9b834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:01.059654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-371a7e4d-7327-48ef-952d-869d4ba9b834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:01.066201 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:01.154089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a7e4d-7327-48ef-952d-869d4ba9b834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:01.155756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a7e4d-7327-48ef-952d-869d4ba9b834 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:01.168023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1033/2063] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:01.292311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea837d5-b9be-4177-82d6-75e58584e6d5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:01.292916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea837d5-b9be-4177-82d6-75e58584e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:01.292916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea837d5-b9be-4177-82d6-75e58584e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:01.321314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9ea837d5-b9be-4177-82d6-75e58584e6d5 None None] MFA Rules not processed for user `66c7e12c0b5a42aa80742e69bfa7bbf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:01.325358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9ea837d5-b9be-4177-82d6-75e58584e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:01.334968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1031/2064] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:02.598205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a7e4d-7327-48ef-952d-869d4ba9b834 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:02.611092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a7e4d-7327-48ef-952d-869d4ba9b834 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:02.615388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63108b-e1e2-4b62-a286-e31b17f8e0fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:02.616269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63108b-e1e2-4b62-a286-e31b17f8e0fc service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:02.616942 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63108b-e1e2-4b62-a286-e31b17f8e0fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:02.617393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63108b-e1e2-4b62-a286-e31b17f8e0fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:02.619501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9a63108b-e1e2-4b62-a286-e31b17f8e0fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:02.787015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63108b-e1e2-4b62-a286-e31b17f8e0fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:02.788708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63108b-e1e2-4b62-a286-e31b17f8e0fc service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:02.828616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1034/2065] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:11.316015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=71,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:12.402624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea837d5-b9be-4177-82d6-75e58584e6d5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:12.404163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9ea837d5-b9be-4177-82d6-75e58584e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:12.422685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea837d5-b9be-4177-82d6-75e58584e6d5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:12.427277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914ee87-aac7-4300-b381-744fb1b79227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:12.428145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914ee87-aac7-4300-b381-744fb1b79227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:12.428443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914ee87-aac7-4300-b381-744fb1b79227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:12.428745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914ee87-aac7-4300-b381-744fb1b79227 admin admin] PATH_INFO: `/v3/users/81c6d25afc4b484e891769c7bd583819` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:12.430317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914ee87-aac7-4300-b381-744fb1b79227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c6d25afc4b484e891769c7bd583819)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:12.432428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914ee87-aac7-4300-b381-744fb1b79227 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:12.483077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2914ee87-aac7-4300-b381-744fb1b79227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c6d25afc4b484e891769c7bd583819'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:12.495409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2914ee87-aac7-4300-b381-744fb1b79227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c6d25afc4b484e891769c7bd583819'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:12.508274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2914ee87-aac7-4300-b381-744fb1b79227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c6d25afc4b484e891769c7bd583819'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:12.509060 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2914ee87-aac7-4300-b381-744fb1b79227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c6d25afc4b484e891769c7bd583819'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:12.509761 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2914ee87-aac7-4300-b381-744fb1b79227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c6d25afc4b484e891769c7bd583819'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:12.524577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1032/2066] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:12 2022] DELETE /identity/v3/users/81c6d25afc4b484e891769c7bd583819 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:12.740440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63108b-e1e2-4b62-a286-e31b17f8e0fc service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:12.752814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63108b-e1e2-4b62-a286-e31b17f8e0fc service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:12.846564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:12.847630 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:12.848089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:12.848535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480 admin admin] PATH_INFO: `/v3/projects/1e0768fb27024185a6653cc26b0447c2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:12.849754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0768fb27024185a6653cc26b0447c2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:12.851653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:12.903192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:12.915065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0768fb27024185a6653cc26b0447c2', 'request_id': 'req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:12.922104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0768fb27024185a6653cc26b0447c2', 'request_id': 'req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:12.929578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0768fb27024185a6653cc26b0447c2', 'request_id': 'req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:12.948677 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480 admin admin] The token cache is being invalidate because project 1e0768fb27024185a6653cc26b0447c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:12.948996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:12.950485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f45934a3-5c4d-4cff-abd9-7c3a6b2cf480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:12.952274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1035/2067] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:12 2022] DELETE /identity/v3/projects/1e0768fb27024185a6653cc26b0447c2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:12.958436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc8c95-e96e-444f-b492-8c0acfdb656c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:12.958730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc8c95-e96e-444f-b492-8c0acfdb656c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:12.959012 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc8c95-e96e-444f-b492-8c0acfdb656c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:12.986783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-aedc8c95-e96e-444f-b492-8c0acfdb656c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:12.988098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-aedc8c95-e96e-444f-b492-8c0acfdb656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:13.098644 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1033/2068] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:13.102832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6fb41-39e6-4ac8-a5bb-d7907178f763 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:13.102832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6fb41-39e6-4ac8-a5bb-d7907178f763 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:13.102832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6fb41-39e6-4ac8-a5bb-d7907178f763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:13.127046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-43a6fb41-39e6-4ac8-a5bb-d7907178f763 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:13.128347 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-43a6fb41-39e6-4ac8-a5bb-d7907178f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:13.142710 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1036/2069] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:13.144219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc8c95-e96e-444f-b492-8c0acfdb656c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:13.161708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc8c95-e96e-444f-b492-8c0acfdb656c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:13.170211 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a78f1b-fa78-47a1-a26b-1cc09e74e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:13.170947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a78f1b-fa78-47a1-a26b-1cc09e74e4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:13.171234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a78f1b-fa78-47a1-a26b-1cc09e74e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:13.171693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a78f1b-fa78-47a1-a26b-1cc09e74e4f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:13.172819 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a78f1b-fa78-47a1-a26b-1cc09e74e4f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:13.173142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a78f1b-fa78-47a1-a26b-1cc09e74e4f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:13.175817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a78f1b-fa78-47a1-a26b-1cc09e74e4f3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:13.196051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6fb41-39e6-4ac8-a5bb-d7907178f763 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:13.196293 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1034/2070] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:28:13.206863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6fb41-39e6-4ac8-a5bb-d7907178f763 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:13.212206 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8b97-9ab3-493e-8bf5-36acf9b34745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:13.213021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8b97-9ab3-493e-8bf5-36acf9b34745 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:13.213365 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8b97-9ab3-493e-8bf5-36acf9b34745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:13.213704 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8b97-9ab3-493e-8bf5-36acf9b34745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:13.214518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c8b97-9ab3-493e-8bf5-36acf9b34745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:13.216567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c8b97-9ab3-493e-8bf5-36acf9b34745 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:13.256524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1037/2071] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:13 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:13.260601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a78f1b-fa78-47a1-a26b-1cc09e74e4f3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:13.271524 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a78f1b-fa78-47a1-a26b-1cc09e74e4f3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:13.335220 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132afe7-70c7-442a-856b-955e5b432188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:13.335910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132afe7-70c7-442a-856b-955e5b432188 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:13.336205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132afe7-70c7-442a-856b-955e5b432188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:13.336476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132afe7-70c7-442a-856b-955e5b432188 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:13.337212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132afe7-70c7-442a-856b-955e5b432188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:13.339225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132afe7-70c7-442a-856b-955e5b432188 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:13.347175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:13.365771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1035/2072] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:13 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:13.369751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8b97-9ab3-493e-8bf5-36acf9b34745 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:13.381132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8b97-9ab3-493e-8bf5-36acf9b34745 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:13.386051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bcec1-3ff4-4264-967d-53278e992924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:13.386726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bcec1-3ff4-4264-967d-53278e992924 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:13.387010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bcec1-3ff4-4264-967d-53278e992924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:13.387287 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bcec1-3ff4-4264-967d-53278e992924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:13.388061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bcec1-3ff4-4264-967d-53278e992924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:13.390075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bcec1-3ff4-4264-967d-53278e992924 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:13.401255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1038/2073] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:13.405435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132afe7-70c7-442a-856b-955e5b432188 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:13.416160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132afe7-70c7-442a-856b-955e5b432188 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:13.421404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a20a2a-d087-49f4-8bb1-35ef27f318b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:13.422231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a20a2a-d087-49f4-8bb1-35ef27f318b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:13.422520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a20a2a-d087-49f4-8bb1-35ef27f318b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:13.422796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a20a2a-d087-49f4-8bb1-35ef27f318b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:13.423537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a20a2a-d087-49f4-8bb1-35ef27f318b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:13.425449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a20a2a-d087-49f4-8bb1-35ef27f318b3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:13.440154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1036/2074] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:13.441278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bcec1-3ff4-4264-967d-53278e992924 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:13.452487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bcec1-3ff4-4264-967d-53278e992924 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:13.457335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03ff7b-9b4b-43a8-b9e4-69638c44c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:13.458245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03ff7b-9b4b-43a8-b9e4-69638c44c90e admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:13.458531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03ff7b-9b4b-43a8-b9e4-69638c44c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:13.458803 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03ff7b-9b4b-43a8-b9e4-69638c44c90e admin admin] PATH_INFO: `/v3/projects/73efebe564d64488941ba509a043f5ab/users/9fe16af9182d4587b4bea27b03fce5e1/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:13.478252 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03ff7b-9b4b-43a8-b9e4-69638c44c90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73efebe564d64488941ba509a043f5ab, user_id=9fe16af9182d4587b4bea27b03fce5e1, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:13.481860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03ff7b-9b4b-43a8-b9e4-69638c44c90e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:13.499432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1039/2075] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:13 2022] PUT /identity/v3/projects/73efebe564d64488941ba509a043f5ab/users/9fe16af9182d4587b4bea27b03fce5e1/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:13.509638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce995b7-c5c3-4db6-8ea4-498b573cac6c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:13.509895 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce995b7-c5c3-4db6-8ea4-498b573cac6c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:13.510224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce995b7-c5c3-4db6-8ea4-498b573cac6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:13.545979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7ce995b7-c5c3-4db6-8ea4-498b573cac6c None None] MFA Rules not processed for user `9fe16af9182d4587b4bea27b03fce5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:13.547219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7ce995b7-c5c3-4db6-8ea4-498b573cac6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:13.616409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1037/2076] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:13.627977 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03ff7b-9b4b-43a8-b9e4-69638c44c90e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:13.629781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-be03ff7b-9b4b-43a8-b9e4-69638c44c90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:13.710413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03ff7b-9b4b-43a8-b9e4-69638c44c90e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:13.716822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38965fd9-aa41-4b73-bff1-79dc1d55ea4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:13.717487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38965fd9-aa41-4b73-bff1-79dc1d55ea4f service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:13.717772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38965fd9-aa41-4b73-bff1-79dc1d55ea4f service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:13.718031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38965fd9-aa41-4b73-bff1-79dc1d55ea4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:13.726959 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38965fd9-aa41-4b73-bff1-79dc1d55ea4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:13.728624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38965fd9-aa41-4b73-bff1-79dc1d55ea4f service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:13.738060 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1040/2077] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:14.587599 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce995b7-c5c3-4db6-8ea4-498b573cac6c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:14.589313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7ce995b7-c5c3-4db6-8ea4-498b573cac6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:14.663127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce995b7-c5c3-4db6-8ea4-498b573cac6c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:14.668528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:14.669429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:14.669709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:14.669982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] PATH_INFO: `/v3/users/69824b7dd25f44d6a3d97ea9df816d6e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:14.671230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69824b7dd25f44d6a3d97ea9df816d6e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:14.673302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:14.726157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69824b7dd25f44d6a3d97ea9df816d6e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:14.733593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69824b7dd25f44d6a3d97ea9df816d6e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:14.745874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:14.748374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69824b7dd25f44d6a3d97ea9df816d6e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:14.749530 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69824b7dd25f44d6a3d97ea9df816d6e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:14.751180 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69824b7dd25f44d6a3d97ea9df816d6e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:14.765947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1038/2078] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:14 2022] DELETE /identity/v3/users/69824b7dd25f44d6a3d97ea9df816d6e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:14.770641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e7769-10d2-4f93-bb67-287ff10425af None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:14.771164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e7769-10d2-4f93-bb67-287ff10425af None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:14.771164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e7769-10d2-4f93-bb67-287ff10425af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:14.789807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-526e7769-10d2-4f93-bb67-287ff10425af None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:14.791020 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-526e7769-10d2-4f93-bb67-287ff10425af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:14.840579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:14.872589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1041/2079] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:14.882576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:14.884201 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:14.963148 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4c7b-cf38-4792-baa1-5a6761f3ec47 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:14.967765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09f8be-8e15-490d-bc50-156b7dda7529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:14.968503 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09f8be-8e15-490d-bc50-156b7dda7529 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:14.968927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09f8be-8e15-490d-bc50-156b7dda7529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:14.969210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09f8be-8e15-490d-bc50-156b7dda7529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:14.979511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09f8be-8e15-490d-bc50-156b7dda7529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:14.981016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09f8be-8e15-490d-bc50-156b7dda7529 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:14.990899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1039/2080] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:15.313936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e7769-10d2-4f93-bb67-287ff10425af None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:15.315270 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-526e7769-10d2-4f93-bb67-287ff10425af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:15.332078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e7769-10d2-4f93-bb67-287ff10425af None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:15.337277 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:15.338325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:15.338609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:15.338931 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] PATH_INFO: `/v3/projects/5e49141748a64d7abb907a5ab083df6f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:15.340100 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e49141748a64d7abb907a5ab083df6f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:15.342071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:15.397349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e49141748a64d7abb907a5ab083df6f', 'request_id': 'req-b998ec56-228f-4368-85e6-b5eb3e77f2ec'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:15.407872 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e49141748a64d7abb907a5ab083df6f', 'request_id': 'req-b998ec56-228f-4368-85e6-b5eb3e77f2ec'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:15.419623 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e49141748a64d7abb907a5ab083df6f', 'request_id': 'req-b998ec56-228f-4368-85e6-b5eb3e77f2ec'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:15.440647 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] The token cache is being invalidate because project 5e49141748a64d7abb907a5ab083df6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:15.441001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:15.441852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:15.446961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1042/2081] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:15 2022] DELETE /identity/v3/projects/5e49141748a64d7abb907a5ab083df6f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:15.447739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09f8be-8e15-490d-bc50-156b7dda7529 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:15.461585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09f8be-8e15-490d-bc50-156b7dda7529 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:15.586362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738621ac-db51-4e00-a597-3af38feb3a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:15.587286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738621ac-db51-4e00-a597-3af38feb3a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:15.587574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738621ac-db51-4e00-a597-3af38feb3a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:15.587854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738621ac-db51-4e00-a597-3af38feb3a41 admin admin] PATH_INFO: `/v3/users/8ce06f888ad64b7d9e9a4b9797ad9e0b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:15.589491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738621ac-db51-4e00-a597-3af38feb3a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce06f888ad64b7d9e9a4b9797ad9e0b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:15.591692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738621ac-db51-4e00-a597-3af38feb3a41 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:15.656116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-738621ac-db51-4e00-a597-3af38feb3a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce06f888ad64b7d9e9a4b9797ad9e0b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:15.665564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-738621ac-db51-4e00-a597-3af38feb3a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce06f888ad64b7d9e9a4b9797ad9e0b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:15.679348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-738621ac-db51-4e00-a597-3af38feb3a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce06f888ad64b7d9e9a4b9797ad9e0b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:15.680272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-738621ac-db51-4e00-a597-3af38feb3a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce06f888ad64b7d9e9a4b9797ad9e0b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:15.681040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-738621ac-db51-4e00-a597-3af38feb3a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce06f888ad64b7d9e9a4b9797ad9e0b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:15.696100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1040/2082] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:15 2022] DELETE /identity/v3/users/8ce06f888ad64b7d9e9a4b9797ad9e0b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:16.039040 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:16.041331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:16.075245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998ec56-228f-4368-85e6-b5eb3e77f2ec admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:16.157019 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b34c0-fe5a-43c9-9a61-0fa94e10d472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:16.157918 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b34c0-fe5a-43c9-9a61-0fa94e10d472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.158195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b34c0-fe5a-43c9-9a61-0fa94e10d472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.158465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b34c0-fe5a-43c9-9a61-0fa94e10d472 admin admin] PATH_INFO: `/v3/projects/b6c29d02fa5c411197e29bd00e83eb6f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.159782 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b34c0-fe5a-43c9-9a61-0fa94e10d472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c29d02fa5c411197e29bd00e83eb6f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:16.161985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b34c0-fe5a-43c9-9a61-0fa94e10d472 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:16.231791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-883b34c0-fe5a-43c9-9a61-0fa94e10d472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c29d02fa5c411197e29bd00e83eb6f', 'request_id': 'req-883b34c0-fe5a-43c9-9a61-0fa94e10d472'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:16.242030 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-883b34c0-fe5a-43c9-9a61-0fa94e10d472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c29d02fa5c411197e29bd00e83eb6f', 'request_id': 'req-883b34c0-fe5a-43c9-9a61-0fa94e10d472'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:16.251094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-883b34c0-fe5a-43c9-9a61-0fa94e10d472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c29d02fa5c411197e29bd00e83eb6f', 'request_id': 'req-883b34c0-fe5a-43c9-9a61-0fa94e10d472'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:16.263368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:16.269819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-883b34c0-fe5a-43c9-9a61-0fa94e10d472 admin admin] The token cache is being invalidate because project b6c29d02fa5c411197e29bd00e83eb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:16.270226 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-883b34c0-fe5a-43c9-9a61-0fa94e10d472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:16.271742 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-883b34c0-fe5a-43c9-9a61-0fa94e10d472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:16.273852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1043/2083] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:16 2022] DELETE /identity/v3/projects/b6c29d02fa5c411197e29bd00e83eb6f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:16.278902 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359f3b5-3ff7-4002-934c-7458086a4289 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.279194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359f3b5-3ff7-4002-934c-7458086a4289 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.279457 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359f3b5-3ff7-4002-934c-7458086a4289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.298459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2359f3b5-3ff7-4002-934c-7458086a4289 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:16.299696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2359f3b5-3ff7-4002-934c-7458086a4289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:16.304715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:16.370696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1041/2084] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:16.381579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22445a0d-e519-426d-9202-27d5d76fa8e9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.381847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22445a0d-e519-426d-9202-27d5d76fa8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.382142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22445a0d-e519-426d-9202-27d5d76fa8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.404539 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-22445a0d-e519-426d-9202-27d5d76fa8e9 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:16.405794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-22445a0d-e519-426d-9202-27d5d76fa8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:16.415157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1044/2085] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:16.419730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359f3b5-3ff7-4002-934c-7458086a4289 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:16.430339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359f3b5-3ff7-4002-934c-7458086a4289 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:16.437066 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ef9b5-9818-4966-8628-2b10e443d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:16.438076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ef9b5-9818-4966-8628-2b10e443d62b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.438376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ef9b5-9818-4966-8628-2b10e443d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.438707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ef9b5-9818-4966-8628-2b10e443d62b admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.439765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ef9b5-9818-4966-8628-2b10e443d62b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:16.440253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ef9b5-9818-4966-8628-2b10e443d62b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:16.442778 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ef9b5-9818-4966-8628-2b10e443d62b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:16.462284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1042/2086] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:16.466973 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22445a0d-e519-426d-9202-27d5d76fa8e9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:16.477133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22445a0d-e519-426d-9202-27d5d76fa8e9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:16.482760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705750a5-c0de-484d-bba1-4ee5adaf3d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:16.483419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705750a5-c0de-484d-bba1-4ee5adaf3d85 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.483704 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705750a5-c0de-484d-bba1-4ee5adaf3d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.483964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705750a5-c0de-484d-bba1-4ee5adaf3d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.484678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705750a5-c0de-484d-bba1-4ee5adaf3d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:16.486594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705750a5-c0de-484d-bba1-4ee5adaf3d85 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:16.520575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1045/2087] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:16 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:16.524877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ef9b5-9818-4966-8628-2b10e443d62b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:16.536723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ef9b5-9818-4966-8628-2b10e443d62b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:16.607393 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c45a27-0161-43de-af25-7be09dcd7fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:16.608062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c45a27-0161-43de-af25-7be09dcd7fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.608467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c45a27-0161-43de-af25-7be09dcd7fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.608805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c45a27-0161-43de-af25-7be09dcd7fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.609479 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c45a27-0161-43de-af25-7be09dcd7fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:16.611508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c45a27-0161-43de-af25-7be09dcd7fb9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:16.650803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1043/2088] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:16 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:16.654099 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705750a5-c0de-484d-bba1-4ee5adaf3d85 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:16.666546 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705750a5-c0de-484d-bba1-4ee5adaf3d85 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:16.674204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780332f-73b1-468d-91fa-30050e7ebf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:16.675220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780332f-73b1-468d-91fa-30050e7ebf83 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.675900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780332f-73b1-468d-91fa-30050e7ebf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.676349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780332f-73b1-468d-91fa-30050e7ebf83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.677681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780332f-73b1-468d-91fa-30050e7ebf83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:16.680536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780332f-73b1-468d-91fa-30050e7ebf83 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:16.699667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1046/2089] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:16.705313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c45a27-0161-43de-af25-7be09dcd7fb9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:16.725989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c45a27-0161-43de-af25-7be09dcd7fb9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:16.736146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413204f4-06e7-4991-a995-d065daea5769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:16.736146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413204f4-06e7-4991-a995-d065daea5769 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.736146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413204f4-06e7-4991-a995-d065daea5769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.736146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413204f4-06e7-4991-a995-d065daea5769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.736601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413204f4-06e7-4991-a995-d065daea5769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:16.738403 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413204f4-06e7-4991-a995-d065daea5769 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:16.759211 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1044/2090] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:16.763309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780332f-73b1-468d-91fa-30050e7ebf83 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:16.786359 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780332f-73b1-468d-91fa-30050e7ebf83 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:16.795467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f712d0-3254-449b-af3a-5c8717669fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:16.796380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f712d0-3254-449b-af3a-5c8717669fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.796694 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f712d0-3254-449b-af3a-5c8717669fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.797140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f712d0-3254-449b-af3a-5c8717669fd6 admin admin] PATH_INFO: `/v3/projects/8b690be94c374751a188e9f112a81f13/users/f65d65ae8af34ee1a812edbb2e630b41/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.816846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f712d0-3254-449b-af3a-5c8717669fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b690be94c374751a188e9f112a81f13, user_id=f65d65ae8af34ee1a812edbb2e630b41, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:16.823372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f712d0-3254-449b-af3a-5c8717669fd6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:16.844578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1047/2091] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:16 2022] PUT /identity/v3/projects/8b690be94c374751a188e9f112a81f13/users/f65d65ae8af34ee1a812edbb2e630b41/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:16.846808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde39db-37c6-406d-8bc2-9adc9e75da79 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:16.847090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde39db-37c6-406d-8bc2-9adc9e75da79 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:16.847458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde39db-37c6-406d-8bc2-9adc9e75da79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:16.866303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bfde39db-37c6-406d-8bc2-9adc9e75da79 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:16.867584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bfde39db-37c6-406d-8bc2-9adc9e75da79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:16.931955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1045/2092] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:16.943157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f712d0-3254-449b-af3a-5c8717669fd6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:16.945434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b2f712d0-3254-449b-af3a-5c8717669fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:17.015479 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f712d0-3254-449b-af3a-5c8717669fd6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:17.019668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67764499-5ab0-41e2-affd-955360450b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:17.020325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764499-5ab0-41e2-affd-955360450b3e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:17.020636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764499-5ab0-41e2-affd-955360450b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:17.020909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764499-5ab0-41e2-affd-955360450b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:17.031283 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67764499-5ab0-41e2-affd-955360450b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:17.032658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67764499-5ab0-41e2-affd-955360450b3e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:17.044535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1048/2093] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:17.701157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d63e1-1dad-4b7b-9ca7-e6302a2ec69e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:17.701670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d63e1-1dad-4b7b-9ca7-e6302a2ec69e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:17.701764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d63e1-1dad-4b7b-9ca7-e6302a2ec69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:17.731011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-651d63e1-1dad-4b7b-9ca7-e6302a2ec69e None None] MFA Rules not processed for user `f65d65ae8af34ee1a812edbb2e630b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:17.732236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-651d63e1-1dad-4b7b-9ca7-e6302a2ec69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:17.737050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:17.813464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1046/2094] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:17.824992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67764499-5ab0-41e2-affd-955360450b3e service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:17.826651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-67764499-5ab0-41e2-affd-955360450b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:17.910953 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67764499-5ab0-41e2-affd-955360450b3e service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:17.916247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70e682-548e-44c2-92eb-2f15f1dc1c21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:17.917153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70e682-548e-44c2-92eb-2f15f1dc1c21 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:17.917432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70e682-548e-44c2-92eb-2f15f1dc1c21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:17.917704 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70e682-548e-44c2-92eb-2f15f1dc1c21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:17.928730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70e682-548e-44c2-92eb-2f15f1dc1c21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:17.931267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70e682-548e-44c2-92eb-2f15f1dc1c21 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:17.942508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1049/2095] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:19.168930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d63e1-1dad-4b7b-9ca7-e6302a2ec69e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:19.170417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-651d63e1-1dad-4b7b-9ca7-e6302a2ec69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:19.184168 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d63e1-1dad-4b7b-9ca7-e6302a2ec69e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:19.188778 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb138c-d925-4f81-a964-583d81db21fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:19.189668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb138c-d925-4f81-a964-583d81db21fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:19.189956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb138c-d925-4f81-a964-583d81db21fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:19.190256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb138c-d925-4f81-a964-583d81db21fb admin admin] PATH_INFO: `/v3/users/9fe16af9182d4587b4bea27b03fce5e1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:19.191605 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb138c-d925-4f81-a964-583d81db21fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe16af9182d4587b4bea27b03fce5e1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:19.193583 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb138c-d925-4f81-a964-583d81db21fb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:19.253420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-34fb138c-d925-4f81-a964-583d81db21fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe16af9182d4587b4bea27b03fce5e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:19.260672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-34fb138c-d925-4f81-a964-583d81db21fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe16af9182d4587b4bea27b03fce5e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:19.273079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-34fb138c-d925-4f81-a964-583d81db21fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe16af9182d4587b4bea27b03fce5e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:19.273783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-34fb138c-d925-4f81-a964-583d81db21fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe16af9182d4587b4bea27b03fce5e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:19.274377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-34fb138c-d925-4f81-a964-583d81db21fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe16af9182d4587b4bea27b03fce5e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:19.290353 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1047/2096] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:19 2022] DELETE /identity/v3/users/9fe16af9182d4587b4bea27b03fce5e1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:19.295074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa09f57-8c84-48ca-a68b-85a9a3df6643 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:19.295571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa09f57-8c84-48ca-a68b-85a9a3df6643 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:19.295688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa09f57-8c84-48ca-a68b-85a9a3df6643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:19.320893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6aa09f57-8c84-48ca-a68b-85a9a3df6643 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:19.322110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6aa09f57-8c84-48ca-a68b-85a9a3df6643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:19.344524 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed3c7f-75b0-4ac2-8b3a-6879ef49d203 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:19.344919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed3c7f-75b0-4ac2-8b3a-6879ef49d203 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:19.345273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed3c7f-75b0-4ac2-8b3a-6879ef49d203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:19.365258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d8ed3c7f-75b0-4ac2-8b3a-6879ef49d203 None None] MFA Rules not processed for user `f65d65ae8af34ee1a812edbb2e630b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:19.366690 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d8ed3c7f-75b0-4ac2-8b3a-6879ef49d203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:19.385505 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:19.416700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1050/2097] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:19.424475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa09f57-8c84-48ca-a68b-85a9a3df6643 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:19.426294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6aa09f57-8c84-48ca-a68b-85a9a3df6643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:19.435630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1048/2098] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:19.498520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa09f57-8c84-48ca-a68b-85a9a3df6643 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:19.502410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f4436-ba50-4b57-888b-85540adb2a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:19.503086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f4436-ba50-4b57-888b-85540adb2a0f service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:19.503441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f4436-ba50-4b57-888b-85540adb2a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:19.503763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f4436-ba50-4b57-888b-85540adb2a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:19.513884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f4436-ba50-4b57-888b-85540adb2a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:19.515773 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f4436-ba50-4b57-888b-85540adb2a0f service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:19.530047 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1051/2099] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:20.321852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed3c7f-75b0-4ac2-8b3a-6879ef49d203 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:20.323788 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d8ed3c7f-75b0-4ac2-8b3a-6879ef49d203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:20.347689 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed3c7f-75b0-4ac2-8b3a-6879ef49d203 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:20.362618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f8700-4751-4fee-935d-42a0df06862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:20.364300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f8700-4751-4fee-935d-42a0df06862e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:20.364878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f8700-4751-4fee-935d-42a0df06862e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:20.365409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f8700-4751-4fee-935d-42a0df06862e admin admin] PATH_INFO: `/v3/projects/73efebe564d64488941ba509a043f5ab` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:20.367547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f8700-4751-4fee-935d-42a0df06862e admin admin] RBAC: Authorizing `identity:delete_project(project_id=73efebe564d64488941ba509a043f5ab)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:20.369695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f8700-4751-4fee-935d-42a0df06862e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:20.398431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:20.477774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-813f8700-4751-4fee-935d-42a0df06862e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73efebe564d64488941ba509a043f5ab', 'request_id': 'req-813f8700-4751-4fee-935d-42a0df06862e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:20.506750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-813f8700-4751-4fee-935d-42a0df06862e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73efebe564d64488941ba509a043f5ab', 'request_id': 'req-813f8700-4751-4fee-935d-42a0df06862e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:20.515422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-813f8700-4751-4fee-935d-42a0df06862e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73efebe564d64488941ba509a043f5ab', 'request_id': 'req-813f8700-4751-4fee-935d-42a0df06862e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:20.532262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-813f8700-4751-4fee-935d-42a0df06862e admin admin] The token cache is being invalidate because project 73efebe564d64488941ba509a043f5ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:20.533272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-813f8700-4751-4fee-935d-42a0df06862e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:20.534206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-813f8700-4751-4fee-935d-42a0df06862e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:20.536288 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1049/2100] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:20 2022] DELETE /identity/v3/projects/73efebe564d64488941ba509a043f5ab => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:20.541661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db55aee-2b60-46b5-a881-8483c57b585f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:20.542355 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db55aee-2b60-46b5-a881-8483c57b585f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:20.542656 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db55aee-2b60-46b5-a881-8483c57b585f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:20.591174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1db55aee-2b60-46b5-a881-8483c57b585f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:20.593015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1db55aee-2b60-46b5-a881-8483c57b585f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:20.686256 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1052/2101] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:20.694433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932e67c-61d6-4725-9fab-cc5bfb1a29e1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:20.694749 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932e67c-61d6-4725-9fab-cc5bfb1a29e1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:20.695124 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932e67c-61d6-4725-9fab-cc5bfb1a29e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:20.721793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e932e67c-61d6-4725-9fab-cc5bfb1a29e1 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:20.723317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e932e67c-61d6-4725-9fab-cc5bfb1a29e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:20.733522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1050/2102] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:20.738440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db55aee-2b60-46b5-a881-8483c57b585f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:20.754697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db55aee-2b60-46b5-a881-8483c57b585f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:20.770621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a611b4-1d6b-45eb-93f4-26c08ea3c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:20.771513 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a611b4-1d6b-45eb-93f4-26c08ea3c199 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:20.771946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a611b4-1d6b-45eb-93f4-26c08ea3c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:20.772468 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a611b4-1d6b-45eb-93f4-26c08ea3c199 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:20.773450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a611b4-1d6b-45eb-93f4-26c08ea3c199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:20.773764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a611b4-1d6b-45eb-93f4-26c08ea3c199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:20.775425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a611b4-1d6b-45eb-93f4-26c08ea3c199 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:20.788579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1053/2103] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:28:20.793746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932e67c-61d6-4725-9fab-cc5bfb1a29e1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:20.807145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932e67c-61d6-4725-9fab-cc5bfb1a29e1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:20.812572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8227da-5033-4330-af9e-c3513b11aaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:20.813407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8227da-5033-4330-af9e-c3513b11aaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:20.813685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8227da-5033-4330-af9e-c3513b11aaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:20.813960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8227da-5033-4330-af9e-c3513b11aaf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:20.814792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8227da-5033-4330-af9e-c3513b11aaf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:20.816837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8227da-5033-4330-af9e-c3513b11aaf0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:20.849882 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1051/2104] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:20 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:28:20.854728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a611b4-1d6b-45eb-93f4-26c08ea3c199 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:20.869794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a611b4-1d6b-45eb-93f4-26c08ea3c199 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:20.948710 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138a795-e87f-4eac-9cae-54bc0bc42e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:20.949410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138a795-e87f-4eac-9cae-54bc0bc42e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:20.949693 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138a795-e87f-4eac-9cae-54bc0bc42e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:20.950015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138a795-e87f-4eac-9cae-54bc0bc42e27 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:20.950799 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138a795-e87f-4eac-9cae-54bc0bc42e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:20.953693 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138a795-e87f-4eac-9cae-54bc0bc42e27 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:20.980892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1054/2105] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:20 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:20.982846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8227da-5033-4330-af9e-c3513b11aaf0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:21.000237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8227da-5033-4330-af9e-c3513b11aaf0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:21.005166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a0a9f-62d2-4f80-9de8-417783c44d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:21.005841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a0a9f-62d2-4f80-9de8-417783c44d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:21.006118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a0a9f-62d2-4f80-9de8-417783c44d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:21.006389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a0a9f-62d2-4f80-9de8-417783c44d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:21.007298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a0a9f-62d2-4f80-9de8-417783c44d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:21.009287 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a0a9f-62d2-4f80-9de8-417783c44d87 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:21.044819 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1052/2106] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:21.046275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138a795-e87f-4eac-9cae-54bc0bc42e27 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:21.052275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:21.073255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138a795-e87f-4eac-9cae-54bc0bc42e27 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:21.081800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9a628-6f30-45f7-a704-d97142ab99a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:21.082623 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9a628-6f30-45f7-a704-d97142ab99a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:21.082908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9a628-6f30-45f7-a704-d97142ab99a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:21.083695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9a628-6f30-45f7-a704-d97142ab99a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:21.084561 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9a628-6f30-45f7-a704-d97142ab99a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:21.086774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9a628-6f30-45f7-a704-d97142ab99a2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:21.101046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1055/2107] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:21.104105 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a0a9f-62d2-4f80-9de8-417783c44d87 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:21.116323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a0a9f-62d2-4f80-9de8-417783c44d87 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:21.124231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67adf00-2906-42a2-8cf9-73420536b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:21.125500 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67adf00-2906-42a2-8cf9-73420536b570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:21.125791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67adf00-2906-42a2-8cf9-73420536b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:21.126124 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67adf00-2906-42a2-8cf9-73420536b570 admin admin] PATH_INFO: `/v3/projects/f93bee5696f54cc3941ef9306680a53c/users/fe04f69023014974b801ab8817d9d0e0/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:21.144895 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67adf00-2906-42a2-8cf9-73420536b570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93bee5696f54cc3941ef9306680a53c, user_id=fe04f69023014974b801ab8817d9d0e0, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:21.147756 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67adf00-2906-42a2-8cf9-73420536b570 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:21.164620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1053/2108] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:21 2022] PUT /identity/v3/projects/f93bee5696f54cc3941ef9306680a53c/users/fe04f69023014974b801ab8817d9d0e0/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:21.176561 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e2b35-0ae7-4ad0-bbb9-ad83fe98fc2a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:21.176780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e2b35-0ae7-4ad0-bbb9-ad83fe98fc2a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:21.177109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e2b35-0ae7-4ad0-bbb9-ad83fe98fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:21.207778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e31e2b35-0ae7-4ad0-bbb9-ad83fe98fc2a None None] MFA Rules not processed for user `fe04f69023014974b801ab8817d9d0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:21.211780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e31e2b35-0ae7-4ad0-bbb9-ad83fe98fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:21.291095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1056/2109] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:21.295827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67adf00-2906-42a2-8cf9-73420536b570 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:21.368652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67adf00-2906-42a2-8cf9-73420536b570 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:21.374457 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e64df-943f-496e-92c8-14fc19d96f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:21.375162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e64df-943f-496e-92c8-14fc19d96f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:21.375441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e64df-943f-496e-92c8-14fc19d96f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:21.375714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e64df-943f-496e-92c8-14fc19d96f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:21.376417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e64df-943f-496e-92c8-14fc19d96f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:21.378399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e64df-943f-496e-92c8-14fc19d96f73 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:21.405627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1054/2110] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:21 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:21.409867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e2b35-0ae7-4ad0-bbb9-ad83fe98fc2a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:21.421697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e2b35-0ae7-4ad0-bbb9-ad83fe98fc2a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:21.479836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85807b30-b34d-4906-ab2a-a512ce5e29af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:21.480536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85807b30-b34d-4906-ab2a-a512ce5e29af admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:21.480820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85807b30-b34d-4906-ab2a-a512ce5e29af admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:21.481099 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85807b30-b34d-4906-ab2a-a512ce5e29af admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:21.481833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85807b30-b34d-4906-ab2a-a512ce5e29af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:21.483840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85807b30-b34d-4906-ab2a-a512ce5e29af admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:21.506770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1057/2111] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:21 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:21.511768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e64df-943f-496e-92c8-14fc19d96f73 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:21.526051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e64df-943f-496e-92c8-14fc19d96f73 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:21.531112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f420e16-cee6-42de-9521-adec374fc058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:21.531969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f420e16-cee6-42de-9521-adec374fc058 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:21.532234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f420e16-cee6-42de-9521-adec374fc058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:21.532504 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f420e16-cee6-42de-9521-adec374fc058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:21.533250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f420e16-cee6-42de-9521-adec374fc058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:21.534920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f420e16-cee6-42de-9521-adec374fc058 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:21.548474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1055/2112] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:21.552855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85807b30-b34d-4906-ab2a-a512ce5e29af admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:21.565392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85807b30-b34d-4906-ab2a-a512ce5e29af admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:21.571317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657e72d-125f-47df-a602-766d881d36eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:21.572241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657e72d-125f-47df-a602-766d881d36eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:21.572650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657e72d-125f-47df-a602-766d881d36eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:21.573683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657e72d-125f-47df-a602-766d881d36eb admin admin] PATH_INFO: `/v3/projects/7bac07d1eca34269ab6c9020412d57dc/users/679f2d39f95240119c51f4c133241f38/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:21.590905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657e72d-125f-47df-a602-766d881d36eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bac07d1eca34269ab6c9020412d57dc, user_id=679f2d39f95240119c51f4c133241f38, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:21.594177 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657e72d-125f-47df-a602-766d881d36eb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:21.611789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1058/2113] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:21 2022] PUT /identity/v3/projects/7bac07d1eca34269ab6c9020412d57dc/users/679f2d39f95240119c51f4c133241f38/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:21.617151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f420e16-cee6-42de-9521-adec374fc058 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:21.628630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f420e16-cee6-42de-9521-adec374fc058 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:21.657671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:21.726565 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da372a-75c7-42bf-8911-aacdcb6664a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:21.727269 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da372a-75c7-42bf-8911-aacdcb6664a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:21.727555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da372a-75c7-42bf-8911-aacdcb6664a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:21.727832 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da372a-75c7-42bf-8911-aacdcb6664a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:21.728729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da372a-75c7-42bf-8911-aacdcb6664a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:21.730426 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da372a-75c7-42bf-8911-aacdcb6664a3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:21.744660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1056/2114] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:21.746773 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657e72d-125f-47df-a602-766d881d36eb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:21.769857 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657e72d-125f-47df-a602-766d881d36eb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:21.770970 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da372a-75c7-42bf-8911-aacdcb6664a3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:21.772586 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c3ca0-085d-4935-8e59-c6d8b4d91681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:21.772774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-41da372a-75c7-42bf-8911-aacdcb6664a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:21.773495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c3ca0-085d-4935-8e59-c6d8b4d91681 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:21.773776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c3ca0-085d-4935-8e59-c6d8b4d91681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:21.774050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c3ca0-085d-4935-8e59-c6d8b4d91681 admin admin] PATH_INFO: `/v3/projects/7bac07d1eca34269ab6c9020412d57dc/users/679f2d39f95240119c51f4c133241f38/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:21.776131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c3ca0-085d-4935-8e59-c6d8b4d91681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bac07d1eca34269ab6c9020412d57dc, user_id=679f2d39f95240119c51f4c133241f38, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:21.778971 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c3ca0-085d-4935-8e59-c6d8b4d91681 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:21.789799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da372a-75c7-42bf-8911-aacdcb6664a3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:21.792080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1059/2115] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:21 2022] PUT /identity/v3/projects/7bac07d1eca34269ab6c9020412d57dc/users/679f2d39f95240119c51f4c133241f38/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:21.803168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fefb18-3fe1-459c-aafb-491489749c46 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:21.803475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fefb18-3fe1-459c-aafb-491489749c46 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:21.803806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fefb18-3fe1-459c-aafb-491489749c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:21.833089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b9fefb18-3fe1-459c-aafb-491489749c46 None None] MFA Rules not processed for user `679f2d39f95240119c51f4c133241f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:21.834671 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9fefb18-3fe1-459c-aafb-491489749c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:21.857432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:21.860298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f22da-79c4-4149-a958-522e23a11ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:21.861380 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f22da-79c4-4149-a958-522e23a11ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:21.861671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f22da-79c4-4149-a958-522e23a11ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:21.862087 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f22da-79c4-4149-a958-522e23a11ad0 admin admin] PATH_INFO: `/v3/users/9c9608ad9af74226b07d97bc3b15f2a9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:21.863857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f22da-79c4-4149-a958-522e23a11ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9608ad9af74226b07d97bc3b15f2a9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:21.866754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f22da-79c4-4149-a958-522e23a11ad0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:21.948577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1060/2116] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:21.966103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fefb18-3fe1-459c-aafb-491489749c46 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:21.967951 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-742f22da-79c4-4149-a958-522e23a11ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9608ad9af74226b07d97bc3b15f2a9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:21.968084 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9fefb18-3fe1-459c-aafb-491489749c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:21.977042 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-742f22da-79c4-4149-a958-522e23a11ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9608ad9af74226b07d97bc3b15f2a9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:21.996636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-742f22da-79c4-4149-a958-522e23a11ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9608ad9af74226b07d97bc3b15f2a9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:21.997947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-742f22da-79c4-4149-a958-522e23a11ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9608ad9af74226b07d97bc3b15f2a9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:21.999199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-742f22da-79c4-4149-a958-522e23a11ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9608ad9af74226b07d97bc3b15f2a9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:22.026895 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1057/2117] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:21 2022] DELETE /identity/v3/users/9c9608ad9af74226b07d97bc3b15f2a9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:22.031552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6370f7-f9dd-4ec6-80d4-d76514d0d82b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:22.031552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6370f7-f9dd-4ec6-80d4-d76514d0d82b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:22.031843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6370f7-f9dd-4ec6-80d4-d76514d0d82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:22.055641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fefb18-3fe1-459c-aafb-491489749c46 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:22.059154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9d6370f7-f9dd-4ec6-80d4-d76514d0d82b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:22.060661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9d6370f7-f9dd-4ec6-80d4-d76514d0d82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:22.096824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:22.128839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d4d05-f96e-4ab5-8464-0a6fffa1ad41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:22.129517 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d4d05-f96e-4ab5-8464-0a6fffa1ad41 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:22.129804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d4d05-f96e-4ab5-8464-0a6fffa1ad41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:22.130086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d4d05-f96e-4ab5-8464-0a6fffa1ad41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:22.132004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3c8d4d05-f96e-4ab5-8464-0a6fffa1ad41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:22.158877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1058/2118] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:22.168132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6370f7-f9dd-4ec6-80d4-d76514d0d82b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:22.170377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9d6370f7-f9dd-4ec6-80d4-d76514d0d82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:22.247644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d4d05-f96e-4ab5-8464-0a6fffa1ad41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:22.249113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d4d05-f96e-4ab5-8464-0a6fffa1ad41 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:22.270401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6370f7-f9dd-4ec6-80d4-d76514d0d82b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:22.272060 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1061/2119] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:22.274914 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a415758-8128-482c-b62f-387c4666be91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:22.276049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a415758-8128-482c-b62f-387c4666be91 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:22.276350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a415758-8128-482c-b62f-387c4666be91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:22.277127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a415758-8128-482c-b62f-387c4666be91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:22.296080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a415758-8128-482c-b62f-387c4666be91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:22.298069 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a415758-8128-482c-b62f-387c4666be91 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:22.316255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1059/2120] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:28:22.705391 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d4d05-f96e-4ab5-8464-0a6fffa1ad41 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:22.720804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d4d05-f96e-4ab5-8464-0a6fffa1ad41 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:22.728996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e6c30-b68f-47ed-a908-ea104ee7295c tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679f2d39f95240119c51f4c133241f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac07d1eca34269ab6c9020412d57dc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:22.729701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e6c30-b68f-47ed-a908-ea104ee7295c tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:22.729988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e6c30-b68f-47ed-a908-ea104ee7295c tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:22.730425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e6c30-b68f-47ed-a908-ea104ee7295c tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:22.731350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e6c30-b68f-47ed-a908-ea104ee7295c tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:22.731522 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e6c30-b68f-47ed-a908-ea104ee7295c tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:22.733276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e6c30-b68f-47ed-a908-ea104ee7295c tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:22.752305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1062/2121] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:22.754044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a415758-8128-482c-b62f-387c4666be91 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:22.768142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a415758-8128-482c-b62f-387c4666be91 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:22.773957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624423e-c85e-4c47-97c7-8d1ed0503335 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679f2d39f95240119c51f4c133241f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac07d1eca34269ab6c9020412d57dc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:22.775216 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624423e-c85e-4c47-97c7-8d1ed0503335 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:22.775510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624423e-c85e-4c47-97c7-8d1ed0503335 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:22.775791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624423e-c85e-4c47-97c7-8d1ed0503335 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:22.778506 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624423e-c85e-4c47-97c7-8d1ed0503335 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:22.789337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624423e-c85e-4c47-97c7-8d1ed0503335 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:22.847396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1060/2122] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:22 2022] POST /identity/v3/projects => generated 353 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:22.852560 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e6c30-b68f-47ed-a908-ea104ee7295c tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:22.866877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e6c30-b68f-47ed-a908-ea104ee7295c tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:22.878504 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:22.958734 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f1295-4e62-4c91-ba54-0bbab6cc98e3 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679f2d39f95240119c51f4c133241f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac07d1eca34269ab6c9020412d57dc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:22.959387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f1295-4e62-4c91-ba54-0bbab6cc98e3 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:22.959670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f1295-4e62-4c91-ba54-0bbab6cc98e3 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:22.960583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f1295-4e62-4c91-ba54-0bbab6cc98e3 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:22.961123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f1295-4e62-4c91-ba54-0bbab6cc98e3 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:22.961372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f1295-4e62-4c91-ba54-0bbab6cc98e3 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:22.963188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f1295-4e62-4c91-ba54-0bbab6cc98e3 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:22.980578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1063/2123] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:23.028455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624423e-c85e-4c47-97c7-8d1ed0503335 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:23.039897 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624423e-c85e-4c47-97c7-8d1ed0503335 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:23.044590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679f2d39f95240119c51f4c133241f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac07d1eca34269ab6c9020412d57dc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:23.045471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:23.045751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:23.046021 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] PATH_INFO: `/v3/projects/5a37459804fe44c8a3f714bd0c8c07be` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:23.047361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5a37459804fe44c8a3f714bd0c8c07be)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:23.049286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:23.104838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a37459804fe44c8a3f714bd0c8c07be', 'request_id': 'req-d79703d2-c536-4a15-b679-cdeb3c69303d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.114849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a37459804fe44c8a3f714bd0c8c07be', 'request_id': 'req-d79703d2-c536-4a15-b679-cdeb3c69303d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.121448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a37459804fe44c8a3f714bd0c8c07be', 'request_id': 'req-d79703d2-c536-4a15-b679-cdeb3c69303d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.136022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] The token cache is being invalidate because project 5a37459804fe44c8a3f714bd0c8c07be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:23.136330 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.137022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.138930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1061/2124] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:23 2022] DELETE /identity/v3/projects/5a37459804fe44c8a3f714bd0c8c07be => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:23.201859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f1295-4e62-4c91-ba54-0bbab6cc98e3 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:23.203820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ba1f1295-4e62-4c91-ba54-0bbab6cc98e3 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:23.340557 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f1295-4e62-4c91-ba54-0bbab6cc98e3 tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:23.435363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb892f58-612b-4ad5-92cc-991ca4512b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:23.437271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb892f58-612b-4ad5-92cc-991ca4512b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:23.437789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb892f58-612b-4ad5-92cc-991ca4512b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:23.439149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb892f58-612b-4ad5-92cc-991ca4512b6c admin admin] PATH_INFO: `/v3/projects/2bc59cb7c3ed4275a205d7039ec95c61` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:23.442683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb892f58-612b-4ad5-92cc-991ca4512b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc59cb7c3ed4275a205d7039ec95c61)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:23.449857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:23.453913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb892f58-612b-4ad5-92cc-991ca4512b6c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:23.454870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:23.488634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79703d2-c536-4a15-b679-cdeb3c69303d tempest-VolumeQuotaClassesTest-1839349995 tempest-VolumeQuotaClassesTest-1839349995-project-admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:23.498131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b67b63-57d3-4459-8e38-3b23946c2ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:23.499805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b67b63-57d3-4459-8e38-3b23946c2ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:23.500728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b67b63-57d3-4459-8e38-3b23946c2ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:23.500878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b67b63-57d3-4459-8e38-3b23946c2ca5 admin admin] PATH_INFO: `/v3/users/fe04f69023014974b801ab8817d9d0e0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:23.503030 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b67b63-57d3-4459-8e38-3b23946c2ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe04f69023014974b801ab8817d9d0e0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:23.506948 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b67b63-57d3-4459-8e38-3b23946c2ca5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:23.523620 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fb892f58-612b-4ad5-92cc-991ca4512b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc59cb7c3ed4275a205d7039ec95c61', 'request_id': 'req-fb892f58-612b-4ad5-92cc-991ca4512b6c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.531067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fb892f58-612b-4ad5-92cc-991ca4512b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc59cb7c3ed4275a205d7039ec95c61', 'request_id': 'req-fb892f58-612b-4ad5-92cc-991ca4512b6c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.532898 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:23.539225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fb892f58-612b-4ad5-92cc-991ca4512b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc59cb7c3ed4275a205d7039ec95c61', 'request_id': 'req-fb892f58-612b-4ad5-92cc-991ca4512b6c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.558467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fb892f58-612b-4ad5-92cc-991ca4512b6c admin admin] The token cache is being invalidate because project 2bc59cb7c3ed4275a205d7039ec95c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:23.558734 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fb892f58-612b-4ad5-92cc-991ca4512b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.559649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fb892f58-612b-4ad5-92cc-991ca4512b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.561323 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1064/2125] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:23 2022] DELETE /identity/v3/projects/2bc59cb7c3ed4275a205d7039ec95c61 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:23.566306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de931b-15d2-4943-a673-e9e95a91a4db None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:23.566669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de931b-15d2-4943-a673-e9e95a91a4db None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:23.567014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de931b-15d2-4943-a673-e9e95a91a4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:23.572189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:23.590537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-79de931b-15d2-4943-a673-e9e95a91a4db None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:23.592116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-79de931b-15d2-4943-a673-e9e95a91a4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:23.601084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c7b67b63-57d3-4459-8e38-3b23946c2ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe04f69023014974b801ab8817d9d0e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.609689 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c7b67b63-57d3-4459-8e38-3b23946c2ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe04f69023014974b801ab8817d9d0e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.626233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c7b67b63-57d3-4459-8e38-3b23946c2ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe04f69023014974b801ab8817d9d0e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.626974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c7b67b63-57d3-4459-8e38-3b23946c2ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe04f69023014974b801ab8817d9d0e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.627568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c7b67b63-57d3-4459-8e38-3b23946c2ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe04f69023014974b801ab8817d9d0e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:23.647468 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1062/2126] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:23 2022] DELETE /identity/v3/users/fe04f69023014974b801ab8817d9d0e0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:23.663162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198dfb2-fce4-4e5a-9312-a4ea87cf67c5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:23.663461 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198dfb2-fce4-4e5a-9312-a4ea87cf67c5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:23.663743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198dfb2-fce4-4e5a-9312-a4ea87cf67c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:23.678528 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1065/2127] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:23.684857 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b87e0-6d69-4aeb-a3ea-1de7bcae82c4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:23.686048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b87e0-6d69-4aeb-a3ea-1de7bcae82c4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:23.686482 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b87e0-6d69-4aeb-a3ea-1de7bcae82c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:23.699132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5198dfb2-fce4-4e5a-9312-a4ea87cf67c5 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:23.700870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5198dfb2-fce4-4e5a-9312-a4ea87cf67c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:23.722871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6c4b87e0-6d69-4aeb-a3ea-1de7bcae82c4 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:23.725222 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6c4b87e0-6d69-4aeb-a3ea-1de7bcae82c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:23.771207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1063/2128] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:23.782538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198dfb2-fce4-4e5a-9312-a4ea87cf67c5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:23.784244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5198dfb2-fce4-4e5a-9312-a4ea87cf67c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:23.800127 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1066/2129] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:23.804508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b87e0-6d69-4aeb-a3ea-1de7bcae82c4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:23.814814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b87e0-6d69-4aeb-a3ea-1de7bcae82c4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:23.824436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc1639-d5eb-4403-89c5-372daa2f8dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:23.825236 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc1639-d5eb-4403-89c5-372daa2f8dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:23.825578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc1639-d5eb-4403-89c5-372daa2f8dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:23.825922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc1639-d5eb-4403-89c5-372daa2f8dd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:23.826740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc1639-d5eb-4403-89c5-372daa2f8dd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:23.827117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc1639-d5eb-4403-89c5-372daa2f8dd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:23.829532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc1639-d5eb-4403-89c5-372daa2f8dd5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:23.843045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1067/2130] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:23.847526 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc1639-d5eb-4403-89c5-372daa2f8dd5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:23.854600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198dfb2-fce4-4e5a-9312-a4ea87cf67c5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:23.861280 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc1639-d5eb-4403-89c5-372daa2f8dd5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:23.861682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e31623-f76f-4d21-b2ba-95c430cf8473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:23.862428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e31623-f76f-4d21-b2ba-95c430cf8473 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:23.862691 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e31623-f76f-4d21-b2ba-95c430cf8473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:23.862985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e31623-f76f-4d21-b2ba-95c430cf8473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:23.866535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97d550-a5be-4437-8ae5-1903ad1bef72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:23.867211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97d550-a5be-4437-8ae5-1903ad1bef72 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:23.867501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97d550-a5be-4437-8ae5-1903ad1bef72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:23.868433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97d550-a5be-4437-8ae5-1903ad1bef72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:23.869262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97d550-a5be-4437-8ae5-1903ad1bef72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:23.871346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97d550-a5be-4437-8ae5-1903ad1bef72 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:23.873957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e31623-f76f-4d21-b2ba-95c430cf8473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:23.875478 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e31623-f76f-4d21-b2ba-95c430cf8473 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:23.886719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1064/2131] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:28:23.904982 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1068/2132] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:23 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:28:23.910777 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e31623-f76f-4d21-b2ba-95c430cf8473 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:23.921627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e31623-f76f-4d21-b2ba-95c430cf8473 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:23.993957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:24.008589 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b7514-ac1d-484c-accd-f22a2cc65e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:24.009640 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7514-ac1d-484c-accd-f22a2cc65e8f admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:24.010420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7514-ac1d-484c-accd-f22a2cc65e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:24.010975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7514-ac1d-484c-accd-f22a2cc65e8f admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:24.013458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b7514-ac1d-484c-accd-f22a2cc65e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:24.014052 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b7514-ac1d-484c-accd-f22a2cc65e8f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:24.049166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1065/2133] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:23 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:24.050783 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97d550-a5be-4437-8ae5-1903ad1bef72 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:24.080671 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97d550-a5be-4437-8ae5-1903ad1bef72 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:24.095153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cb9d5-e696-4827-94fd-0a2794def649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:24.095857 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cb9d5-e696-4827-94fd-0a2794def649 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:24.096572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cb9d5-e696-4827-94fd-0a2794def649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:24.096572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cb9d5-e696-4827-94fd-0a2794def649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:24.097227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cb9d5-e696-4827-94fd-0a2794def649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:24.098980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cb9d5-e696-4827-94fd-0a2794def649 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:24.116183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1069/2134] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:24.125291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b7514-ac1d-484c-accd-f22a2cc65e8f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:24.139872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b7514-ac1d-484c-accd-f22a2cc65e8f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:24.145372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926bc20-748d-4e52-87f2-d6511f092a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:24.167093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926bc20-748d-4e52-87f2-d6511f092a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:24.169928 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926bc20-748d-4e52-87f2-d6511f092a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:24.173110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926bc20-748d-4e52-87f2-d6511f092a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:24.173110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926bc20-748d-4e52-87f2-d6511f092a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:24.177352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926bc20-748d-4e52-87f2-d6511f092a0f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:24.203060 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1066/2135] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:24.206666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cb9d5-e696-4827-94fd-0a2794def649 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:24.220754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cb9d5-e696-4827-94fd-0a2794def649 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:24.228585 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57317771-6324-4e7e-8838-d3b8f8b0e767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:24.229639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57317771-6324-4e7e-8838-d3b8f8b0e767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:24.229970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57317771-6324-4e7e-8838-d3b8f8b0e767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:24.230461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57317771-6324-4e7e-8838-d3b8f8b0e767 admin admin] PATH_INFO: `/v3/projects/ddbc4d5bf668410c9a6d208c084e6cbc/users/5634691faf874333986a446c24e0ed0d/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:24.268562 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57317771-6324-4e7e-8838-d3b8f8b0e767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddbc4d5bf668410c9a6d208c084e6cbc, user_id=5634691faf874333986a446c24e0ed0d, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:24.271563 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57317771-6324-4e7e-8838-d3b8f8b0e767 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:24.295428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1070/2136] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:24 2022] PUT /identity/v3/projects/ddbc4d5bf668410c9a6d208c084e6cbc/users/5634691faf874333986a446c24e0ed0d/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:24.310574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9358-f6a5-4c04-a945-03d727084e9c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:24.311078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9358-f6a5-4c04-a945-03d727084e9c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:24.311743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9358-f6a5-4c04-a945-03d727084e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:24.365868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a7bf9358-f6a5-4c04-a945-03d727084e9c None None] MFA Rules not processed for user `5634691faf874333986a446c24e0ed0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:24.367140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a7bf9358-f6a5-4c04-a945-03d727084e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:24.426209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57317771-6324-4e7e-8838-d3b8f8b0e767 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:24.427975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-57317771-6324-4e7e-8838-d3b8f8b0e767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:24.450682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:24.464921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1067/2137] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:24.477231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf9358-f6a5-4c04-a945-03d727084e9c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:24.478851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a7bf9358-f6a5-4c04-a945-03d727084e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:24.508364 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57317771-6324-4e7e-8838-d3b8f8b0e767 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:24.513477 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:24.514864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:24.515155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:24.515549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] PATH_INFO: `/v3/projects/f93bee5696f54cc3941ef9306680a53c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:24.517097 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93bee5696f54cc3941ef9306680a53c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:24.519306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:24.551119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf9358-f6a5-4c04-a945-03d727084e9c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:24.555167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6746564-423f-4a6e-820e-e9ab0a3e13e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:24.555785 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6746564-423f-4a6e-820e-e9ab0a3e13e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:24.556797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6746564-423f-4a6e-820e-e9ab0a3e13e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:24.557161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6746564-423f-4a6e-820e-e9ab0a3e13e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:24.567300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6746564-423f-4a6e-820e-e9ab0a3e13e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:24.568814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6746564-423f-4a6e-820e-e9ab0a3e13e3 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:24.579214 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1068/2138] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:28:24.579410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93bee5696f54cc3941ef9306680a53c', 'request_id': 'req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:24.589759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93bee5696f54cc3941ef9306680a53c', 'request_id': 'req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:24.596102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93bee5696f54cc3941ef9306680a53c', 'request_id': 'req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:24.617133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] The token cache is being invalidate because project f93bee5696f54cc3941ef9306680a53c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:24.617421 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:24.618146 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:24.620002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1071/2139] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:24 2022] DELETE /identity/v3/projects/f93bee5696f54cc3941ef9306680a53c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:24.624430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6746564-423f-4a6e-820e-e9ab0a3e13e3 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:24.635876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6746564-423f-4a6e-820e-e9ab0a3e13e3 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:24.705596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75dd99-c988-46ae-8033-8e0f98511309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:24.716618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75dd99-c988-46ae-8033-8e0f98511309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:24.716912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75dd99-c988-46ae-8033-8e0f98511309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:24.717202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75dd99-c988-46ae-8033-8e0f98511309 admin admin] PATH_INFO: `/v3/users/679f2d39f95240119c51f4c133241f38` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:24.719082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75dd99-c988-46ae-8033-8e0f98511309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=679f2d39f95240119c51f4c133241f38)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:24.721918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75dd99-c988-46ae-8033-8e0f98511309 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:24.725249 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:24.812411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d75dd99-c988-46ae-8033-8e0f98511309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679f2d39f95240119c51f4c133241f38'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:24.820331 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d75dd99-c988-46ae-8033-8e0f98511309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679f2d39f95240119c51f4c133241f38'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:24.834790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d75dd99-c988-46ae-8033-8e0f98511309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679f2d39f95240119c51f4c133241f38'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:24.835381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d75dd99-c988-46ae-8033-8e0f98511309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679f2d39f95240119c51f4c133241f38'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:24.836016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d75dd99-c988-46ae-8033-8e0f98511309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679f2d39f95240119c51f4c133241f38'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:24.850784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1069/2140] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:24 2022] DELETE /identity/v3/users/679f2d39f95240119c51f4c133241f38 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:25.173766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:25.175312 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:25.191672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd8ef0-6bc2-4b03-9f50-ef39185e9e22 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:25.255094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e274f05-169d-4f7d-b062-98a7dcaed2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:25.255985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e274f05-169d-4f7d-b062-98a7dcaed2ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:25.256269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e274f05-169d-4f7d-b062-98a7dcaed2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:25.256576 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e274f05-169d-4f7d-b062-98a7dcaed2ea admin admin] PATH_INFO: `/v3/projects/7bac07d1eca34269ab6c9020412d57dc` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:25.257814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e274f05-169d-4f7d-b062-98a7dcaed2ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bac07d1eca34269ab6c9020412d57dc)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:25.259789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e274f05-169d-4f7d-b062-98a7dcaed2ea admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:25.305492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:25.308822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e274f05-169d-4f7d-b062-98a7dcaed2ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bac07d1eca34269ab6c9020412d57dc', 'request_id': 'req-4e274f05-169d-4f7d-b062-98a7dcaed2ea'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:25.316370 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e274f05-169d-4f7d-b062-98a7dcaed2ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bac07d1eca34269ab6c9020412d57dc', 'request_id': 'req-4e274f05-169d-4f7d-b062-98a7dcaed2ea'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:25.323214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e274f05-169d-4f7d-b062-98a7dcaed2ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bac07d1eca34269ab6c9020412d57dc', 'request_id': 'req-4e274f05-169d-4f7d-b062-98a7dcaed2ea'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:25.340303 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e274f05-169d-4f7d-b062-98a7dcaed2ea admin admin] The token cache is being invalidate because project 7bac07d1eca34269ab6c9020412d57dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:25.340712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e274f05-169d-4f7d-b062-98a7dcaed2ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:25.341373 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e274f05-169d-4f7d-b062-98a7dcaed2ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:25.343031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1072/2141] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:25 2022] DELETE /identity/v3/projects/7bac07d1eca34269ab6c9020412d57dc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:25.348796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44c023-4a24-4b3d-a966-d2c94088b00e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:25.349162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44c023-4a24-4b3d-a966-d2c94088b00e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:25.349509 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44c023-4a24-4b3d-a966-d2c94088b00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:25.370218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1d44c023-4a24-4b3d-a966-d2c94088b00e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:25.371446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1d44c023-4a24-4b3d-a966-d2c94088b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:25.500799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1070/2142] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:25.508731 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357c2a-54db-4c45-b500-e2b0008a471a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:25.509026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357c2a-54db-4c45-b500-e2b0008a471a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:25.509310 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357c2a-54db-4c45-b500-e2b0008a471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:25.539629 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2c357c2a-54db-4c45-b500-e2b0008a471a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:25.541109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2c357c2a-54db-4c45-b500-e2b0008a471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:25.551028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1073/2143] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:25.556331 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44c023-4a24-4b3d-a966-d2c94088b00e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:25.576265 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44c023-4a24-4b3d-a966-d2c94088b00e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:25.582985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d976b-c98f-4653-9a5d-bd33cbd1d4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:25.584263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d976b-c98f-4653-9a5d-bd33cbd1d4ac admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:25.584649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d976b-c98f-4653-9a5d-bd33cbd1d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:25.584994 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d976b-c98f-4653-9a5d-bd33cbd1d4ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:25.585847 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d976b-c98f-4653-9a5d-bd33cbd1d4ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:25.586224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d976b-c98f-4653-9a5d-bd33cbd1d4ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:25.587936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d976b-c98f-4653-9a5d-bd33cbd1d4ac admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:25.601100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1071/2144] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:25.605304 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c357c2a-54db-4c45-b500-e2b0008a471a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:25.615199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c357c2a-54db-4c45-b500-e2b0008a471a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:25.620678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e565f7-5acc-4161-acb1-7377e46e7bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:25.621349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e565f7-5acc-4161-acb1-7377e46e7bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:25.621630 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e565f7-5acc-4161-acb1-7377e46e7bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:25.621901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e565f7-5acc-4161-acb1-7377e46e7bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:25.622600 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e565f7-5acc-4161-acb1-7377e46e7bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:25.624972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e565f7-5acc-4161-acb1-7377e46e7bc9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:25.659324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1074/2145] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:25 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:25.662175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d976b-c98f-4653-9a5d-bd33cbd1d4ac admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:25.672848 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d976b-c98f-4653-9a5d-bd33cbd1d4ac admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:25.756730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310332e-535d-4106-b199-206ed8c2f056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:25.757801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310332e-535d-4106-b199-206ed8c2f056 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:25.758137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310332e-535d-4106-b199-206ed8c2f056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:25.758666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310332e-535d-4106-b199-206ed8c2f056 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:25.760176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310332e-535d-4106-b199-206ed8c2f056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:25.762967 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310332e-535d-4106-b199-206ed8c2f056 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:25.784581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:25.799498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e565f7-5acc-4161-acb1-7377e46e7bc9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:25.800877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1072/2146] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:25 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:25.814262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e565f7-5acc-4161-acb1-7377e46e7bc9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:25.828088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a8fef-03c9-41de-b580-8018b8d67906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:25.828827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a8fef-03c9-41de-b580-8018b8d67906 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:25.829107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a8fef-03c9-41de-b580-8018b8d67906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:25.829382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a8fef-03c9-41de-b580-8018b8d67906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:25.830180 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a8fef-03c9-41de-b580-8018b8d67906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:25.831805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a8fef-03c9-41de-b580-8018b8d67906 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:25.851048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1075/2147] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:25.857774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310332e-535d-4106-b199-206ed8c2f056 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:25.870983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310332e-535d-4106-b199-206ed8c2f056 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:25.878015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ab20a-f26b-4f28-a8d7-77cd8358bf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:25.878919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ab20a-f26b-4f28-a8d7-77cd8358bf53 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:25.879272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ab20a-f26b-4f28-a8d7-77cd8358bf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:25.879619 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ab20a-f26b-4f28-a8d7-77cd8358bf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:25.880444 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ab20a-f26b-4f28-a8d7-77cd8358bf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:25.882232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ab20a-f26b-4f28-a8d7-77cd8358bf53 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:25.896688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1073/2148] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:25.898978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a8fef-03c9-41de-b580-8018b8d67906 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:25.909249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a8fef-03c9-41de-b580-8018b8d67906 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:25.914413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f676d-d50c-435b-ad19-0e7cfb59b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:25.915445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f676d-d50c-435b-ad19-0e7cfb59b810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:25.915790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f676d-d50c-435b-ad19-0e7cfb59b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:25.916131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f676d-d50c-435b-ad19-0e7cfb59b810 admin admin] PATH_INFO: `/v3/projects/0cf4b3e815394016960aebac940418e2/users/d1e21e9b82e54c6dad4c8d217d3d2be0/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:25.933245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f676d-d50c-435b-ad19-0e7cfb59b810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf4b3e815394016960aebac940418e2, user_id=d1e21e9b82e54c6dad4c8d217d3d2be0, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:25.936101 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f676d-d50c-435b-ad19-0e7cfb59b810 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:25.957472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1076/2149] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:25 2022] PUT /identity/v3/projects/0cf4b3e815394016960aebac940418e2/users/d1e21e9b82e54c6dad4c8d217d3d2be0/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:25.967919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c2005-42be-49d4-bcc7-244ebdb09b91 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:25.968204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c2005-42be-49d4-bcc7-244ebdb09b91 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:25.968475 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c2005-42be-49d4-bcc7-244ebdb09b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:26.005747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-756c2005-42be-49d4-bcc7-244ebdb09b91 None None] MFA Rules not processed for user `d1e21e9b82e54c6dad4c8d217d3d2be0`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:26.006996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-756c2005-42be-49d4-bcc7-244ebdb09b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:26.091757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f676d-d50c-435b-ad19-0e7cfb59b810 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:26.098990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1074/2150] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:26.188605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f676d-d50c-435b-ad19-0e7cfb59b810 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:26.195691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9502be6-c351-46bc-9aec-feaaece21626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:26.196921 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9502be6-c351-46bc-9aec-feaaece21626 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:26.197379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9502be6-c351-46bc-9aec-feaaece21626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:26.197806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9502be6-c351-46bc-9aec-feaaece21626 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:26.198699 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9502be6-c351-46bc-9aec-feaaece21626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:26.201840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9502be6-c351-46bc-9aec-feaaece21626 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:26.244720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1077/2151] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:26 2022] POST /identity/v3/projects => generated 389 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:28:26.245936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c2005-42be-49d4-bcc7-244ebdb09b91 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:26.258010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c2005-42be-49d4-bcc7-244ebdb09b91 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:26.329700 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd7b8e-70f6-4ee6-aa90-15e8bfbcb904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:26.330275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7b8e-70f6-4ee6-aa90-15e8bfbcb904 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:26.330552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7b8e-70f6-4ee6-aa90-15e8bfbcb904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:26.330831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7b8e-70f6-4ee6-aa90-15e8bfbcb904 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:26.331711 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd7b8e-70f6-4ee6-aa90-15e8bfbcb904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:26.333677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd7b8e-70f6-4ee6-aa90-15e8bfbcb904 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:26.358601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1075/2152] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:26 2022] POST /identity/v3/users => generated 301 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:26.363150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9502be6-c351-46bc-9aec-feaaece21626 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:26.375472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9502be6-c351-46bc-9aec-feaaece21626 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:26.380321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e78f49-3f2b-47b9-8ee4-e60156ce9baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:26.381042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e78f49-3f2b-47b9-8ee4-e60156ce9baa admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:26.381320 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e78f49-3f2b-47b9-8ee4-e60156ce9baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:26.381597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e78f49-3f2b-47b9-8ee4-e60156ce9baa admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:26.382354 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e78f49-3f2b-47b9-8ee4-e60156ce9baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:26.383969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e78f49-3f2b-47b9-8ee4-e60156ce9baa admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:26.403564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1078/2153] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:26.404806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd7b8e-70f6-4ee6-aa90-15e8bfbcb904 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:26.419986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd7b8e-70f6-4ee6-aa90-15e8bfbcb904 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:26.425292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695d852-f77a-4b38-8b37-573065dbdca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:26.426240 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695d852-f77a-4b38-8b37-573065dbdca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:26.426520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695d852-f77a-4b38-8b37-573065dbdca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:26.426798 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695d852-f77a-4b38-8b37-573065dbdca2 admin admin] PATH_INFO: `/v3/projects/2af82d465687462db93f92ad25adc424/users/76ba44ad45e84751b81349924c8afc34/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:26.443359 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695d852-f77a-4b38-8b37-573065dbdca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af82d465687462db93f92ad25adc424, user_id=76ba44ad45e84751b81349924c8afc34, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:26.446132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695d852-f77a-4b38-8b37-573065dbdca2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:26.461633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1076/2154] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:26 2022] PUT /identity/v3/projects/2af82d465687462db93f92ad25adc424/users/76ba44ad45e84751b81349924c8afc34/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:26.465837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e78f49-3f2b-47b9-8ee4-e60156ce9baa admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:26.476988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e78f49-3f2b-47b9-8ee4-e60156ce9baa admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:26.525557 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:26.545134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db82514-dd03-46b8-b189-564dbd8f432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:26.545835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82514-dd03-46b8-b189-564dbd8f432a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:26.546119 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82514-dd03-46b8-b189-564dbd8f432a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:26.546392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82514-dd03-46b8-b189-564dbd8f432a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:26.547272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db82514-dd03-46b8-b189-564dbd8f432a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:26.548945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db82514-dd03-46b8-b189-564dbd8f432a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:26.560527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1079/2155] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:26.568091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695d852-f77a-4b38-8b37-573065dbdca2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:26.581309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695d852-f77a-4b38-8b37-573065dbdca2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:26.586793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008e18d-abdd-4789-8d7f-7ba41858eccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:26.587701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008e18d-abdd-4789-8d7f-7ba41858eccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:26.587986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008e18d-abdd-4789-8d7f-7ba41858eccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:26.588767 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008e18d-abdd-4789-8d7f-7ba41858eccb admin admin] PATH_INFO: `/v3/projects/2af82d465687462db93f92ad25adc424/users/76ba44ad45e84751b81349924c8afc34/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:26.590547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008e18d-abdd-4789-8d7f-7ba41858eccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af82d465687462db93f92ad25adc424, user_id=76ba44ad45e84751b81349924c8afc34, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:26.593459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008e18d-abdd-4789-8d7f-7ba41858eccb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:26.607956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1077/2156] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:26 2022] PUT /identity/v3/projects/2af82d465687462db93f92ad25adc424/users/76ba44ad45e84751b81349924c8afc34/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:26.618367 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28704a0d-0aad-418a-a7f9-84ca6adb6601 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:26.618658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28704a0d-0aad-418a-a7f9-84ca6adb6601 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:26.618934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28704a0d-0aad-418a-a7f9-84ca6adb6601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:26.648595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-28704a0d-0aad-418a-a7f9-84ca6adb6601 None None] MFA Rules not processed for user `76ba44ad45e84751b81349924c8afc34`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:26.649854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-28704a0d-0aad-418a-a7f9-84ca6adb6601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:26.731600 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1080/2157] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:26.744484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008e18d-abdd-4789-8d7f-7ba41858eccb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:26.747011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6008e18d-abdd-4789-8d7f-7ba41858eccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:26.787235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:26.818266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db37c3e-d745-43f2-b882-19f5708ac8d8 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:26.818677 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db37c3e-d745-43f2-b882-19f5708ac8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:26.818988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db37c3e-d745-43f2-b882-19f5708ac8d8 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:26.820899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1081/2158] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:28:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:28:26.829039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008e18d-abdd-4789-8d7f-7ba41858eccb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:26.831148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348fe32-b2f3-4173-bf3e-d3e8f15f464f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:26.831574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348fe32-b2f3-4173-bf3e-d3e8f15f464f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:26.831848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348fe32-b2f3-4173-bf3e-d3e8f15f464f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:26.833458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948199a7-dccc-42c0-9f91-9e128f51fbbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:26.834123 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948199a7-dccc-42c0-9f91-9e128f51fbbc service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:26.834408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948199a7-dccc-42c0-9f91-9e128f51fbbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:26.834686 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948199a7-dccc-42c0-9f91-9e128f51fbbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:26.844422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948199a7-dccc-42c0-9f91-9e128f51fbbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:26.845926 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948199a7-dccc-42c0-9f91-9e128f51fbbc service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:26.856679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8348fe32-b2f3-4173-bf3e-d3e8f15f464f None None] MFA Rules not processed for user `1fd9ea435d7b48cb8b1b2a27d79cfa91`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:26.858367 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8348fe32-b2f3-4173-bf3e-d3e8f15f464f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:26.861320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1078/2159] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:26.948920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948199a7-dccc-42c0-9f91-9e128f51fbbc service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:26.953137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-948199a7-dccc-42c0-9f91-9e128f51fbbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:27.035674 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1082/2160] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:28:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:27.054046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348fe32-b2f3-4173-bf3e-d3e8f15f464f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:27.055612 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8348fe32-b2f3-4173-bf3e-d3e8f15f464f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:27.057807 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948199a7-dccc-42c0-9f91-9e128f51fbbc service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:27.064442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e92c7-3737-48a7-9e7b-2303ea58928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:27.065718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e92c7-3737-48a7-9e7b-2303ea58928d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:27.066138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e92c7-3737-48a7-9e7b-2303ea58928d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:27.066542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e92c7-3737-48a7-9e7b-2303ea58928d admin admin] PATH_INFO: `/v3/users/a999398fb6d843fa8fc9f6a2612b840d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:27.069263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e92c7-3737-48a7-9e7b-2303ea58928d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a999398fb6d843fa8fc9f6a2612b840d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:27.071488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e92c7-3737-48a7-9e7b-2303ea58928d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:27.072997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348fe32-b2f3-4173-bf3e-d3e8f15f464f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:27.079202 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce04fd-7e41-4b50-845b-e9aa1081f921 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd9ea435d7b48cb8b1b2a27d79cfa91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:27.079875 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce04fd-7e41-4b50-845b-e9aa1081f921 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:27.080160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce04fd-7e41-4b50-845b-e9aa1081f921 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:27.080439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce04fd-7e41-4b50-845b-e9aa1081f921 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:27.090618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce04fd-7e41-4b50-845b-e9aa1081f921 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:27.092201 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce04fd-7e41-4b50-845b-e9aa1081f921 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:27.106410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1083/2161] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:27.107155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce04fd-7e41-4b50-845b-e9aa1081f921 service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:27.119190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce04fd-7e41-4b50-845b-e9aa1081f921 service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:27.124863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:27.126196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:27.126618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:27.127031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] PATH_INFO: `/v3/users/d1e21e9b82e54c6dad4c8d217d3d2be0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:27.128621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e21e9b82e54c6dad4c8d217d3d2be0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:27.130740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:27.147199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5f8e92c7-3737-48a7-9e7b-2303ea58928d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a999398fb6d843fa8fc9f6a2612b840d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.156718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5f8e92c7-3737-48a7-9e7b-2303ea58928d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a999398fb6d843fa8fc9f6a2612b840d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.187294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5f8e92c7-3737-48a7-9e7b-2303ea58928d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a999398fb6d843fa8fc9f6a2612b840d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.188396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5f8e92c7-3737-48a7-9e7b-2303ea58928d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a999398fb6d843fa8fc9f6a2612b840d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.189265 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5f8e92c7-3737-48a7-9e7b-2303ea58928d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a999398fb6d843fa8fc9f6a2612b840d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.216257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1079/2162] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:26 2022] DELETE /identity/v3/users/a999398fb6d843fa8fc9f6a2612b840d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:27.219315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:27.223030 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e21e9b82e54c6dad4c8d217d3d2be0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.232700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e21e9b82e54c6dad4c8d217d3d2be0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.247499 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e21e9b82e54c6dad4c8d217d3d2be0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.267760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e21e9b82e54c6dad4c8d217d3d2be0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.268681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e21e9b82e54c6dad4c8d217d3d2be0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.280385 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1084/2163] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:27 2022] DELETE /identity/v3/users/d1e21e9b82e54c6dad4c8d217d3d2be0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:27.292412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e61dd-9609-47ee-bc37-d42287cb390b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:27.293167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e61dd-9609-47ee-bc37-d42287cb390b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:27.293167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e61dd-9609-47ee-bc37-d42287cb390b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:27.319899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9f0e61dd-9609-47ee-bc37-d42287cb390b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:27.320772 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9f0e61dd-9609-47ee-bc37-d42287cb390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:27.406654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:27.437305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1080/2164] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:27.463640 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:27.465649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:27.574011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e61dd-9609-47ee-bc37-d42287cb390b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:27.576214 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9f0e61dd-9609-47ee-bc37-d42287cb390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:27.591846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d909085-f937-4a37-8c20-81bd0ed8eb46 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:27.600224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e61dd-9609-47ee-bc37-d42287cb390b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:27.602061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc2aa0-0523-498e-bd59-767370cc18dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:27.607455 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc2aa0-0523-498e-bd59-767370cc18dc service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:27.609029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc2aa0-0523-498e-bd59-767370cc18dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:27.612454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc2aa0-0523-498e-bd59-767370cc18dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:27.619903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:27.621680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:27.622155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:27.622662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] PATH_INFO: `/v3/projects/58eb827a321f4200b604fabe074064ca` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:27.627857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] RBAC: Authorizing `identity:delete_project(project_id=58eb827a321f4200b604fabe074064ca)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:27.630127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:27.637922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc2aa0-0523-498e-bd59-767370cc18dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:27.640082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc2aa0-0523-498e-bd59-767370cc18dc service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:27.662744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1085/2165] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:27.735795 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58eb827a321f4200b604fabe074064ca', 'request_id': 'req-aa820797-2f0a-45e5-8935-98e112adf03c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.752944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58eb827a321f4200b604fabe074064ca', 'request_id': 'req-aa820797-2f0a-45e5-8935-98e112adf03c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.763553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58eb827a321f4200b604fabe074064ca', 'request_id': 'req-aa820797-2f0a-45e5-8935-98e112adf03c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.778220 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] The token cache is being invalidate because project 58eb827a321f4200b604fabe074064ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:27.778510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.779251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.780998 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1081/2166] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:27 2022] DELETE /identity/v3/projects/58eb827a321f4200b604fabe074064ca => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:27.785268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc2aa0-0523-498e-bd59-767370cc18dc service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:27.795792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc2aa0-0523-498e-bd59-767370cc18dc service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:27.860832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:27.861735 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:27.862035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:27.862363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] PATH_INFO: `/v3/users/1f5f868ff5684560ba8a059d7384f4c8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:27.863735 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5f868ff5684560ba8a059d7384f4c8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:27.865765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:27.918167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5f868ff5684560ba8a059d7384f4c8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.930254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5f868ff5684560ba8a059d7384f4c8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.939628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5f868ff5684560ba8a059d7384f4c8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.942995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:27.970436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5f868ff5684560ba8a059d7384f4c8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.971397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5f868ff5684560ba8a059d7384f4c8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:27.982103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1086/2167] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:27 2022] DELETE /identity/v3/users/1f5f868ff5684560ba8a059d7384f4c8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:28.079995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:28.081740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:28.099482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820797-2f0a-45e5-8935-98e112adf03c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:28.172247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:28.173079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.173494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.173766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] PATH_INFO: `/v3/projects/0cf4b3e815394016960aebac940418e2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.175096 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf4b3e815394016960aebac940418e2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:28.177238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:28.231045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf4b3e815394016960aebac940418e2', 'request_id': 'req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.239495 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf4b3e815394016960aebac940418e2', 'request_id': 'req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.245980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf4b3e815394016960aebac940418e2', 'request_id': 'req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.259067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] The token cache is being invalidate because project 0cf4b3e815394016960aebac940418e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:28.259341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.260100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.261851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1082/2168] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:28 2022] DELETE /identity/v3/projects/0cf4b3e815394016960aebac940418e2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:28.266562 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:28.268363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:28.285056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:28.286415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7755d6b-040e-4b96-a43d-27e46808abac admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:28.286790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:28.293392 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:28.367770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cccc1-97dc-4d1c-9576-21f5550461ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:28.368718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cccc1-97dc-4d1c-9576-21f5550461ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.369006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cccc1-97dc-4d1c-9576-21f5550461ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.369283 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cccc1-97dc-4d1c-9576-21f5550461ff admin admin] PATH_INFO: `/v3/users/76ba44ad45e84751b81349924c8afc34` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.370607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cccc1-97dc-4d1c-9576-21f5550461ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ba44ad45e84751b81349924c8afc34)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:28.372612 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cccc1-97dc-4d1c-9576-21f5550461ff admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:28.382679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f32a8a-e162-49cd-bc8a-a1f362f5d10b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:28.387686 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f4c35-08d6-431d-be79-b63db208bd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:28.388620 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f4c35-08d6-431d-be79-b63db208bd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.388898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f4c35-08d6-431d-be79-b63db208bd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.389555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f4c35-08d6-431d-be79-b63db208bd8e admin admin] PATH_INFO: `/v3/projects/adc249fcb6554ec1a34afdc1ee146e73` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.393811 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f4c35-08d6-431d-be79-b63db208bd8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc249fcb6554ec1a34afdc1ee146e73)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:28.395930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f4c35-08d6-431d-be79-b63db208bd8e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:28.429387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6c7cccc1-97dc-4d1c-9576-21f5550461ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ba44ad45e84751b81349924c8afc34'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.437350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6c7cccc1-97dc-4d1c-9576-21f5550461ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ba44ad45e84751b81349924c8afc34'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.445410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6c7cccc1-97dc-4d1c-9576-21f5550461ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ba44ad45e84751b81349924c8afc34'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.448061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9d9f4c35-08d6-431d-be79-b63db208bd8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc249fcb6554ec1a34afdc1ee146e73', 'request_id': 'req-9d9f4c35-08d6-431d-be79-b63db208bd8e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.455966 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9d9f4c35-08d6-431d-be79-b63db208bd8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc249fcb6554ec1a34afdc1ee146e73', 'request_id': 'req-9d9f4c35-08d6-431d-be79-b63db208bd8e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.458410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6c7cccc1-97dc-4d1c-9576-21f5550461ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ba44ad45e84751b81349924c8afc34'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.459089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6c7cccc1-97dc-4d1c-9576-21f5550461ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ba44ad45e84751b81349924c8afc34'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.462523 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9d9f4c35-08d6-431d-be79-b63db208bd8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc249fcb6554ec1a34afdc1ee146e73', 'request_id': 'req-9d9f4c35-08d6-431d-be79-b63db208bd8e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.465873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1087/2169] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:28 2022] DELETE /identity/v3/users/76ba44ad45e84751b81349924c8afc34 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:28.478726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9d9f4c35-08d6-431d-be79-b63db208bd8e admin admin] The token cache is being invalidate because project adc249fcb6554ec1a34afdc1ee146e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:28.479024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9d9f4c35-08d6-431d-be79-b63db208bd8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.479736 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9d9f4c35-08d6-431d-be79-b63db208bd8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.481426 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1083/2170] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:28 2022] DELETE /identity/v3/projects/adc249fcb6554ec1a34afdc1ee146e73 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:28.487767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc6d0-70d9-428c-8ee6-19c56eeed562 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.488051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc6d0-70d9-428c-8ee6-19c56eeed562 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.488407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc6d0-70d9-428c-8ee6-19c56eeed562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.511164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f71cc6d0-70d9-428c-8ee6-19c56eeed562 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:28.512688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f71cc6d0-70d9-428c-8ee6-19c56eeed562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:28.591195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1088/2171] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:28.599625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccc2de-e85e-447e-a4f7-f9573c70232e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.600038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccc2de-e85e-447e-a4f7-f9573c70232e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.600367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccc2de-e85e-447e-a4f7-f9573c70232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.631442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-44ccc2de-e85e-447e-a4f7-f9573c70232e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:28.633063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-44ccc2de-e85e-447e-a4f7-f9573c70232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:28.647441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1084/2172] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:28.651744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc6d0-70d9-428c-8ee6-19c56eeed562 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:28.658305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:28.664751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc6d0-70d9-428c-8ee6-19c56eeed562 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:28.672917 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf006f-ee8a-4df7-bc72-9bcbd5347fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:28.673499 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf006f-ee8a-4df7-bc72-9bcbd5347fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.674026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf006f-ee8a-4df7-bc72-9bcbd5347fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.674772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf006f-ee8a-4df7-bc72-9bcbd5347fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.675803 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf006f-ee8a-4df7-bc72-9bcbd5347fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:28.676390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf006f-ee8a-4df7-bc72-9bcbd5347fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:28.678582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf006f-ee8a-4df7-bc72-9bcbd5347fa5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:28.697364 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1089/2173] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:28.703431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccc2de-e85e-447e-a4f7-f9573c70232e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:28.717766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccc2de-e85e-447e-a4f7-f9573c70232e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:28.727657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519f900-adc0-4a4c-8a4e-f60ed988290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:28.729575 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519f900-adc0-4a4c-8a4e-f60ed988290e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.731453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519f900-adc0-4a4c-8a4e-f60ed988290e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.731453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519f900-adc0-4a4c-8a4e-f60ed988290e admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.731959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519f900-adc0-4a4c-8a4e-f60ed988290e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:28.734330 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519f900-adc0-4a4c-8a4e-f60ed988290e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:28.779653 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1085/2174] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:28 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:28:28.784161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf006f-ee8a-4df7-bc72-9bcbd5347fa5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:28.795061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf006f-ee8a-4df7-bc72-9bcbd5347fa5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:28.892573 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519f900-adc0-4a4c-8a4e-f60ed988290e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:28.894348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2519f900-adc0-4a4c-8a4e-f60ed988290e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:28.897791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fac3a8-abd9-4050-80d5-1e551457c4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:28.898690 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fac3a8-abd9-4050-80d5-1e551457c4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.899893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fac3a8-abd9-4050-80d5-1e551457c4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.900272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fac3a8-abd9-4050-80d5-1e551457c4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.901460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fac3a8-abd9-4050-80d5-1e551457c4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:28.903985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fac3a8-abd9-4050-80d5-1e551457c4c8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:28.915622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519f900-adc0-4a4c-8a4e-f60ed988290e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:28.924127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ab105-f8c4-4852-acfa-ad6d7860a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:28.925909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ab105-f8c4-4852-acfa-ad6d7860a013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.926326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ab105-f8c4-4852-acfa-ad6d7860a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.927030 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ab105-f8c4-4852-acfa-ad6d7860a013 admin admin] PATH_INFO: `/v3/projects/2af82d465687462db93f92ad25adc424` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.929045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ab105-f8c4-4852-acfa-ad6d7860a013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af82d465687462db93f92ad25adc424)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:28.931520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ab105-f8c4-4852-acfa-ad6d7860a013 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:28.940444 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1090/2175] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:28 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:28:28.944843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fac3a8-abd9-4050-80d5-1e551457c4c8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:28.955868 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fac3a8-abd9-4050-80d5-1e551457c4c8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:28.961184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e10c7-9398-48a0-8f97-e86c55c56b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:28.961870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e10c7-9398-48a0-8f97-e86c55c56b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:28.964754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e10c7-9398-48a0-8f97-e86c55c56b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:28.964754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e10c7-9398-48a0-8f97-e86c55c56b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:28.964754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e10c7-9398-48a0-8f97-e86c55c56b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:28.965621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e10c7-9398-48a0-8f97-e86c55c56b8c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:28.978996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1091/2176] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:28.982955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e10c7-9398-48a0-8f97-e86c55c56b8c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:28.993952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9b0ab105-f8c4-4852-acfa-ad6d7860a013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af82d465687462db93f92ad25adc424', 'request_id': 'req-9b0ab105-f8c4-4852-acfa-ad6d7860a013'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:28.996644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e10c7-9398-48a0-8f97-e86c55c56b8c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.003473 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9b0ab105-f8c4-4852-acfa-ad6d7860a013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af82d465687462db93f92ad25adc424', 'request_id': 'req-9b0ab105-f8c4-4852-acfa-ad6d7860a013'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:29.008728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:29.011379 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9b0ab105-f8c4-4852-acfa-ad6d7860a013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af82d465687462db93f92ad25adc424', 'request_id': 'req-9b0ab105-f8c4-4852-acfa-ad6d7860a013'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:29.045812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9b0ab105-f8c4-4852-acfa-ad6d7860a013 admin admin] The token cache is being invalidate because project 2af82d465687462db93f92ad25adc424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:29.046388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9b0ab105-f8c4-4852-acfa-ad6d7860a013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:29.047282 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9b0ab105-f8c4-4852-acfa-ad6d7860a013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:29.051188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1086/2177] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:28 2022] DELETE /identity/v3/projects/2af82d465687462db93f92ad25adc424 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:29.057071 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13854-f787-44d3-837a-8231fed75547 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.057412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13854-f787-44d3-837a-8231fed75547 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.057699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13854-f787-44d3-837a-8231fed75547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.074492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de374e78-585b-4402-a55d-277a6f437c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.075780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de374e78-585b-4402-a55d-277a6f437c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.076373 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de374e78-585b-4402-a55d-277a6f437c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.076842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de374e78-585b-4402-a55d-277a6f437c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.077824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de374e78-585b-4402-a55d-277a6f437c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.079639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de374e78-585b-4402-a55d-277a6f437c4d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.082664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6dc13854-f787-44d3-837a-8231fed75547 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:29.084112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6dc13854-f787-44d3-837a-8231fed75547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:29.095458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1092/2178] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:29.100097 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de374e78-585b-4402-a55d-277a6f437c4d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.102585 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-de374e78-585b-4402-a55d-277a6f437c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:29.107026 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1087/2179] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:29.115768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe576980-c8f3-4cc3-be53-b948ac6ad62f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.116184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe576980-c8f3-4cc3-be53-b948ac6ad62f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.116599 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe576980-c8f3-4cc3-be53-b948ac6ad62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.119814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de374e78-585b-4402-a55d-277a6f437c4d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.125424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757019b-1241-4d28-a4f3-c9df81e3fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.126128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757019b-1241-4d28-a4f3-c9df81e3fc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.126414 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757019b-1241-4d28-a4f3-c9df81e3fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.126686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757019b-1241-4d28-a4f3-c9df81e3fc9b admin admin] PATH_INFO: `/v3/projects/8f0b9ebcec034746a799b14d95f34a86/users/bbb14398e7d5430fb67f748ef7c997cf/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.144221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fe576980-c8f3-4cc3-be53-b948ac6ad62f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:29.148531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fe576980-c8f3-4cc3-be53-b948ac6ad62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:29.157322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1088/2180] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:29.160744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757019b-1241-4d28-a4f3-c9df81e3fc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0b9ebcec034746a799b14d95f34a86, user_id=bbb14398e7d5430fb67f748ef7c997cf, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.161667 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe576980-c8f3-4cc3-be53-b948ac6ad62f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.163683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757019b-1241-4d28-a4f3-c9df81e3fc9b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.172568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe576980-c8f3-4cc3-be53-b948ac6ad62f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.180465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa96d95-f4d6-439f-a946-2fe381165b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.181309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa96d95-f4d6-439f-a946-2fe381165b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.181687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa96d95-f4d6-439f-a946-2fe381165b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.182059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa96d95-f4d6-439f-a946-2fe381165b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.183211 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa96d95-f4d6-439f-a946-2fe381165b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:29.183623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa96d95-f4d6-439f-a946-2fe381165b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.185490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa96d95-f4d6-439f-a946-2fe381165b1f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.187604 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1093/2181] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:29 2022] PUT /identity/v3/projects/8f0b9ebcec034746a799b14d95f34a86/users/bbb14398e7d5430fb67f748ef7c997cf/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:29.202123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5a4a9-576e-4983-8a1f-fb522ff3fa84 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.202682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5a4a9-576e-4983-8a1f-fb522ff3fa84 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.203122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5a4a9-576e-4983-8a1f-fb522ff3fa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.208174 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1089/2182] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:28:29.212292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa96d95-f4d6-439f-a946-2fe381165b1f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.226533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa96d95-f4d6-439f-a946-2fe381165b1f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.234280 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-30e5a4a9-576e-4983-8a1f-fb522ff3fa84 None None] MFA Rules not processed for user `bbb14398e7d5430fb67f748ef7c997cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:29.235809 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-30e5a4a9-576e-4983-8a1f-fb522ff3fa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:29.280012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:29.311698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6220b6-11ba-47d5-b9df-4884fc838908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.312416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6220b6-11ba-47d5-b9df-4884fc838908 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.312733 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6220b6-11ba-47d5-b9df-4884fc838908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.313009 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6220b6-11ba-47d5-b9df-4884fc838908 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.313898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6220b6-11ba-47d5-b9df-4884fc838908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.316169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6220b6-11ba-47d5-b9df-4884fc838908 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.338800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1094/2183] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:29.340547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5a4a9-576e-4983-8a1f-fb522ff3fa84 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.354891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5a4a9-576e-4983-8a1f-fb522ff3fa84 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.355600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1090/2184] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:29 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:29.360617 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6220b6-11ba-47d5-b9df-4884fc838908 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.435493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5820f8b-b690-4864-9b62-d1080a673c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.436244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5820f8b-b690-4864-9b62-d1080a673c8f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.436657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5820f8b-b690-4864-9b62-d1080a673c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.436836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5820f8b-b690-4864-9b62-d1080a673c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.437558 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5820f8b-b690-4864-9b62-d1080a673c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.439838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5820f8b-b690-4864-9b62-d1080a673c8f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.450173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6220b6-11ba-47d5-b9df-4884fc838908 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.459171 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96619c-665d-40c4-834b-fc17be0d141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.460137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96619c-665d-40c4-834b-fc17be0d141d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.460542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96619c-665d-40c4-834b-fc17be0d141d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.461691 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96619c-665d-40c4-834b-fc17be0d141d admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.462807 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96619c-665d-40c4-834b-fc17be0d141d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.466526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96619c-665d-40c4-834b-fc17be0d141d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.485207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1095/2185] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:29 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:29.486655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5820f8b-b690-4864-9b62-d1080a673c8f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.505220 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1091/2186] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:29 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:29.510532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96619c-665d-40c4-834b-fc17be0d141d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.522729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96619c-665d-40c4-834b-fc17be0d141d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.567343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:29.605770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e680bc6-4894-4dd8-a3f0-7840dc3c55a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.606474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e680bc6-4894-4dd8-a3f0-7840dc3c55a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.606758 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e680bc6-4894-4dd8-a3f0-7840dc3c55a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.607171 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e680bc6-4894-4dd8-a3f0-7840dc3c55a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.608089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e680bc6-4894-4dd8-a3f0-7840dc3c55a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.610336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e680bc6-4894-4dd8-a3f0-7840dc3c55a3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.612514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5820f8b-b690-4864-9b62-d1080a673c8f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.619072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33408d-cbd5-48bf-9abe-99321826f696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.620332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33408d-cbd5-48bf-9abe-99321826f696 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.621904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33408d-cbd5-48bf-9abe-99321826f696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.622395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33408d-cbd5-48bf-9abe-99321826f696 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.629602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1092/2187] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:29.629802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33408d-cbd5-48bf-9abe-99321826f696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.629802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33408d-cbd5-48bf-9abe-99321826f696 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.630787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e680bc6-4894-4dd8-a3f0-7840dc3c55a3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.644037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e680bc6-4894-4dd8-a3f0-7840dc3c55a3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.650844 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995586-4340-41e4-8239-cf18615feb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.651816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995586-4340-41e4-8239-cf18615feb2f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.652169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995586-4340-41e4-8239-cf18615feb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.652567 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995586-4340-41e4-8239-cf18615feb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.653373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995586-4340-41e4-8239-cf18615feb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.655095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995586-4340-41e4-8239-cf18615feb2f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.656368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1096/2188] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:29 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:29.661087 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33408d-cbd5-48bf-9abe-99321826f696 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.672226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1093/2189] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:29.672922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33408d-cbd5-48bf-9abe-99321826f696 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.674396 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995586-4340-41e4-8239-cf18615feb2f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.678448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bea97-34af-4e4e-971c-46db070caa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.679140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bea97-34af-4e4e-971c-46db070caa91 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.679648 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bea97-34af-4e4e-971c-46db070caa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.679958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bea97-34af-4e4e-971c-46db070caa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.681351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bea97-34af-4e4e-971c-46db070caa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.683191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bea97-34af-4e4e-971c-46db070caa91 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.687056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995586-4340-41e4-8239-cf18615feb2f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.690154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75d89c-31fe-42a7-bd10-15ef4c00e0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.691048 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75d89c-31fe-42a7-bd10-15ef4c00e0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.691891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75d89c-31fe-42a7-bd10-15ef4c00e0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.691891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75d89c-31fe-42a7-bd10-15ef4c00e0f0 admin admin] PATH_INFO: `/v3/projects/181bd9acee804de3a3f94bfa95475f11/users/4de82dee34e343dbb05660d3a32b4e60/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.701146 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1097/2190] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:29.702292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bea97-34af-4e4e-971c-46db070caa91 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.709411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75d89c-31fe-42a7-bd10-15ef4c00e0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=181bd9acee804de3a3f94bfa95475f11, user_id=4de82dee34e343dbb05660d3a32b4e60, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.711615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75d89c-31fe-42a7-bd10-15ef4c00e0f0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.713687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bea97-34af-4e4e-971c-46db070caa91 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.719223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565fe88-0bb4-43b5-964c-f019d665d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.720264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565fe88-0bb4-43b5-964c-f019d665d775 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.720754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565fe88-0bb4-43b5-964c-f019d665d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.721122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565fe88-0bb4-43b5-964c-f019d665d775 admin admin] PATH_INFO: `/v3/projects/70f5a71942e249218b75f87318a3d723/users/61bdf84b955e49908433f22b9f69d0d8/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.735072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1094/2191] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:29 2022] PUT /identity/v3/projects/181bd9acee804de3a3f94bfa95475f11/users/4de82dee34e343dbb05660d3a32b4e60/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:29.750463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7bf1b-b6d5-4359-9773-a179c91772e7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.750831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7bf1b-b6d5-4359-9773-a179c91772e7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.751162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7bf1b-b6d5-4359-9773-a179c91772e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.756697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565fe88-0bb4-43b5-964c-f019d665d775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f5a71942e249218b75f87318a3d723, user_id=61bdf84b955e49908433f22b9f69d0d8, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.761933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565fe88-0bb4-43b5-964c-f019d665d775 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.781643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1098/2192] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:29 2022] PUT /identity/v3/projects/70f5a71942e249218b75f87318a3d723/users/61bdf84b955e49908433f22b9f69d0d8/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:29.786090 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565fe88-0bb4-43b5-964c-f019d665d775 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.795240 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3ca7bf1b-b6d5-4359-9773-a179c91772e7 None None] MFA Rules not processed for user `4de82dee34e343dbb05660d3a32b4e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:29.796484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3ca7bf1b-b6d5-4359-9773-a179c91772e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:29.797225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:29.860819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565fe88-0bb4-43b5-964c-f019d665d775 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.866419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3731c09-5936-4aa6-92fa-97d33e2fb1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.867111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3731c09-5936-4aa6-92fa-97d33e2fb1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.867409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3731c09-5936-4aa6-92fa-97d33e2fb1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.867687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3731c09-5936-4aa6-92fa-97d33e2fb1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.868429 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3731c09-5936-4aa6-92fa-97d33e2fb1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.870465 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3731c09-5936-4aa6-92fa-97d33e2fb1e2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.881376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1095/2193] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:29.881778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1099/2194] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:29.885780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7bf1b-b6d5-4359-9773-a179c91772e7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.887098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3731c09-5936-4aa6-92fa-97d33e2fb1e2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.901420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7bf1b-b6d5-4359-9773-a179c91772e7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.908265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3731c09-5936-4aa6-92fa-97d33e2fb1e2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:29.909834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e4e07-84a4-42e0-b0a6-5f8d3a2d3d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.910708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e4e07-84a4-42e0-b0a6-5f8d3a2d3d72 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.911211 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e4e07-84a4-42e0-b0a6-5f8d3a2d3d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.911653 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e4e07-84a4-42e0-b0a6-5f8d3a2d3d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.912453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e4e07-84a4-42e0-b0a6-5f8d3a2d3d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.914531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283a76d-034d-4ea5-af1f-1878793e91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:29.914864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e4e07-84a4-42e0-b0a6-5f8d3a2d3d72 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.915626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283a76d-034d-4ea5-af1f-1878793e91c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.915964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283a76d-034d-4ea5-af1f-1878793e91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.916320 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283a76d-034d-4ea5-af1f-1878793e91c6 admin admin] PATH_INFO: `/v3/projects/70f5a71942e249218b75f87318a3d723/users/61bdf84b955e49908433f22b9f69d0d8/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.918475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283a76d-034d-4ea5-af1f-1878793e91c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f5a71942e249218b75f87318a3d723, user_id=61bdf84b955e49908433f22b9f69d0d8, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:29.922124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283a76d-034d-4ea5-af1f-1878793e91c6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:29.937310 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1100/2195] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:29 2022] PUT /identity/v3/projects/70f5a71942e249218b75f87318a3d723/users/61bdf84b955e49908433f22b9f69d0d8/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:29.947194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1096/2196] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:29 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:29.948309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228f9a6-25e3-4d70-a5cd-ae2a80a8c36f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:29.948721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228f9a6-25e3-4d70-a5cd-ae2a80a8c36f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:29.949003 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228f9a6-25e3-4d70-a5cd-ae2a80a8c36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:29.951771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e4e07-84a4-42e0-b0a6-5f8d3a2d3d72 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:29.978435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a228f9a6-25e3-4d70-a5cd-ae2a80a8c36f None None] MFA Rules not processed for user `61bdf84b955e49908433f22b9f69d0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:29.979663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a228f9a6-25e3-4d70-a5cd-ae2a80a8c36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:30.019465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e4e07-84a4-42e0-b0a6-5f8d3a2d3d72 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:30.024290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1a52a-cb27-4deb-a505-82e57b1cbe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:30.025028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a52a-cb27-4deb-a505-82e57b1cbe4c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.025289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a52a-cb27-4deb-a505-82e57b1cbe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.025586 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a52a-cb27-4deb-a505-82e57b1cbe4c admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.026280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1a52a-cb27-4deb-a505-82e57b1cbe4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:30.028277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1a52a-cb27-4deb-a505-82e57b1cbe4c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:30.038388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:30.051701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1097/2197] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:29 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:28:30.055932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1101/2198] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:30.057163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1a52a-cb27-4deb-a505-82e57b1cbe4c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:30.063408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228f9a6-25e3-4d70-a5cd-ae2a80a8c36f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:30.064999 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a228f9a6-25e3-4d70-a5cd-ae2a80a8c36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:30.067464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1a52a-cb27-4deb-a505-82e57b1cbe4c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:30.072976 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c89e4-294c-45c8-90aa-8a53d9c343c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:30.073991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c89e4-294c-45c8-90aa-8a53d9c343c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.074305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c89e4-294c-45c8-90aa-8a53d9c343c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.074585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c89e4-294c-45c8-90aa-8a53d9c343c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.075319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c89e4-294c-45c8-90aa-8a53d9c343c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:30.076969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c89e4-294c-45c8-90aa-8a53d9c343c5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:30.087735 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1098/2199] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:30.091633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c89e4-294c-45c8-90aa-8a53d9c343c5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:30.101439 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c89e4-294c-45c8-90aa-8a53d9c343c5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:30.107034 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11ce05-971f-4e6d-8275-d286f457a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:30.107690 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ce05-971f-4e6d-8275-d286f457a600 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.107974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ce05-971f-4e6d-8275-d286f457a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.108347 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ce05-971f-4e6d-8275-d286f457a600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.109382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11ce05-971f-4e6d-8275-d286f457a600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:30.111088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11ce05-971f-4e6d-8275-d286f457a600 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:30.122898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1099/2200] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:30.127162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11ce05-971f-4e6d-8275-d286f457a600 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:30.132271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228f9a6-25e3-4d70-a5cd-ae2a80a8c36f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:30.136996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56381752-0b7f-4df7-a4bf-d59c6d40a10c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:30.137671 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56381752-0b7f-4df7-a4bf-d59c6d40a10c service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.137965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56381752-0b7f-4df7-a4bf-d59c6d40a10c service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.138077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11ce05-971f-4e6d-8275-d286f457a600 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:30.138310 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56381752-0b7f-4df7-a4bf-d59c6d40a10c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.144842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd28b4-e65a-445a-917f-b30167c18a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:30.145758 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd28b4-e65a-445a-917f-b30167c18a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.146036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd28b4-e65a-445a-917f-b30167c18a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.146316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd28b4-e65a-445a-917f-b30167c18a1d admin admin] PATH_INFO: `/v3/projects/b605ff59d8d64f1ea334cb4820ff7f42/users/355f913167cd4d1191e2e13b90bd5586/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.163282 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd28b4-e65a-445a-917f-b30167c18a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b605ff59d8d64f1ea334cb4820ff7f42, user_id=355f913167cd4d1191e2e13b90bd5586, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:30.167786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd28b4-e65a-445a-917f-b30167c18a1d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:30.179193 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:30.185505 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1100/2201] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:30 2022] PUT /identity/v3/projects/b605ff59d8d64f1ea334cb4820ff7f42/users/355f913167cd4d1191e2e13b90bd5586/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:30.197474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cadd21-e818-41a3-8877-f35ee13986da None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.197474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cadd21-e818-41a3-8877-f35ee13986da None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.197474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cadd21-e818-41a3-8877-f35ee13986da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.231779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c0cadd21-e818-41a3-8877-f35ee13986da None None] MFA Rules not processed for user `355f913167cd4d1191e2e13b90bd5586`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:30.233495 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c0cadd21-e818-41a3-8877-f35ee13986da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:30.238550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56381752-0b7f-4df7-a4bf-d59c6d40a10c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:30.240066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56381752-0b7f-4df7-a4bf-d59c6d40a10c service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:30.249881 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1102/2202] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:30.308638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1101/2203] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:30.320340 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56381752-0b7f-4df7-a4bf-d59c6d40a10c service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:30.326944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56381752-0b7f-4df7-a4bf-d59c6d40a10c service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:30.404272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea534ae6-3279-4d42-bac0-00d08db2324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:30.404992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea534ae6-3279-4d42-bac0-00d08db2324a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.405272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea534ae6-3279-4d42-bac0-00d08db2324a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.405549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea534ae6-3279-4d42-bac0-00d08db2324a admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.406325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea534ae6-3279-4d42-bac0-00d08db2324a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:30.408261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea534ae6-3279-4d42-bac0-00d08db2324a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:30.438620 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1103/2204] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:30 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:30.443325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cadd21-e818-41a3-8877-f35ee13986da None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:30.455855 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cadd21-e818-41a3-8877-f35ee13986da None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:30.552669 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb59e-99dc-4726-b879-c169ea0da5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:30.554005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb59e-99dc-4726-b879-c169ea0da5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.554524 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb59e-99dc-4726-b879-c169ea0da5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.555088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb59e-99dc-4726-b879-c169ea0da5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.556428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fb59e-99dc-4726-b879-c169ea0da5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:30.560237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fb59e-99dc-4726-b879-c169ea0da5c6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:30.605825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1102/2205] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:30 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:30.610364 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea534ae6-3279-4d42-bac0-00d08db2324a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:30.623641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea534ae6-3279-4d42-bac0-00d08db2324a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:30.629522 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc22706-43de-46c4-b294-5170b0ce36c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:30.630684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc22706-43de-46c4-b294-5170b0ce36c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.631046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc22706-43de-46c4-b294-5170b0ce36c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.631394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc22706-43de-46c4-b294-5170b0ce36c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.632218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc22706-43de-46c4-b294-5170b0ce36c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:30.634015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc22706-43de-46c4-b294-5170b0ce36c2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:30.649422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1104/2206] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:30.655319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb59e-99dc-4726-b879-c169ea0da5c6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:30.682335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb59e-99dc-4726-b879-c169ea0da5c6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:30.694025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53481050-bdea-4f55-ba5f-9389365c505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:30.695695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53481050-bdea-4f55-ba5f-9389365c505e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.695695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53481050-bdea-4f55-ba5f-9389365c505e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.695695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53481050-bdea-4f55-ba5f-9389365c505e admin admin] PATH_INFO: `/v3/projects/9de748691b504bad82b43893c7eaa921/users/5e056c10dc2a4e3c8111a5cbe49c4d64/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.737618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53481050-bdea-4f55-ba5f-9389365c505e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de748691b504bad82b43893c7eaa921, user_id=5e056c10dc2a4e3c8111a5cbe49c4d64, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:30.739896 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53481050-bdea-4f55-ba5f-9389365c505e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:30.766956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1103/2207] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:30 2022] PUT /identity/v3/projects/9de748691b504bad82b43893c7eaa921/users/5e056c10dc2a4e3c8111a5cbe49c4d64/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:30.772847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc22706-43de-46c4-b294-5170b0ce36c2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:30.788850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc22706-43de-46c4-b294-5170b0ce36c2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:30.865379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd082403-efd1-4d1a-b4f2-e96c36c19b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:30.866208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082403-efd1-4d1a-b4f2-e96c36c19b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.866556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082403-efd1-4d1a-b4f2-e96c36c19b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.866922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082403-efd1-4d1a-b4f2-e96c36c19b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.867704 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd082403-efd1-4d1a-b4f2-e96c36c19b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:30.869466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd082403-efd1-4d1a-b4f2-e96c36c19b94 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:30.880211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1105/2208] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:30.884677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53481050-bdea-4f55-ba5f-9389365c505e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:30.891797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:30.895715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53481050-bdea-4f55-ba5f-9389365c505e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:30.902231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738077c-764b-40da-98d3-07df7f9fbea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:30.903134 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738077c-764b-40da-98d3-07df7f9fbea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.903417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738077c-764b-40da-98d3-07df7f9fbea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.903692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738077c-764b-40da-98d3-07df7f9fbea2 admin admin] PATH_INFO: `/v3/projects/9de748691b504bad82b43893c7eaa921/users/5e056c10dc2a4e3c8111a5cbe49c4d64/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.905931 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738077c-764b-40da-98d3-07df7f9fbea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de748691b504bad82b43893c7eaa921, user_id=5e056c10dc2a4e3c8111a5cbe49c4d64, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:30.908777 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738077c-764b-40da-98d3-07df7f9fbea2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:30.921002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1104/2209] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:30 2022] PUT /identity/v3/projects/9de748691b504bad82b43893c7eaa921/users/5e056c10dc2a4e3c8111a5cbe49c4d64/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:30.932669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34622e8a-7309-4ccd-8d58-08aedf1d63a5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:30.933115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34622e8a-7309-4ccd-8d58-08aedf1d63a5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:30.933469 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34622e8a-7309-4ccd-8d58-08aedf1d63a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:30.966051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-34622e8a-7309-4ccd-8d58-08aedf1d63a5 None None] MFA Rules not processed for user `5e056c10dc2a4e3c8111a5cbe49c4d64`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:30.967299 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-34622e8a-7309-4ccd-8d58-08aedf1d63a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:31.002331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:31.046974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1106/2210] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:31.058958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738077c-764b-40da-98d3-07df7f9fbea2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:31.125007 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738077c-764b-40da-98d3-07df7f9fbea2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:31.128880 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fe7a2-a09f-4eb7-9554-9df1b7ebcdd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:31.129541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fe7a2-a09f-4eb7-9554-9df1b7ebcdd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:31.129815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fe7a2-a09f-4eb7-9554-9df1b7ebcdd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:31.130097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fe7a2-a09f-4eb7-9554-9df1b7ebcdd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:31.139921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fe7a2-a09f-4eb7-9554-9df1b7ebcdd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:31.141401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fe7a2-a09f-4eb7-9554-9df1b7ebcdd6 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:31.151679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1105/2211] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:31.196830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34622e8a-7309-4ccd-8d58-08aedf1d63a5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:31.210367 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34622e8a-7309-4ccd-8d58-08aedf1d63a5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:31.225713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7aa58-0877-479b-b4bd-2e7bf5d36223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:31.226542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7aa58-0877-479b-b4bd-2e7bf5d36223 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:31.226833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7aa58-0877-479b-b4bd-2e7bf5d36223 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:31.227111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7aa58-0877-479b-b4bd-2e7bf5d36223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:31.294083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7aa58-0877-479b-b4bd-2e7bf5d36223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:31.295610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7aa58-0877-479b-b4bd-2e7bf5d36223 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:31.310238 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1107/2212] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:33.026493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fe7a2-a09f-4eb7-9554-9df1b7ebcdd6 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:33.104312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fe7a2-a09f-4eb7-9554-9df1b7ebcdd6 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:33.112159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:33.113209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:33.113458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:33.113890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] PATH_INFO: `/v3/users/bbb14398e7d5430fb67f748ef7c997cf` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:33.115393 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb14398e7d5430fb67f748ef7c997cf)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:33.117528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:33.185404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb14398e7d5430fb67f748ef7c997cf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:33.193817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb14398e7d5430fb67f748ef7c997cf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:33.209491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb14398e7d5430fb67f748ef7c997cf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:33.210417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb14398e7d5430fb67f748ef7c997cf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:33.211132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb14398e7d5430fb67f748ef7c997cf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:33.230817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1106/2213] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:33 2022] DELETE /identity/v3/users/bbb14398e7d5430fb67f748ef7c997cf => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:33.235689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ce297-6e9b-484f-afbe-3463857f7d64 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:33.236191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ce297-6e9b-484f-afbe-3463857f7d64 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:33.236191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ce297-6e9b-484f-afbe-3463857f7d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:33.256051 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6d0ce297-6e9b-484f-afbe-3463857f7d64 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:33.257422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6d0ce297-6e9b-484f-afbe-3463857f7d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:33.329407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1108/2214] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:33.341154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:33.343458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:33.361667 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:33.410209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d18a1-b76b-4367-a93b-5c9d288131ea admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:33.413978 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b5d16-d6f3-4feb-bed8-4a813ec75c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:33.414641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b5d16-d6f3-4feb-bed8-4a813ec75c50 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:33.414919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b5d16-d6f3-4feb-bed8-4a813ec75c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:33.415197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b5d16-d6f3-4feb-bed8-4a813ec75c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:33.430037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b5d16-d6f3-4feb-bed8-4a813ec75c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:33.430593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b5d16-d6f3-4feb-bed8-4a813ec75c50 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:33.441433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1107/2215] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:33.752781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ce297-6e9b-484f-afbe-3463857f7d64 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:33.754449 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6d0ce297-6e9b-484f-afbe-3463857f7d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:33.770381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ce297-6e9b-484f-afbe-3463857f7d64 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:33.793408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:33.794323 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:33.794606 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:33.794880 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] PATH_INFO: `/v3/projects/8f0b9ebcec034746a799b14d95f34a86` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:33.797736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0b9ebcec034746a799b14d95f34a86)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:33.799853 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:33.875419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0b9ebcec034746a799b14d95f34a86', 'request_id': 'req-ac2c6528-400e-4574-82e0-6f971ac731ab'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:33.884038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0b9ebcec034746a799b14d95f34a86', 'request_id': 'req-ac2c6528-400e-4574-82e0-6f971ac731ab'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:33.893005 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:33.894584 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0b9ebcec034746a799b14d95f34a86', 'request_id': 'req-ac2c6528-400e-4574-82e0-6f971ac731ab'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:33.918070 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] The token cache is being invalidate because project 8f0b9ebcec034746a799b14d95f34a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:33.918557 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:33.919242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:33.921187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1109/2216] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:33 2022] DELETE /identity/v3/projects/8f0b9ebcec034746a799b14d95f34a86 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:33.925126 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b5d16-d6f3-4feb-bed8-4a813ec75c50 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:33.937470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b5d16-d6f3-4feb-bed8-4a813ec75c50 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:34.027047 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949582b4-8c4c-4323-8d98-333efdaed566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:34.028836 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949582b4-8c4c-4323-8d98-333efdaed566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:34.029097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949582b4-8c4c-4323-8d98-333efdaed566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:34.029387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949582b4-8c4c-4323-8d98-333efdaed566 admin admin] PATH_INFO: `/v3/users/61bdf84b955e49908433f22b9f69d0d8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:34.030757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949582b4-8c4c-4323-8d98-333efdaed566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61bdf84b955e49908433f22b9f69d0d8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:34.032875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949582b4-8c4c-4323-8d98-333efdaed566 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:34.118045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-949582b4-8c4c-4323-8d98-333efdaed566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61bdf84b955e49908433f22b9f69d0d8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.137422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-949582b4-8c4c-4323-8d98-333efdaed566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61bdf84b955e49908433f22b9f69d0d8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.152616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-949582b4-8c4c-4323-8d98-333efdaed566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61bdf84b955e49908433f22b9f69d0d8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.153410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-949582b4-8c4c-4323-8d98-333efdaed566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61bdf84b955e49908433f22b9f69d0d8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.157081 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-949582b4-8c4c-4323-8d98-333efdaed566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61bdf84b955e49908433f22b9f69d0d8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.177083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1108/2217] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:33 2022] DELETE /identity/v3/users/61bdf84b955e49908433f22b9f69d0d8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:34.275504 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:34.277040 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:34.293247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c6528-400e-4574-82e0-6f971ac731ab admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:34.380360 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:34.381303 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:34.381577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:34.381852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] PATH_INFO: `/v3/users/4de82dee34e343dbb05660d3a32b4e60` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:34.383068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de82dee34e343dbb05660d3a32b4e60)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:34.385066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:34.433542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de82dee34e343dbb05660d3a32b4e60'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.444745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de82dee34e343dbb05660d3a32b4e60'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.452464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de82dee34e343dbb05660d3a32b4e60'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.467167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de82dee34e343dbb05660d3a32b4e60'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.468167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de82dee34e343dbb05660d3a32b4e60'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.482993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1110/2218] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:34 2022] DELETE /identity/v3/users/4de82dee34e343dbb05660d3a32b4e60 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:34.487949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b796f5-123b-4560-a823-4c4e9d61e4f4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:34.488240 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b796f5-123b-4560-a823-4c4e9d61e4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:34.488572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b796f5-123b-4560-a823-4c4e9d61e4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:34.500521 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:34.503012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:34.507706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-77b796f5-123b-4560-a823-4c4e9d61e4f4 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:34.509015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-77b796f5-123b-4560-a823-4c4e9d61e4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:34.553661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:34.577211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073cc44-eaa5-45e8-b776-f5ce54ab4946 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:34.583521 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27de0c-8935-472c-a8b5-e8c55f8e8375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:34.584517 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27de0c-8935-472c-a8b5-e8c55f8e8375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:34.584811 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27de0c-8935-472c-a8b5-e8c55f8e8375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:34.585088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27de0c-8935-472c-a8b5-e8c55f8e8375 admin admin] PATH_INFO: `/v3/projects/70f5a71942e249218b75f87318a3d723` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:34.586297 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27de0c-8935-472c-a8b5-e8c55f8e8375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f5a71942e249218b75f87318a3d723)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:34.588072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1109/2219] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:34.588666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27de0c-8935-472c-a8b5-e8c55f8e8375 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:34.597798 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b796f5-123b-4560-a823-4c4e9d61e4f4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:34.599222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-77b796f5-123b-4560-a823-4c4e9d61e4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:34.602736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:34.647248 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9b27de0c-8935-472c-a8b5-e8c55f8e8375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f5a71942e249218b75f87318a3d723', 'request_id': 'req-9b27de0c-8935-472c-a8b5-e8c55f8e8375'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.654471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9b27de0c-8935-472c-a8b5-e8c55f8e8375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f5a71942e249218b75f87318a3d723', 'request_id': 'req-9b27de0c-8935-472c-a8b5-e8c55f8e8375'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.662351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9b27de0c-8935-472c-a8b5-e8c55f8e8375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f5a71942e249218b75f87318a3d723', 'request_id': 'req-9b27de0c-8935-472c-a8b5-e8c55f8e8375'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.663716 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b796f5-123b-4560-a823-4c4e9d61e4f4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:34.677143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9b27de0c-8935-472c-a8b5-e8c55f8e8375 admin admin] The token cache is being invalidate because project 70f5a71942e249218b75f87318a3d723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:34.677434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9b27de0c-8935-472c-a8b5-e8c55f8e8375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.678094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9b27de0c-8935-472c-a8b5-e8c55f8e8375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:34.679714 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1111/2220] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:34 2022] DELETE /identity/v3/projects/70f5a71942e249218b75f87318a3d723 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:34.684754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ea661-d481-437f-85b2-5a6d066cc863 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:34.685036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ea661-d481-437f-85b2-5a6d066cc863 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:34.685309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ea661-d481-437f-85b2-5a6d066cc863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:34.706436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3f6ea661-d481-437f-85b2-5a6d066cc863 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:34.707665 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3f6ea661-d481-437f-85b2-5a6d066cc863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:34.717636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c197-3542-4ceb-ba7c-cca35aa0035c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:34.718301 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c197-3542-4ceb-ba7c-cca35aa0035c service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:34.718582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c197-3542-4ceb-ba7c-cca35aa0035c service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:34.718839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c197-3542-4ceb-ba7c-cca35aa0035c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:34.720639 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-75d9c197-3542-4ceb-ba7c-cca35aa0035c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:34.770277 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1112/2221] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:34.778624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a8beb-c169-42a2-83b5-25e5e5693143 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:34.778980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a8beb-c169-42a2-83b5-25e5e5693143 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:34.779265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a8beb-c169-42a2-83b5-25e5e5693143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:34.789402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9c197-3542-4ceb-ba7c-cca35aa0035c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:34.790888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9c197-3542-4ceb-ba7c-cca35aa0035c service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:34.797957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f49a8beb-c169-42a2-83b5-25e5e5693143 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:34.799167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f49a8beb-c169-42a2-83b5-25e5e5693143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:34.801574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1110/2222] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:28:34.807588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1113/2223] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:34.811933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c197-3542-4ceb-ba7c-cca35aa0035c service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:34.821706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c197-3542-4ceb-ba7c-cca35aa0035c service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:34.826750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea5603-1fac-4580-b47f-cfa76f7efee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:34.827659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea5603-1fac-4580-b47f-cfa76f7efee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:34.828089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea5603-1fac-4580-b47f-cfa76f7efee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:34.828443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea5603-1fac-4580-b47f-cfa76f7efee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:34.829307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea5603-1fac-4580-b47f-cfa76f7efee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:34.829692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea5603-1fac-4580-b47f-cfa76f7efee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:34.831492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea5603-1fac-4580-b47f-cfa76f7efee9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:34.848088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1111/2224] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:34.849631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a8beb-c169-42a2-83b5-25e5e5693143 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:34.859798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a8beb-c169-42a2-83b5-25e5e5693143 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:34.864898 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496a9d9-bb15-42b3-9e6e-c31084b82d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:34.865706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496a9d9-bb15-42b3-9e6e-c31084b82d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:34.866093 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496a9d9-bb15-42b3-9e6e-c31084b82d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:34.866451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496a9d9-bb15-42b3-9e6e-c31084b82d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:34.867153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496a9d9-bb15-42b3-9e6e-c31084b82d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:34.869121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496a9d9-bb15-42b3-9e6e-c31084b82d74 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:34.905636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1114/2225] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:34 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:34.909747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea5603-1fac-4580-b47f-cfa76f7efee9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:34.931050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea5603-1fac-4580-b47f-cfa76f7efee9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:34.967000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:35.003530 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd01d4-439a-4bbf-9db1-7c452c7bc518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.004297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd01d4-439a-4bbf-9db1-7c452c7bc518 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.004683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd01d4-439a-4bbf-9db1-7c452c7bc518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.005060 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd01d4-439a-4bbf-9db1-7c452c7bc518 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.005924 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd01d4-439a-4bbf-9db1-7c452c7bc518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.007840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd01d4-439a-4bbf-9db1-7c452c7bc518 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.034093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1112/2226] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:34 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:35.038390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496a9d9-bb15-42b3-9e6e-c31084b82d74 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.053492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496a9d9-bb15-42b3-9e6e-c31084b82d74 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.059627 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa641f7-42c1-4689-a310-0321fecd973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.060329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa641f7-42c1-4689-a310-0321fecd973d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.060642 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa641f7-42c1-4689-a310-0321fecd973d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.060923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa641f7-42c1-4689-a310-0321fecd973d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.061678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa641f7-42c1-4689-a310-0321fecd973d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.063456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa641f7-42c1-4689-a310-0321fecd973d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.079211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1115/2227] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:35.080448 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd01d4-439a-4bbf-9db1-7c452c7bc518 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.095251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd01d4-439a-4bbf-9db1-7c452c7bc518 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.100525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886b1fa-4d6b-406e-b158-90473ac1834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.101558 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886b1fa-4d6b-406e-b158-90473ac1834d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.101993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886b1fa-4d6b-406e-b158-90473ac1834d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.102410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886b1fa-4d6b-406e-b158-90473ac1834d admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.103350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886b1fa-4d6b-406e-b158-90473ac1834d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.105020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886b1fa-4d6b-406e-b158-90473ac1834d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.116432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1113/2228] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:35.121133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa641f7-42c1-4689-a310-0321fecd973d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.134769 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa641f7-42c1-4689-a310-0321fecd973d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.141055 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605ca24-96b7-4547-b84f-0f97485f0bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.142321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605ca24-96b7-4547-b84f-0f97485f0bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.142946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605ca24-96b7-4547-b84f-0f97485f0bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.142946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605ca24-96b7-4547-b84f-0f97485f0bdc admin admin] PATH_INFO: `/v3/projects/3cefde28456b4b719b60bd3f2022e0f8/users/2aa8474961ff40d0b22eadc8d47f809a/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.156196 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886b1fa-4d6b-406e-b158-90473ac1834d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.159900 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2886b1fa-4d6b-406e-b158-90473ac1834d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:35.170672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605ca24-96b7-4547-b84f-0f97485f0bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cefde28456b4b719b60bd3f2022e0f8, user_id=2aa8474961ff40d0b22eadc8d47f809a, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.174740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605ca24-96b7-4547-b84f-0f97485f0bdc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.180006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886b1fa-4d6b-406e-b158-90473ac1834d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.207423 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.208340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.208675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.208955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] PATH_INFO: `/v3/projects/181bd9acee804de3a3f94bfa95475f11` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.210386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=181bd9acee804de3a3f94bfa95475f11)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.220026 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.220184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1116/2229] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:35 2022] PUT /identity/v3/projects/3cefde28456b4b719b60bd3f2022e0f8/users/2aa8474961ff40d0b22eadc8d47f809a/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:35.223691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25904ca-10d0-4e55-b336-8da103c4e5c3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.227711 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25904ca-10d0-4e55-b336-8da103c4e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.228125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25904ca-10d0-4e55-b336-8da103c4e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.259589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c25904ca-10d0-4e55-b336-8da103c4e5c3 None None] MFA Rules not processed for user `2aa8474961ff40d0b22eadc8d47f809a`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:35.261314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c25904ca-10d0-4e55-b336-8da103c4e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:35.284918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181bd9acee804de3a3f94bfa95475f11', 'request_id': 'req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:35.289833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:35.295148 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181bd9acee804de3a3f94bfa95475f11', 'request_id': 'req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:35.311231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181bd9acee804de3a3f94bfa95475f11', 'request_id': 'req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:35.331938 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] The token cache is being invalidate because project 181bd9acee804de3a3f94bfa95475f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:35.332227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:35.333219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:35.334826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1114/2230] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:35 2022] DELETE /identity/v3/projects/181bd9acee804de3a3f94bfa95475f11 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:35.336827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1117/2231] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:35.339077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.342133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25904ca-10d0-4e55-b336-8da103c4e5c3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.342312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:35.431697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361c881-44aa-4f57-9e1f-0eb5a5cc6952 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.431832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25904ca-10d0-4e55-b336-8da103c4e5c3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.433763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.434467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ea32-cfcd-4589-8ab9-82d2a752c406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.435178 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.435582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.435737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ea32-cfcd-4589-8ab9-82d2a752c406 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.436021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ea32-cfcd-4589-8ab9-82d2a752c406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.436295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ea32-cfcd-4589-8ab9-82d2a752c406 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.436992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] PATH_INFO: `/v3/users/355f913167cd4d1191e2e13b90bd5586` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.437147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6ea32-cfcd-4589-8ab9-82d2a752c406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.438864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] RBAC: Authorizing `identity:delete_user(user_id=355f913167cd4d1191e2e13b90bd5586)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.439091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6ea32-cfcd-4589-8ab9-82d2a752c406 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.440997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.472391 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1118/2232] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:35 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:28:35.477432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ea32-cfcd-4589-8ab9-82d2a752c406 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.480286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-66d6ea32-cfcd-4589-8ab9-82d2a752c406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:35.492273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:35.509074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '355f913167cd4d1191e2e13b90bd5586'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:35.523220 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '355f913167cd4d1191e2e13b90bd5586'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:35.546279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '355f913167cd4d1191e2e13b90bd5586'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:35.547258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '355f913167cd4d1191e2e13b90bd5586'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:35.548170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '355f913167cd4d1191e2e13b90bd5586'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:35.568036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1115/2233] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:35 2022] DELETE /identity/v3/users/355f913167cd4d1191e2e13b90bd5586 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:35.594490 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ea32-cfcd-4589-8ab9-82d2a752c406 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.655320 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:35.662128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98f933-69aa-4411-a8b3-35e11d24d5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.662773 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98f933-69aa-4411-a8b3-35e11d24d5cb admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.663467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98f933-69aa-4411-a8b3-35e11d24d5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.663635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98f933-69aa-4411-a8b3-35e11d24d5cb admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.664612 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98f933-69aa-4411-a8b3-35e11d24d5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.666962 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98f933-69aa-4411-a8b3-35e11d24d5cb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.688778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1119/2234] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:35 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:35.693294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.694863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:35.710420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b652281-98d2-4dfb-bf08-88a84bb3271a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.715716 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93046a20-bba0-4641-96ac-2fb7d309e417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.716340 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93046a20-bba0-4641-96ac-2fb7d309e417 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.716699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93046a20-bba0-4641-96ac-2fb7d309e417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.716941 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93046a20-bba0-4641-96ac-2fb7d309e417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.721239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93046a20-bba0-4641-96ac-2fb7d309e417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.721239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93046a20-bba0-4641-96ac-2fb7d309e417 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.732919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1116/2235] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:35.737001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98f933-69aa-4411-a8b3-35e11d24d5cb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.748064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98f933-69aa-4411-a8b3-35e11d24d5cb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.752835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3cd05-3a40-428f-abdd-7f6ec0168e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.753610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3cd05-3a40-428f-abdd-7f6ec0168e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.753894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3cd05-3a40-428f-abdd-7f6ec0168e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.754171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3cd05-3a40-428f-abdd-7f6ec0168e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.754915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3cd05-3a40-428f-abdd-7f6ec0168e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.756663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3cd05-3a40-428f-abdd-7f6ec0168e78 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.767619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1120/2236] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:35.772523 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93046a20-bba0-4641-96ac-2fb7d309e417 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.782886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93046a20-bba0-4641-96ac-2fb7d309e417 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.787726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd6fa6-6178-4f3c-bb0d-1c6dceae05ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.788656 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd6fa6-6178-4f3c-bb0d-1c6dceae05ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.788922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd6fa6-6178-4f3c-bb0d-1c6dceae05ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.789187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd6fa6-6178-4f3c-bb0d-1c6dceae05ca admin admin] PATH_INFO: `/v3/projects/5294f064f9a54b449fe3138322cd3bbf/users/2b3d6260893640c0a8292c01d39a9f16/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.805693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd6fa6-6178-4f3c-bb0d-1c6dceae05ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5294f064f9a54b449fe3138322cd3bbf, user_id=2b3d6260893640c0a8292c01d39a9f16, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.808426 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd6fa6-6178-4f3c-bb0d-1c6dceae05ca admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.823670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1117/2237] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:35 2022] PUT /identity/v3/projects/5294f064f9a54b449fe3138322cd3bbf/users/2b3d6260893640c0a8292c01d39a9f16/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:35.835147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113d17f-162b-443e-9967-98a8bdc2e045 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.835500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113d17f-162b-443e-9967-98a8bdc2e045 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.835786 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113d17f-162b-443e-9967-98a8bdc2e045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.855429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd6fa6-6178-4f3c-bb0d-1c6dceae05ca admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.857465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ebbd6fa6-6178-4f3c-bb0d-1c6dceae05ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:35.869001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1113d17f-162b-443e-9967-98a8bdc2e045 None None] MFA Rules not processed for user `2b3d6260893640c0a8292c01d39a9f16`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:35.870390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1113d17f-162b-443e-9967-98a8bdc2e045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:35.940681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd6fa6-6178-4f3c-bb0d-1c6dceae05ca admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.945200 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1121/2238] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:35.946157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.947464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.947615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.947790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] PATH_INFO: `/v3/projects/b605ff59d8d64f1ea334cb4820ff7f42` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.949108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b605ff59d8d64f1ea334cb4820ff7f42)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.949737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113d17f-162b-443e-9967-98a8bdc2e045 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:35.951159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.961429 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113d17f-162b-443e-9967-98a8bdc2e045 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:35.966253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6e16a-5f9d-4b52-b8f9-a8671a245131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:35.967091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6e16a-5f9d-4b52-b8f9-a8671a245131 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:35.967378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6e16a-5f9d-4b52-b8f9-a8671a245131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:35.967647 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6e16a-5f9d-4b52-b8f9-a8671a245131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:35.968347 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6e16a-5f9d-4b52-b8f9-a8671a245131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:35.970287 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6e16a-5f9d-4b52-b8f9-a8671a245131 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:35.998748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1122/2239] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:35 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:28:36.002606 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6e16a-5f9d-4b52-b8f9-a8671a245131 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:36.006253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b605ff59d8d64f1ea334cb4820ff7f42', 'request_id': 'req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:36.015354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b605ff59d8d64f1ea334cb4820ff7f42', 'request_id': 'req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:36.022093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b605ff59d8d64f1ea334cb4820ff7f42', 'request_id': 'req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:36.033649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] The token cache is being invalidate because project b605ff59d8d64f1ea334cb4820ff7f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:36.033930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:36.034614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:36.036185 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1118/2240] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:35 2022] DELETE /identity/v3/projects/b605ff59d8d64f1ea334cb4820ff7f42 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:36.040019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:36.041527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:36.047784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:36.071396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6e16a-5f9d-4b52-b8f9-a8671a245131 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:36.076568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2348f6-6bb5-4cb4-bd7b-72b3774859b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:36.077263 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2348f6-6bb5-4cb4-bd7b-72b3774859b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:36.077543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2348f6-6bb5-4cb4-bd7b-72b3774859b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:36.077818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2348f6-6bb5-4cb4-bd7b-72b3774859b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:36.078523 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2348f6-6bb5-4cb4-bd7b-72b3774859b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:36.080486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2348f6-6bb5-4cb4-bd7b-72b3774859b5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:36.102330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1123/2241] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:36 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:28:36.106340 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2348f6-6bb5-4cb4-bd7b-72b3774859b5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:36.108015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-be2348f6-6bb5-4cb4-bd7b-72b3774859b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:36.111366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0c7e3-b27c-41fd-a124-421b8cb98bbf admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:36.116061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:36.117045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:36.117357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:36.117642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] PATH_INFO: `/v3/users/5e056c10dc2a4e3c8111a5cbe49c4d64` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:36.118872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e056c10dc2a4e3c8111a5cbe49c4d64)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:36.120865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:36.121740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2348f6-6bb5-4cb4-bd7b-72b3774859b5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:36.128722 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133ea30-7d6b-439e-8b46-5f12e46c1ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:36.129625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133ea30-7d6b-439e-8b46-5f12e46c1ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:36.129988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133ea30-7d6b-439e-8b46-5f12e46c1ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:36.130447 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133ea30-7d6b-439e-8b46-5f12e46c1ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:36.131312 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133ea30-7d6b-439e-8b46-5f12e46c1ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:36.133473 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133ea30-7d6b-439e-8b46-5f12e46c1ee2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:36.147433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1124/2242] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:36.152812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133ea30-7d6b-439e-8b46-5f12e46c1ee2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:36.163609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133ea30-7d6b-439e-8b46-5f12e46c1ee2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:36.168645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95537ef-259a-4434-bae7-95eb8d1213ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:36.169781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95537ef-259a-4434-bae7-95eb8d1213ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:36.170064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95537ef-259a-4434-bae7-95eb8d1213ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:36.170338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95537ef-259a-4434-bae7-95eb8d1213ae admin admin] PATH_INFO: `/v3/projects/58cfdc17aeb9432086fac438fabb7eda/users/7c73cf014e4c46d6a9880b4d8817b08f/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:36.171346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e056c10dc2a4e3c8111a5cbe49c4d64'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:36.178648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e056c10dc2a4e3c8111a5cbe49c4d64'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:36.186197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95537ef-259a-4434-bae7-95eb8d1213ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cfdc17aeb9432086fac438fabb7eda, user_id=7c73cf014e4c46d6a9880b4d8817b08f, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:36.188948 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95537ef-259a-4434-bae7-95eb8d1213ae admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:36.195417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e056c10dc2a4e3c8111a5cbe49c4d64'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:36.196226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e056c10dc2a4e3c8111a5cbe49c4d64'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:36.196901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e056c10dc2a4e3c8111a5cbe49c4d64'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:36.198955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:36.207884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1125/2243] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:36 2022] PUT /identity/v3/projects/58cfdc17aeb9432086fac438fabb7eda/users/7c73cf014e4c46d6a9880b4d8817b08f/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:36.212462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95537ef-259a-4434-bae7-95eb8d1213ae admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:36.215183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b95537ef-259a-4434-bae7-95eb8d1213ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:36.217572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1119/2244] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:36 2022] DELETE /identity/v3/users/5e056c10dc2a4e3c8111a5cbe49c4d64 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:36.305289 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95537ef-259a-4434-bae7-95eb8d1213ae admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:36.381203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7536f8-3e3e-417b-93f1-d36f926aee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:36.381910 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7536f8-3e3e-417b-93f1-d36f926aee3d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:36.382254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7536f8-3e3e-417b-93f1-d36f926aee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:36.382532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7536f8-3e3e-417b-93f1-d36f926aee3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:36.383305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7536f8-3e3e-417b-93f1-d36f926aee3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:36.385489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7536f8-3e3e-417b-93f1-d36f926aee3d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:36.397757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1126/2245] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:36.401826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:36.412734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a4cf6-6c5a-4907-aede-397920a337e7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:36.417648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7bc70-9849-4fc4-98d1-272791258260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:36.418729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7bc70-9849-4fc4-98d1-272791258260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:36.419079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7bc70-9849-4fc4-98d1-272791258260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:36.419355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7bc70-9849-4fc4-98d1-272791258260 admin admin] PATH_INFO: `/v3/projects/58cfdc17aeb9432086fac438fabb7eda/users/7c73cf014e4c46d6a9880b4d8817b08f/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:36.421706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7bc70-9849-4fc4-98d1-272791258260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cfdc17aeb9432086fac438fabb7eda, user_id=7c73cf014e4c46d6a9880b4d8817b08f, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:36.424824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7bc70-9849-4fc4-98d1-272791258260 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:36.441549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1120/2246] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:36 2022] PUT /identity/v3/projects/58cfdc17aeb9432086fac438fabb7eda/users/7c73cf014e4c46d6a9880b4d8817b08f/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:36.453279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ea207-2f48-4a76-8b47-fcfcfe77d6cf None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:36.453494 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ea207-2f48-4a76-8b47-fcfcfe77d6cf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:36.453774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ea207-2f48-4a76-8b47-fcfcfe77d6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:36.486468 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-384ea207-2f48-4a76-8b47-fcfcfe77d6cf None None] MFA Rules not processed for user `7c73cf014e4c46d6a9880b4d8817b08f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:36.488009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-384ea207-2f48-4a76-8b47-fcfcfe77d6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:36.607862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1127/2247] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:36.641363 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7bc70-9849-4fc4-98d1-272791258260 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:36.645276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-aac7bc70-9849-4fc4-98d1-272791258260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:36.759398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7bc70-9849-4fc4-98d1-272791258260 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:36.763885 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09569061-3cd0-4794-bd19-d64bdd7f2057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:36.764972 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09569061-3cd0-4794-bd19-d64bdd7f2057 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:36.765255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09569061-3cd0-4794-bd19-d64bdd7f2057 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:36.765534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09569061-3cd0-4794-bd19-d64bdd7f2057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:36.767619 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-09569061-3cd0-4794-bd19-d64bdd7f2057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:36.798326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:36.838204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09569061-3cd0-4794-bd19-d64bdd7f2057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:36.839677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09569061-3cd0-4794-bd19-d64bdd7f2057 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:36.852238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1121/2248] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:37.105413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ea207-2f48-4a76-8b47-fcfcfe77d6cf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:37.107721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-384ea207-2f48-4a76-8b47-fcfcfe77d6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:37.184189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:37.233477 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ea207-2f48-4a76-8b47-fcfcfe77d6cf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:37.239220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:37.240123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:37.240402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:37.240775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b admin admin] PATH_INFO: `/v3/projects/9de748691b504bad82b43893c7eaa921` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:37.241985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de748691b504bad82b43893c7eaa921)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:37.244263 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:37.314189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de748691b504bad82b43893c7eaa921', 'request_id': 'req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:37.325983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de748691b504bad82b43893c7eaa921', 'request_id': 'req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:37.338620 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de748691b504bad82b43893c7eaa921', 'request_id': 'req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:37.358370 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b admin admin] The token cache is being invalidate because project 9de748691b504bad82b43893c7eaa921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:37.359001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:37.361005 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4322e87d-1a4c-440e-8127-7ad1f9d3fd8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:37.363007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1128/2249] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:37 2022] DELETE /identity/v3/projects/9de748691b504bad82b43893c7eaa921 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:37.369204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd383bbd-6a76-48bd-9c5b-7c849ac9b2e3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:37.369698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd383bbd-6a76-48bd-9c5b-7c849ac9b2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:37.369800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd383bbd-6a76-48bd-9c5b-7c849ac9b2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:37.388060 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dd383bbd-6a76-48bd-9c5b-7c849ac9b2e3 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:37.390866 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dd383bbd-6a76-48bd-9c5b-7c849ac9b2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:37.478036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1122/2250] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:37.479850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0003c-80ce-48f8-99e5-564fd3630961 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:37.480141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0003c-80ce-48f8-99e5-564fd3630961 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:37.480387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0003c-80ce-48f8-99e5-564fd3630961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:37.504738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-40d0003c-80ce-48f8-99e5-564fd3630961 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:37.505967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-40d0003c-80ce-48f8-99e5-564fd3630961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:37.514647 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1129/2251] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:37.519155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd383bbd-6a76-48bd-9c5b-7c849ac9b2e3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:37.529543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd383bbd-6a76-48bd-9c5b-7c849ac9b2e3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:37.534952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372f07f-cd3e-4d3b-8bbf-3a8dcc3fcbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:37.535634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372f07f-cd3e-4d3b-8bbf-3a8dcc3fcbef admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:37.535918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372f07f-cd3e-4d3b-8bbf-3a8dcc3fcbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:37.536196 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372f07f-cd3e-4d3b-8bbf-3a8dcc3fcbef admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:37.536983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372f07f-cd3e-4d3b-8bbf-3a8dcc3fcbef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:37.537290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372f07f-cd3e-4d3b-8bbf-3a8dcc3fcbef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:37.538932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372f07f-cd3e-4d3b-8bbf-3a8dcc3fcbef admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:37.551886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1123/2252] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:37.556683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0003c-80ce-48f8-99e5-564fd3630961 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:37.569347 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0003c-80ce-48f8-99e5-564fd3630961 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:37.574523 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8e2f5-9d76-4c5d-89d1-89329e9ca0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:37.575188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8e2f5-9d76-4c5d-89d1-89329e9ca0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:37.575510 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8e2f5-9d76-4c5d-89d1-89329e9ca0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:37.575784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8e2f5-9d76-4c5d-89d1-89329e9ca0d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:37.576484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8e2f5-9d76-4c5d-89d1-89329e9ca0d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:37.578492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8e2f5-9d76-4c5d-89d1-89329e9ca0d5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:37.606261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1130/2253] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:37 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:37.611280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372f07f-cd3e-4d3b-8bbf-3a8dcc3fcbef admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:37.622593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372f07f-cd3e-4d3b-8bbf-3a8dcc3fcbef admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:37.691224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b2cd-f6bb-4d04-a646-73f25396b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:37.691910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b2cd-f6bb-4d04-a646-73f25396b2ef admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:37.692222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b2cd-f6bb-4d04-a646-73f25396b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:37.692521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b2cd-f6bb-4d04-a646-73f25396b2ef admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:37.693241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956b2cd-f6bb-4d04-a646-73f25396b2ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:37.695176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956b2cd-f6bb-4d04-a646-73f25396b2ef admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:37.715323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1124/2254] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:37 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:37.719631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8e2f5-9d76-4c5d-89d1-89329e9ca0d5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:37.731001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8e2f5-9d76-4c5d-89d1-89329e9ca0d5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:37.737193 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bc978-7ad6-472b-8840-0a51c2527074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:37.739397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bc978-7ad6-472b-8840-0a51c2527074 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:37.739397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bc978-7ad6-472b-8840-0a51c2527074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:37.739397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bc978-7ad6-472b-8840-0a51c2527074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:37.739754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bc978-7ad6-472b-8840-0a51c2527074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:37.741410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bc978-7ad6-472b-8840-0a51c2527074 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:37.758080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1131/2255] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:37.762592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b2cd-f6bb-4d04-a646-73f25396b2ef admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:37.773936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b2cd-f6bb-4d04-a646-73f25396b2ef admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:37.779138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b61db-fdd0-47eb-b17c-52eb5c6f8fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:37.779695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b61db-fdd0-47eb-b17c-52eb5c6f8fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:37.779980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b61db-fdd0-47eb-b17c-52eb5c6f8fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:37.780310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b61db-fdd0-47eb-b17c-52eb5c6f8fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:37.781100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b61db-fdd0-47eb-b17c-52eb5c6f8fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:37.782751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b61db-fdd0-47eb-b17c-52eb5c6f8fdd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:37.795049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1125/2256] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:37.799566 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bc978-7ad6-472b-8840-0a51c2527074 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:37.815788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bc978-7ad6-472b-8840-0a51c2527074 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:37.825983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf6825-b2b0-4062-9b32-01ba4005fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:37.827158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6825-b2b0-4062-9b32-01ba4005fec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:37.827505 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6825-b2b0-4062-9b32-01ba4005fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:37.827845 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6825-b2b0-4062-9b32-01ba4005fec9 admin admin] PATH_INFO: `/v3/projects/a151847750d14a3eaeb4bc84995832db/users/90ebeb777931402184d9471f86e111ca/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:37.853390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf6825-b2b0-4062-9b32-01ba4005fec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a151847750d14a3eaeb4bc84995832db, user_id=90ebeb777931402184d9471f86e111ca, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:37.856413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf6825-b2b0-4062-9b32-01ba4005fec9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:37.906288 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b61db-fdd0-47eb-b17c-52eb5c6f8fdd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:37.906422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1132/2257] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:37 2022] PUT /identity/v3/projects/a151847750d14a3eaeb4bc84995832db/users/90ebeb777931402184d9471f86e111ca/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:37.908660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8d2b61db-fdd0-47eb-b17c-52eb5c6f8fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:37.908981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1d1a1-1d0f-4234-906d-4d130691159d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:37.909427 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1d1a1-1d0f-4234-906d-4d130691159d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:37.909994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1d1a1-1d0f-4234-906d-4d130691159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:37.937184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b61db-fdd0-47eb-b17c-52eb5c6f8fdd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:37.951965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-73b1d1a1-1d0f-4234-906d-4d130691159d None None] MFA Rules not processed for user `90ebeb777931402184d9471f86e111ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:37.953441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-73b1d1a1-1d0f-4234-906d-4d130691159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:38.011317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:38.026676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:38.067442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1133/2258] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:38.081110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:38.082365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:38.082707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:38.082988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] PATH_INFO: `/v3/users/5634691faf874333986a446c24e0ed0d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:38.084572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5634691faf874333986a446c24e0ed0d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:38.086599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1d1a1-1d0f-4234-906d-4d130691159d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:38.088724 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-73b1d1a1-1d0f-4234-906d-4d130691159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:38.091593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:38.149574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5634691faf874333986a446c24e0ed0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:38.157673 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5634691faf874333986a446c24e0ed0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:38.158134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1d1a1-1d0f-4234-906d-4d130691159d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:38.162215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4f325-5e90-4fe4-b9a5-8363b184d65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:38.162846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4f325-5e90-4fe4-b9a5-8363b184d65e service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:38.163195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4f325-5e90-4fe4-b9a5-8363b184d65e service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:38.163536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4f325-5e90-4fe4-b9a5-8363b184d65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:38.172794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4f325-5e90-4fe4-b9a5-8363b184d65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:38.173020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5634691faf874333986a446c24e0ed0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:38.173534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5634691faf874333986a446c24e0ed0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:38.174137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5634691faf874333986a446c24e0ed0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:38.174255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4f325-5e90-4fe4-b9a5-8363b184d65e service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:38.184751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1134/2259] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:28:38.188377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1126/2260] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:37 2022] DELETE /identity/v3/users/5634691faf874333986a446c24e0ed0d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:38.193259 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355abeb3-eb96-4dea-a19d-d745c8d8407f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:38.193557 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355abeb3-eb96-4dea-a19d-d745c8d8407f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:38.193835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355abeb3-eb96-4dea-a19d-d745c8d8407f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:38.212095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-355abeb3-eb96-4dea-a19d-d745c8d8407f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:38.213414 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-355abeb3-eb96-4dea-a19d-d745c8d8407f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:38.280096 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1135/2261] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:38.290525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:38.292184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:38.372993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170f951-5cff-403b-a9db-fb932baeec5d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:38.377037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775d05b-afd7-4b5d-94b1-5e706d788cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:38.377708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775d05b-afd7-4b5d-94b1-5e706d788cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:38.378051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775d05b-afd7-4b5d-94b1-5e706d788cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:38.378305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775d05b-afd7-4b5d-94b1-5e706d788cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:38.391386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775d05b-afd7-4b5d-94b1-5e706d788cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:38.394730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775d05b-afd7-4b5d-94b1-5e706d788cb9 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:38.406233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1127/2262] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:38.480279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355abeb3-eb96-4dea-a19d-d745c8d8407f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:38.481945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-355abeb3-eb96-4dea-a19d-d745c8d8407f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:38.578290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355abeb3-eb96-4dea-a19d-d745c8d8407f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:38.582359 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38cc84-6555-49d6-b580-1be4e8d6f8ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:38.583031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38cc84-6555-49d6-b580-1be4e8d6f8ac service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:38.583305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38cc84-6555-49d6-b580-1be4e8d6f8ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:38.583599 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38cc84-6555-49d6-b580-1be4e8d6f8ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:38.591251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6a38cc84-6555-49d6-b580-1be4e8d6f8ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:38.701184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:38.732091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38cc84-6555-49d6-b580-1be4e8d6f8ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:38.734731 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38cc84-6555-49d6-b580-1be4e8d6f8ac service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:38.752609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1136/2263] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:38.817852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775d05b-afd7-4b5d-94b1-5e706d788cb9 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:38.819829 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3775d05b-afd7-4b5d-94b1-5e706d788cb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:38.836185 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775d05b-afd7-4b5d-94b1-5e706d788cb9 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:38.843079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:38.844135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:38.844415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:38.844930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa admin admin] PATH_INFO: `/v3/projects/ddbc4d5bf668410c9a6d208c084e6cbc` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:38.849654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddbc4d5bf668410c9a6d208c084e6cbc)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:38.849654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:38.928987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:38.930888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddbc4d5bf668410c9a6d208c084e6cbc', 'request_id': 'req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:38.942183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddbc4d5bf668410c9a6d208c084e6cbc', 'request_id': 'req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:38.948801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddbc4d5bf668410c9a6d208c084e6cbc', 'request_id': 'req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:38.963977 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa admin admin] The token cache is being invalidate because project ddbc4d5bf668410c9a6d208c084e6cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:38.964269 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:38.965030 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b5eb0b4c-baa9-488d-8e40-8d9692cb59fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:38.966655 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1128/2264] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:38 2022] DELETE /identity/v3/projects/ddbc4d5bf668410c9a6d208c084e6cbc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:38.972069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f80416-b776-4be8-85f5-554aeea45f84 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:38.972358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f80416-b776-4be8-85f5-554aeea45f84 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:38.972670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f80416-b776-4be8-85f5-554aeea45f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:38.992450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d7f80416-b776-4be8-85f5-554aeea45f84 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:38.993696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d7f80416-b776-4be8-85f5-554aeea45f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:39.063589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1137/2265] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:39.071551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944ceca-f623-4104-bdb4-fed3b3e260a6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.071839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944ceca-f623-4104-bdb4-fed3b3e260a6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.072120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944ceca-f623-4104-bdb4-fed3b3e260a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.099934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6944ceca-f623-4104-bdb4-fed3b3e260a6 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:39.101743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6944ceca-f623-4104-bdb4-fed3b3e260a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:39.115061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1129/2266] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:39.120115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f80416-b776-4be8-85f5-554aeea45f84 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:39.134294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f80416-b776-4be8-85f5-554aeea45f84 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:39.146415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455584a-0995-4639-8180-46f8b51aa50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:39.147530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455584a-0995-4639-8180-46f8b51aa50c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.148054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455584a-0995-4639-8180-46f8b51aa50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.148376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455584a-0995-4639-8180-46f8b51aa50c admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.149520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455584a-0995-4639-8180-46f8b51aa50c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:39.149899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455584a-0995-4639-8180-46f8b51aa50c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:39.152239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455584a-0995-4639-8180-46f8b51aa50c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:39.171864 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1138/2267] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:39.176154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944ceca-f623-4104-bdb4-fed3b3e260a6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:39.186539 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944ceca-f623-4104-bdb4-fed3b3e260a6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:39.193336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06ca8b-fd1f-4b4d-9093-62ad51905673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:39.194234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06ca8b-fd1f-4b4d-9093-62ad51905673 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.194708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06ca8b-fd1f-4b4d-9093-62ad51905673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.195121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06ca8b-fd1f-4b4d-9093-62ad51905673 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.196021 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06ca8b-fd1f-4b4d-9093-62ad51905673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:39.200741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06ca8b-fd1f-4b4d-9093-62ad51905673 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:39.248483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1130/2268] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:39 2022] POST /identity/v3/projects => generated 399 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:39.253187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455584a-0995-4639-8180-46f8b51aa50c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:39.275015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455584a-0995-4639-8180-46f8b51aa50c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:39.351440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bc7e-d1e4-4197-9ee9-7ed0490495d1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.352102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bc7e-d1e4-4197-9ee9-7ed0490495d1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.353022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bc7e-d1e4-4197-9ee9-7ed0490495d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.374584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-45d6bc7e-d1e4-4197-9ee9-7ed0490495d1 None None] MFA Rules not processed for user `f65d65ae8af34ee1a812edbb2e630b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:39.375792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-45d6bc7e-d1e4-4197-9ee9-7ed0490495d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:39.388993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3612d3c-d97f-471b-9792-806b5d77421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:39.390373 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3612d3c-d97f-471b-9792-806b5d77421e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.390932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3612d3c-d97f-471b-9792-806b5d77421e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.391387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3612d3c-d97f-471b-9792-806b5d77421e admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.392371 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3612d3c-d97f-471b-9792-806b5d77421e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:39.394957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3612d3c-d97f-471b-9792-806b5d77421e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:39.425937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1139/2269] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:39 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:39.431975 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3612d3c-d97f-471b-9792-806b5d77421e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:39.437815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3612d3c-d97f-471b-9792-806b5d77421e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:39.443324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4a865-b97a-401f-8e22-0bd963ec65c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:39.444268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4a865-b97a-401f-8e22-0bd963ec65c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.444700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4a865-b97a-401f-8e22-0bd963ec65c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.444929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4a865-b97a-401f-8e22-0bd963ec65c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.445589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4a865-b97a-401f-8e22-0bd963ec65c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:39.447221 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4a865-b97a-401f-8e22-0bd963ec65c0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:39.454631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1131/2270] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:39.462866 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6bc7e-d1e4-4197-9ee9-7ed0490495d1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:39.468556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1140/2271] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:39.475265 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6bc7e-d1e4-4197-9ee9-7ed0490495d1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:39.483273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2680ba8-4349-4f5e-9edf-9f064f16fd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:39.484057 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2680ba8-4349-4f5e-9edf-9f064f16fd7f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.484576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2680ba8-4349-4f5e-9edf-9f064f16fd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.484926 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2680ba8-4349-4f5e-9edf-9f064f16fd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.485731 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2680ba8-4349-4f5e-9edf-9f064f16fd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:39.487453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2680ba8-4349-4f5e-9edf-9f064f16fd7f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:39.499072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1132/2272] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:39.503858 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4a865-b97a-401f-8e22-0bd963ec65c0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:39.515746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4a865-b97a-401f-8e22-0bd963ec65c0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:39.517945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2680ba8-4349-4f5e-9edf-9f064f16fd7f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:39.519988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a2680ba8-4349-4f5e-9edf-9f064f16fd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:39.525067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54489a8b-13fb-40f6-a7e0-95749197e5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:39.526367 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54489a8b-13fb-40f6-a7e0-95749197e5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.526709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54489a8b-13fb-40f6-a7e0-95749197e5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.527032 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54489a8b-13fb-40f6-a7e0-95749197e5d9 admin admin] PATH_INFO: `/v3/projects/422107047cbd40969d2f9efd17dc8d08/users/4ec80e80a5e94562844118189d494246/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.544738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54489a8b-13fb-40f6-a7e0-95749197e5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422107047cbd40969d2f9efd17dc8d08, user_id=4ec80e80a5e94562844118189d494246, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:39.547419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54489a8b-13fb-40f6-a7e0-95749197e5d9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:39.564139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1141/2273] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:39 2022] PUT /identity/v3/projects/422107047cbd40969d2f9efd17dc8d08/users/4ec80e80a5e94562844118189d494246/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:39.578009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123886a-0895-472a-a4ee-fb63c0bbb061 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.578850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123886a-0895-472a-a4ee-fb63c0bbb061 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.579879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123886a-0895-472a-a4ee-fb63c0bbb061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.604225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2680ba8-4349-4f5e-9edf-9f064f16fd7f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:39.632524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c123886a-0895-472a-a4ee-fb63c0bbb061 None None] MFA Rules not processed for user `4ec80e80a5e94562844118189d494246`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:39.634837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c123886a-0895-472a-a4ee-fb63c0bbb061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:39.658955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:39.681114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1215be6-5d18-4565-9c0a-2cf6aa907324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:39.681997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1215be6-5d18-4565-9c0a-2cf6aa907324 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.682419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1215be6-5d18-4565-9c0a-2cf6aa907324 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.682851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1215be6-5d18-4565-9c0a-2cf6aa907324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.685061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a1215be6-5d18-4565-9c0a-2cf6aa907324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:39.698143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:39.765148 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1215be6-5d18-4565-9c0a-2cf6aa907324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:39.770039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1142/2274] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:39.770200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1215be6-5d18-4565-9c0a-2cf6aa907324 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:39.770292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1cd85-c997-49e3-8bd4-93333ff8f7f8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.770292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1cd85-c997-49e3-8bd4-93333ff8f7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.770292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1cd85-c997-49e3-8bd4-93333ff8f7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.782137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1133/2275] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:28:39.806372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ceb1cd85-c997-49e3-8bd4-93333ff8f7f8 None None] MFA Rules not processed for user `90ebeb777931402184d9471f86e111ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:39.809464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ceb1cd85-c997-49e3-8bd4-93333ff8f7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:39.845772 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1215be6-5d18-4565-9c0a-2cf6aa907324 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:39.847241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a1215be6-5d18-4565-9c0a-2cf6aa907324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:39.861403 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1215be6-5d18-4565-9c0a-2cf6aa907324 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:39.865662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f152943-671a-4b81-89fe-aba669de4e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:39.866461 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f152943-671a-4b81-89fe-aba669de4e0f service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:39.866746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f152943-671a-4b81-89fe-aba669de4e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:39.867171 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f152943-671a-4b81-89fe-aba669de4e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:39.877538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f152943-671a-4b81-89fe-aba669de4e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:39.879102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f152943-671a-4b81-89fe-aba669de4e0f service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:39.897371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1134/2276] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:28:39.928660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1143/2277] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:43.890040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f152943-671a-4b81-89fe-aba669de4e0f service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:43.895072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7f152943-671a-4b81-89fe-aba669de4e0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:43.994352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f152943-671a-4b81-89fe-aba669de4e0f service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:44.000140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:44.003135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:44.003628 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:44.004252 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] PATH_INFO: `/v3/users/2aa8474961ff40d0b22eadc8d47f809a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:44.006347 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa8474961ff40d0b22eadc8d47f809a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:44.008757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:44.081820 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa8474961ff40d0b22eadc8d47f809a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:44.093303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa8474961ff40d0b22eadc8d47f809a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:44.116539 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa8474961ff40d0b22eadc8d47f809a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:44.117022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa8474961ff40d0b22eadc8d47f809a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:44.117636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa8474961ff40d0b22eadc8d47f809a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:44.160161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1135/2278] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:43 2022] DELETE /identity/v3/users/2aa8474961ff40d0b22eadc8d47f809a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:44.161782 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2823-25e9-4c83-99d6-8ff9680330fe None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:44.162224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2823-25e9-4c83-99d6-8ff9680330fe None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:44.162301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2823-25e9-4c83-99d6-8ff9680330fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:44.189313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-545d2823-25e9-4c83-99d6-8ff9680330fe None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:44.191088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-545d2823-25e9-4c83-99d6-8ff9680330fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:44.284532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1144/2279] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:44.294663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:44.297053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:44.329734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:44.386254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df406a6-22c4-4401-9a27-987e80ec5e1d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:44.392077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d158a-49a1-4e26-ac21-a10eb5b4f4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:44.393283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d158a-49a1-4e26-ac21-a10eb5b4f4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:44.393283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d158a-49a1-4e26-ac21-a10eb5b4f4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:44.393558 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d158a-49a1-4e26-ac21-a10eb5b4f4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:44.405865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d158a-49a1-4e26-ac21-a10eb5b4f4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:44.407321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d158a-49a1-4e26-ac21-a10eb5b4f4b7 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:44.420646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1136/2280] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:44.723502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2823-25e9-4c83-99d6-8ff9680330fe None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:44.725096 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-545d2823-25e9-4c83-99d6-8ff9680330fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:44.740739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2823-25e9-4c83-99d6-8ff9680330fe None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:44.746148 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:44.747293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:44.747752 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:44.748095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] PATH_INFO: `/v3/projects/3cefde28456b4b719b60bd3f2022e0f8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:44.749849 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cefde28456b4b719b60bd3f2022e0f8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:44.751393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:44.802867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cefde28456b4b719b60bd3f2022e0f8', 'request_id': 'req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:44.805811 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:44.811357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cefde28456b4b719b60bd3f2022e0f8', 'request_id': 'req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:44.819360 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cefde28456b4b719b60bd3f2022e0f8', 'request_id': 'req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:44.832224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] The token cache is being invalidate because project 3cefde28456b4b719b60bd3f2022e0f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:44.832559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:44.833270 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:44.835159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1145/2281] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:44 2022] DELETE /identity/v3/projects/3cefde28456b4b719b60bd3f2022e0f8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:44.838988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d158a-49a1-4e26-ac21-a10eb5b4f4b7 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:44.849543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d158a-49a1-4e26-ac21-a10eb5b4f4b7 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:44.942776 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:44.944144 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:44.944610 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:44.944969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] PATH_INFO: `/v3/users/2b3d6260893640c0a8292c01d39a9f16` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:44.946425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3d6260893640c0a8292c01d39a9f16)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:44.950154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:45.039002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3d6260893640c0a8292c01d39a9f16'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.058920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3d6260893640c0a8292c01d39a9f16'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.078155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3d6260893640c0a8292c01d39a9f16'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.078993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3d6260893640c0a8292c01d39a9f16'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.079626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3d6260893640c0a8292c01d39a9f16'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.094992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1137/2282] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:44 2022] DELETE /identity/v3/users/2b3d6260893640c0a8292c01d39a9f16 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:45.350111 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:45.352717 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:45.380549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021930-4722-43ab-8fb4-4fdb1ca5bbc9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:45.470770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc736b-dfd8-4469-9a9b-20f2b68c1611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:45.471719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc736b-dfd8-4469-9a9b-20f2b68c1611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:45.472042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc736b-dfd8-4469-9a9b-20f2b68c1611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:45.472461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc736b-dfd8-4469-9a9b-20f2b68c1611 admin admin] PATH_INFO: `/v3/users/4ec80e80a5e94562844118189d494246` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:45.474798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc736b-dfd8-4469-9a9b-20f2b68c1611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec80e80a5e94562844118189d494246)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:45.476484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc736b-dfd8-4469-9a9b-20f2b68c1611 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:45.507857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:45.510231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:45.539630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078bc4e-c509-4343-999d-6807cba01bc2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:45.546924 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:45.549260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:45.549846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:45.550310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] PATH_INFO: `/v3/projects/5294f064f9a54b449fe3138322cd3bbf` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:45.551647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5294f064f9a54b449fe3138322cd3bbf)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:45.554953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:45.568704 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3afc736b-dfd8-4469-9a9b-20f2b68c1611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec80e80a5e94562844118189d494246'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.580734 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3afc736b-dfd8-4469-9a9b-20f2b68c1611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec80e80a5e94562844118189d494246'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.615616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3afc736b-dfd8-4469-9a9b-20f2b68c1611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec80e80a5e94562844118189d494246'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.664550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3afc736b-dfd8-4469-9a9b-20f2b68c1611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec80e80a5e94562844118189d494246'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.665839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3afc736b-dfd8-4469-9a9b-20f2b68c1611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec80e80a5e94562844118189d494246'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.679719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1146/2283] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:45 2022] DELETE /identity/v3/users/4ec80e80a5e94562844118189d494246 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:45.687649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608a7e-20c7-4b21-a778-2ac3c9959ef0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:45.687930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608a7e-20c7-4b21-a778-2ac3c9959ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:45.688234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608a7e-20c7-4b21-a778-2ac3c9959ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:45.699998 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:45.727231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2c608a7e-20c7-4b21-a778-2ac3c9959ef0 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:45.728381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5294f064f9a54b449fe3138322cd3bbf', 'request_id': 'req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.728858 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2c608a7e-20c7-4b21-a778-2ac3c9959ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:45.742382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5294f064f9a54b449fe3138322cd3bbf', 'request_id': 'req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.758815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5294f064f9a54b449fe3138322cd3bbf', 'request_id': 'req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.792745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] The token cache is being invalidate because project 5294f064f9a54b449fe3138322cd3bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:45.794715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.795816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:45.798660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1138/2284] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:45 2022] DELETE /identity/v3/projects/5294f064f9a54b449fe3138322cd3bbf => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:45.818835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:45.836634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:45.854383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:45.890795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1147/2285] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:45.902014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608a7e-20c7-4b21-a778-2ac3c9959ef0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:45.903970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2c608a7e-20c7-4b21-a778-2ac3c9959ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:45.966779 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c6d49-df0d-426e-b5b5-e4a3e498dd41 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:45.972084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:45.973145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:45.973529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:45.973918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] PATH_INFO: `/v3/users/7c73cf014e4c46d6a9880b4d8817b08f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:45.975409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c73cf014e4c46d6a9880b4d8817b08f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:45.977840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:46.000364 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608a7e-20c7-4b21-a778-2ac3c9959ef0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:46.005969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f94f9-880a-490b-93b3-d51bca84a655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:46.006755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f94f9-880a-490b-93b3-d51bca84a655 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:46.007083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f94f9-880a-490b-93b3-d51bca84a655 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:46.007445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f94f9-880a-490b-93b3-d51bca84a655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:46.027357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f94f9-880a-490b-93b3-d51bca84a655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:46.034639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f94f9-880a-490b-93b3-d51bca84a655 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:46.046771 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1148/2286] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:46.060262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c73cf014e4c46d6a9880b4d8817b08f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.070462 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c73cf014e4c46d6a9880b4d8817b08f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.092678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c73cf014e4c46d6a9880b4d8817b08f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.093579 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c73cf014e4c46d6a9880b4d8817b08f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.094463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c73cf014e4c46d6a9880b4d8817b08f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.119625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1139/2287] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:45 2022] DELETE /identity/v3/users/7c73cf014e4c46d6a9880b4d8817b08f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:46.413735 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5add59-f727-4210-89ef-a97be1244ef5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:46.414623 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5add59-f727-4210-89ef-a97be1244ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:46.415495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5add59-f727-4210-89ef-a97be1244ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:46.443423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-af5add59-f727-4210-89ef-a97be1244ef5 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:46.445566 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-af5add59-f727-4210-89ef-a97be1244ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:46.515885 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1149/2288] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Jul 21 08:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:46.535944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:46.539840 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:46.540136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5add59-f727-4210-89ef-a97be1244ef5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:46.541658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-af5add59-f727-4210-89ef-a97be1244ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:46.557107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7d70c-b994-45c2-9515-fc085315142a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:46.563740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:46.564906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:46.565389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:46.578131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] PATH_INFO: `/v3/projects/422107047cbd40969d2f9efd17dc8d08` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:46.580715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=422107047cbd40969d2f9efd17dc8d08)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:46.583404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:46.649951 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:46.669780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422107047cbd40969d2f9efd17dc8d08', 'request_id': 'req-1102f764-5d37-4ba0-875f-84e83f6cc2e2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.681478 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422107047cbd40969d2f9efd17dc8d08', 'request_id': 'req-1102f764-5d37-4ba0-875f-84e83f6cc2e2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.691352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422107047cbd40969d2f9efd17dc8d08', 'request_id': 'req-1102f764-5d37-4ba0-875f-84e83f6cc2e2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.708549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] The token cache is being invalidate because project 422107047cbd40969d2f9efd17dc8d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:46.708549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.709140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.710959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1140/2289] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:46 2022] DELETE /identity/v3/projects/422107047cbd40969d2f9efd17dc8d08 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:46.711799 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:46.714373 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5add59-f727-4210-89ef-a97be1244ef5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:46.716519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:46.787494 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:46.817844 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f764-5d37-4ba0-875f-84e83f6cc2e2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:46.821199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409a6c7-933f-4f9f-a123-e87db42abc2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:46.821892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409a6c7-933f-4f9f-a123-e87db42abc2e service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:46.822222 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409a6c7-933f-4f9f-a123-e87db42abc2e service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:46.822447 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409a6c7-933f-4f9f-a123-e87db42abc2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:46.822918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9dba0-a0ba-49ab-844c-07598d2dd25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:46.823973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9dba0-a0ba-49ab-844c-07598d2dd25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:46.824255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9dba0-a0ba-49ab-844c-07598d2dd25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:46.824525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0409a6c7-933f-4f9f-a123-e87db42abc2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:46.824725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9dba0-a0ba-49ab-844c-07598d2dd25e admin admin] PATH_INFO: `/v3/projects/58cfdc17aeb9432086fac438fabb7eda` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:46.826005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9dba0-a0ba-49ab-844c-07598d2dd25e admin admin] RBAC: Authorizing `identity:delete_project(project_id=58cfdc17aeb9432086fac438fabb7eda)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:46.828103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9dba0-a0ba-49ab-844c-07598d2dd25e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:46.836829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409a6c7-933f-4f9f-a123-e87db42abc2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:46.838491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409a6c7-933f-4f9f-a123-e87db42abc2e service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:46.851681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1150/2290] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:28:46.853097 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5af0b-c0f9-47cb-90b1-29a7e1112fd1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:46.853382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5af0b-c0f9-47cb-90b1-29a7e1112fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:46.853758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5af0b-c0f9-47cb-90b1-29a7e1112fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:46.878525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3be5af0b-c0f9-47cb-90b1-29a7e1112fd1 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:46.879867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3be5af0b-c0f9-47cb-90b1-29a7e1112fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:46.892039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52f9dba0-a0ba-49ab-844c-07598d2dd25e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58cfdc17aeb9432086fac438fabb7eda', 'request_id': 'req-52f9dba0-a0ba-49ab-844c-07598d2dd25e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.906023 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52f9dba0-a0ba-49ab-844c-07598d2dd25e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58cfdc17aeb9432086fac438fabb7eda', 'request_id': 'req-52f9dba0-a0ba-49ab-844c-07598d2dd25e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.916849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52f9dba0-a0ba-49ab-844c-07598d2dd25e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58cfdc17aeb9432086fac438fabb7eda', 'request_id': 'req-52f9dba0-a0ba-49ab-844c-07598d2dd25e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.932304 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52f9dba0-a0ba-49ab-844c-07598d2dd25e admin admin] The token cache is being invalidate because project 58cfdc17aeb9432086fac438fabb7eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:46.932637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52f9dba0-a0ba-49ab-844c-07598d2dd25e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.933463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52f9dba0-a0ba-49ab-844c-07598d2dd25e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:46.940593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1141/2291] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:46 2022] DELETE /identity/v3/projects/58cfdc17aeb9432086fac438fabb7eda => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:46.942429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ed85b-b035-4652-bfa1-a28e31baf610 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:46.942839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ed85b-b035-4652-bfa1-a28e31baf610 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:46.943126 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ed85b-b035-4652-bfa1-a28e31baf610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:46.962671 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ca6ed85b-b035-4652-bfa1-a28e31baf610 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:46.964802 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ca6ed85b-b035-4652-bfa1-a28e31baf610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:46.964942 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1151/2292] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:46.973814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98066e89-48d5-4c85-9e07-fa0c7bfd156d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:46.973814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98066e89-48d5-4c85-9e07-fa0c7bfd156d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:46.974113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98066e89-48d5-4c85-9e07-fa0c7bfd156d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:46.982120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1142/2293] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:46.992626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64268-b116-403f-8143-30f56e631a93 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:46.993043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64268-b116-403f-8143-30f56e631a93 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:46.993422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64268-b116-403f-8143-30f56e631a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.025079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-98066e89-48d5-4c85-9e07-fa0c7bfd156d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:47.026031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-18b64268-b116-403f-8143-30f56e631a93 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:47.027967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-98066e89-48d5-4c85-9e07-fa0c7bfd156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:47.028618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-18b64268-b116-403f-8143-30f56e631a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:47.050961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1143/2294] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:47.052364 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64268-b116-403f-8143-30f56e631a93 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.063192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64268-b116-403f-8143-30f56e631a93 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.070298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a320a-9922-425d-a124-de580b7e1eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.071240 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a320a-9922-425d-a124-de580b7e1eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.071675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a320a-9922-425d-a124-de580b7e1eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.072200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a320a-9922-425d-a124-de580b7e1eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.073132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a320a-9922-425d-a124-de580b7e1eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:47.076465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a320a-9922-425d-a124-de580b7e1eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.078834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a320a-9922-425d-a124-de580b7e1eb2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.093216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1152/2295] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:47.105863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1144/2296] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:47.110687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a320a-9922-425d-a124-de580b7e1eb2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.115123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98066e89-48d5-4c85-9e07-fa0c7bfd156d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.122588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a320a-9922-425d-a124-de580b7e1eb2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.128874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f6a1a-7353-492b-b7f5-9f39b4d9d869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.129640 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f6a1a-7353-492b-b7f5-9f39b4d9d869 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.130135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f6a1a-7353-492b-b7f5-9f39b4d9d869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.130477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f6a1a-7353-492b-b7f5-9f39b4d9d869 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.131424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f6a1a-7353-492b-b7f5-9f39b4d9d869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.133765 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f6a1a-7353-492b-b7f5-9f39b4d9d869 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.146225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98066e89-48d5-4c85-9e07-fa0c7bfd156d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.156965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa196b2-c9e9-419e-b967-3fa26814003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.157206 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa196b2-c9e9-419e-b967-3fa26814003c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.157533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa196b2-c9e9-419e-b967-3fa26814003c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.157752 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa196b2-c9e9-419e-b967-3fa26814003c admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.159633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa196b2-c9e9-419e-b967-3fa26814003c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:47.160594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa196b2-c9e9-419e-b967-3fa26814003c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.163749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa196b2-c9e9-419e-b967-3fa26814003c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.173013 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1145/2297] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:47 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:47.174346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f6a1a-7353-492b-b7f5-9f39b4d9d869 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.180365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:47.192571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1153/2298] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:47.194233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa196b2-c9e9-419e-b967-3fa26814003c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.208081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa196b2-c9e9-419e-b967-3fa26814003c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.266187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f6a1a-7353-492b-b7f5-9f39b4d9d869 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.273045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f51b2-de49-4642-9636-51d3da7be947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.273856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f51b2-de49-4642-9636-51d3da7be947 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.274215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f51b2-de49-4642-9636-51d3da7be947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.274563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f51b2-de49-4642-9636-51d3da7be947 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.275281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f51b2-de49-4642-9636-51d3da7be947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.277313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f51b2-de49-4642-9636-51d3da7be947 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.279224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bf7a9-d6af-4b77-b11c-79d907879d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.279915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bf7a9-d6af-4b77-b11c-79d907879d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.280197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bf7a9-d6af-4b77-b11c-79d907879d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.280457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bf7a9-d6af-4b77-b11c-79d907879d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.281219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bf7a9-d6af-4b77-b11c-79d907879d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.283205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bf7a9-d6af-4b77-b11c-79d907879d00 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.312074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1146/2299] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:47 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:47.316905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f51b2-de49-4642-9636-51d3da7be947 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.317848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1154/2300] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:47 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:47.322316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bf7a9-d6af-4b77-b11c-79d907879d00 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.328416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f51b2-de49-4642-9636-51d3da7be947 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.360801 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:47.391667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bf7a9-d6af-4b77-b11c-79d907879d00 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.397047 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6e510-9e9a-4c84-8b65-cf380446bdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.397735 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6e510-9e9a-4c84-8b65-cf380446bdf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.398014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6e510-9e9a-4c84-8b65-cf380446bdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.398285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6e510-9e9a-4c84-8b65-cf380446bdf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.398995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6e510-9e9a-4c84-8b65-cf380446bdf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.400714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27066cd-3f00-41c3-b13a-b41f6e3b3c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.400982 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6e510-9e9a-4c84-8b65-cf380446bdf0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.401398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27066cd-3f00-41c3-b13a-b41f6e3b3c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.401678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27066cd-3f00-41c3-b13a-b41f6e3b3c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.401951 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27066cd-3f00-41c3-b13a-b41f6e3b3c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.402682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27066cd-3f00-41c3-b13a-b41f6e3b3c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.404279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27066cd-3f00-41c3-b13a-b41f6e3b3c97 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.418367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1147/2301] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:47.419764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27066cd-3f00-41c3-b13a-b41f6e3b3c97 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.428838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1155/2302] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:47 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:47.429777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6e510-9e9a-4c84-8b65-cf380446bdf0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.430842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27066cd-3f00-41c3-b13a-b41f6e3b3c97 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.440595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6e510-9e9a-4c84-8b65-cf380446bdf0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.442369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babe119-49b5-4407-8c43-a4165d447041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.443011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babe119-49b5-4407-8c43-a4165d447041 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.443336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babe119-49b5-4407-8c43-a4165d447041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.443555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babe119-49b5-4407-8c43-a4165d447041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.444375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babe119-49b5-4407-8c43-a4165d447041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.445598 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f46ec-5038-4b59-be54-afe68b70b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.446046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babe119-49b5-4407-8c43-a4165d447041 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.446276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f46ec-5038-4b59-be54-afe68b70b556 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.446625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f46ec-5038-4b59-be54-afe68b70b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.446833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f46ec-5038-4b59-be54-afe68b70b556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.447572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f46ec-5038-4b59-be54-afe68b70b556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.449301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f46ec-5038-4b59-be54-afe68b70b556 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.457623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1148/2303] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:47.461649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babe119-49b5-4407-8c43-a4165d447041 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.464357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1156/2304] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:47.465332 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f46ec-5038-4b59-be54-afe68b70b556 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.472605 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babe119-49b5-4407-8c43-a4165d447041 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.475964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f46ec-5038-4b59-be54-afe68b70b556 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.478719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32490920-bc90-4f02-a735-f727656f61b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.480223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32490920-bc90-4f02-a735-f727656f61b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.483775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32490920-bc90-4f02-a735-f727656f61b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.483775 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32490920-bc90-4f02-a735-f727656f61b1 admin admin] PATH_INFO: `/v3/projects/59cae0222af741469cbaf8fa6e16239f/users/9367ed6443c94190b80b599eaf2035f3/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.484039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e4a9f-fcbd-483b-a155-5ce1d80e8534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.485387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e4a9f-fcbd-483b-a155-5ce1d80e8534 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.485681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e4a9f-fcbd-483b-a155-5ce1d80e8534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.485964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e4a9f-fcbd-483b-a155-5ce1d80e8534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.486721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e4a9f-fcbd-483b-a155-5ce1d80e8534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.490826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e4a9f-fcbd-483b-a155-5ce1d80e8534 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.502126 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32490920-bc90-4f02-a735-f727656f61b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cae0222af741469cbaf8fa6e16239f, user_id=9367ed6443c94190b80b599eaf2035f3, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.503179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1157/2305] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:47.506300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32490920-bc90-4f02-a735-f727656f61b1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.507825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e4a9f-fcbd-483b-a155-5ce1d80e8534 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.521038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e4a9f-fcbd-483b-a155-5ce1d80e8534 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.530360 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1149/2306] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:47 2022] PUT /identity/v3/projects/59cae0222af741469cbaf8fa6e16239f/users/9367ed6443c94190b80b599eaf2035f3/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:47.540708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf5a01-12c6-4b8b-b700-861c4035677b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.540991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf5a01-12c6-4b8b-b700-861c4035677b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.541271 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf5a01-12c6-4b8b-b700-861c4035677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.571921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6acf5a01-12c6-4b8b-b700-861c4035677b None None] MFA Rules not processed for user `9367ed6443c94190b80b599eaf2035f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:47.573252 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6acf5a01-12c6-4b8b-b700-861c4035677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:47.594705 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fadab-13ae-43dc-8ace-55dbb3780308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.595721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fadab-13ae-43dc-8ace-55dbb3780308 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.596069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fadab-13ae-43dc-8ace-55dbb3780308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.596481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fadab-13ae-43dc-8ace-55dbb3780308 admin admin] PATH_INFO: `/v3/projects/9bc1f5ffbcbc411aad62b49e8391852c/users/4185cf0e97934e288a0d6eddc611d343/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.625306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:47.625664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fadab-13ae-43dc-8ace-55dbb3780308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc1f5ffbcbc411aad62b49e8391852c, user_id=4185cf0e97934e288a0d6eddc611d343, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.628818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fadab-13ae-43dc-8ace-55dbb3780308 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.652254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1158/2307] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:47 2022] PUT /identity/v3/projects/9bc1f5ffbcbc411aad62b49e8391852c/users/4185cf0e97934e288a0d6eddc611d343/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:47.657706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d5bc-d835-4d99-921b-7d73cfc3e2c0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.662825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1150/2308] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:47.662936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d5bc-d835-4d99-921b-7d73cfc3e2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.662936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d5bc-d835-4d99-921b-7d73cfc3e2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.671082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf5a01-12c6-4b8b-b700-861c4035677b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.672778 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6acf5a01-12c6-4b8b-b700-861c4035677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:47.677670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9966d5bc-d835-4d99-921b-7d73cfc3e2c0 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:47.678955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9966d5bc-d835-4d99-921b-7d73cfc3e2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:47.734284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf5a01-12c6-4b8b-b700-861c4035677b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.744286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1159/2309] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:47.754046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966d5bc-d835-4d99-921b-7d73cfc3e2c0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:47.755482 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9966d5bc-d835-4d99-921b-7d73cfc3e2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:47.788433 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:47.791802 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b15a9-e573-48b0-90a2-6017d88213a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.792524 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b15a9-e573-48b0-90a2-6017d88213a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.793043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b15a9-e573-48b0-90a2-6017d88213a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.793161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b15a9-e573-48b0-90a2-6017d88213a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.821698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966d5bc-d835-4d99-921b-7d73cfc3e2c0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:47.825534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22aea4-1758-4de4-8820-86d8f5f84bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:47.826131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22aea4-1758-4de4-8820-86d8f5f84bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:47.826414 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22aea4-1758-4de4-8820-86d8f5f84bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:47.826728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22aea4-1758-4de4-8820-86d8f5f84bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:47.836565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22aea4-1758-4de4-8820-86d8f5f84bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.838008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22aea4-1758-4de4-8820-86d8f5f84bb7 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.848738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1160/2310] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:28:47.855344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b15a9-e573-48b0-90a2-6017d88213a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:47.856881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b15a9-e573-48b0-90a2-6017d88213a1 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:47.868233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1151/2311] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:28:49.927624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2bba0-a93d-4cff-b207-6779816a11fc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:49.929695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2bba0-a93d-4cff-b207-6779816a11fc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:49.930135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2bba0-a93d-4cff-b207-6779816a11fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:49.956037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-cdb2bba0-a93d-4cff-b207-6779816a11fc None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:49.959710 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cdb2bba0-a93d-4cff-b207-6779816a11fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:49.989039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1161/2312] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Jul 21 08:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:50.079530 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b15a9-e573-48b0-90a2-6017d88213a1 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:50.080911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5a1b15a9-e573-48b0-90a2-6017d88213a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:50.197226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:50.252941 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b15a9-e573-48b0-90a2-6017d88213a1 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:50.273105 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4787b92-8ba2-48d8-a641-2d18ae48affa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:50.273921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4787b92-8ba2-48d8-a641-2d18ae48affa service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:50.274307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4787b92-8ba2-48d8-a641-2d18ae48affa service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:50.274791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4787b92-8ba2-48d8-a641-2d18ae48affa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:50.287167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4787b92-8ba2-48d8-a641-2d18ae48affa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:50.289006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4787b92-8ba2-48d8-a641-2d18ae48affa service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:50.300529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1152/2313] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:50.901957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2bba0-a93d-4cff-b207-6779816a11fc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:50.912600 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2bba0-a93d-4cff-b207-6779816a11fc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:50.927929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:50.929693 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:50.930133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:50.930561 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] PATH_INFO: `/v3/users/9367ed6443c94190b80b599eaf2035f3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:50.934244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9367ed6443c94190b80b599eaf2035f3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:50.936633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:51.098485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9367ed6443c94190b80b599eaf2035f3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:51.118290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9367ed6443c94190b80b599eaf2035f3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:51.134573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9367ed6443c94190b80b599eaf2035f3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:51.179895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9367ed6443c94190b80b599eaf2035f3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:51.181068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9367ed6443c94190b80b599eaf2035f3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:51.197490 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1162/2314] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:28:50 2022] DELETE /identity/v3/users/9367ed6443c94190b80b599eaf2035f3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:28:51.202121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf287c-f0c2-47cb-b5e3-c45926141f3b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:51.202717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf287c-f0c2-47cb-b5e3-c45926141f3b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:51.202717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf287c-f0c2-47cb-b5e3-c45926141f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:51.253567 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3cdf287c-f0c2-47cb-b5e3-c45926141f3b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:51.256259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3cdf287c-f0c2-47cb-b5e3-c45926141f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:51.410082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1153/2315] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:51.460199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:51.462243 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:51.573420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76963ce-972e-4989-8d89-c10e2bb9cbb0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:51.577965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3484fe3-44d9-4b99-9380-f307c06ab0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:51.578600 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3484fe3-44d9-4b99-9380-f307c06ab0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:51.578887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3484fe3-44d9-4b99-9380-f307c06ab0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:51.579164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3484fe3-44d9-4b99-9380-f307c06ab0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:51.598417 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3484fe3-44d9-4b99-9380-f307c06ab0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:51.599915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3484fe3-44d9-4b99-9380-f307c06ab0e2 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:51.615366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1163/2316] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:52.887512 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf287c-f0c2-47cb-b5e3-c45926141f3b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:52.889925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3cdf287c-f0c2-47cb-b5e3-c45926141f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:52.921339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf287c-f0c2-47cb-b5e3-c45926141f3b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:52.934664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e107f-ccbc-4739-b006-7c105b56fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:52.935566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e107f-ccbc-4739-b006-7c105b56fb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:52.935852 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e107f-ccbc-4739-b006-7c105b56fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:52.936145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e107f-ccbc-4739-b006-7c105b56fb21 admin admin] PATH_INFO: `/v3/projects/59cae0222af741469cbaf8fa6e16239f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:52.941464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e107f-ccbc-4739-b006-7c105b56fb21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cae0222af741469cbaf8fa6e16239f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:52.943490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e107f-ccbc-4739-b006-7c105b56fb21 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:53.035921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8e2e107f-ccbc-4739-b006-7c105b56fb21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cae0222af741469cbaf8fa6e16239f', 'request_id': 'req-8e2e107f-ccbc-4739-b006-7c105b56fb21'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:53.058821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8e2e107f-ccbc-4739-b006-7c105b56fb21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cae0222af741469cbaf8fa6e16239f', 'request_id': 'req-8e2e107f-ccbc-4739-b006-7c105b56fb21'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:53.072369 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8e2e107f-ccbc-4739-b006-7c105b56fb21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cae0222af741469cbaf8fa6e16239f', 'request_id': 'req-8e2e107f-ccbc-4739-b006-7c105b56fb21'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:53.090356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8e2e107f-ccbc-4739-b006-7c105b56fb21 admin admin] The token cache is being invalidate because project 59cae0222af741469cbaf8fa6e16239f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:28:53.091141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8e2e107f-ccbc-4739-b006-7c105b56fb21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:53.092103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8e2e107f-ccbc-4739-b006-7c105b56fb21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:28:53.098295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1154/2317] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:28:52 2022] DELETE /identity/v3/projects/59cae0222af741469cbaf8fa6e16239f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:53.100115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4b49b-16fe-4a03-80c3-ba970771b490 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.100608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4b49b-16fe-4a03-80c3-ba970771b490 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.100861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4b49b-16fe-4a03-80c3-ba970771b490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:53.129605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-66b4b49b-16fe-4a03-80c3-ba970771b490 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:53.130867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-66b4b49b-16fe-4a03-80c3-ba970771b490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:53.210251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:53.273401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1164/2318] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:53.282414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6421-13cf-42d1-a6e5-27f0270bc34c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.283093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6421-13cf-42d1-a6e5-27f0270bc34c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.283093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6421-13cf-42d1-a6e5-27f0270bc34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:53.350510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-725c6421-13cf-42d1-a6e5-27f0270bc34c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:53.352767 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-725c6421-13cf-42d1-a6e5-27f0270bc34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:53.368292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1155/2319] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:53.369639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4b49b-16fe-4a03-80c3-ba970771b490 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:53.386570 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4b49b-16fe-4a03-80c3-ba970771b490 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:53.396951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69683c41-d16d-4f74-820f-f85e97d9c780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:53.397942 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69683c41-d16d-4f74-820f-f85e97d9c780 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.398474 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69683c41-d16d-4f74-820f-f85e97d9c780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.398947 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69683c41-d16d-4f74-820f-f85e97d9c780 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:53.399730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69683c41-d16d-4f74-820f-f85e97d9c780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:28:53.400036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69683c41-d16d-4f74-820f-f85e97d9c780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:53.404179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69683c41-d16d-4f74-820f-f85e97d9c780 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:53.437306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1165/2320] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:28:53.448883 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6421-13cf-42d1-a6e5-27f0270bc34c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:53.459743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6421-13cf-42d1-a6e5-27f0270bc34c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:53.465395 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32954b98-c921-4c37-b1cd-a6c9037018ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:53.466025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32954b98-c921-4c37-b1cd-a6c9037018ad admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.466424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32954b98-c921-4c37-b1cd-a6c9037018ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.466709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32954b98-c921-4c37-b1cd-a6c9037018ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:53.467435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32954b98-c921-4c37-b1cd-a6c9037018ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:53.469499 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32954b98-c921-4c37-b1cd-a6c9037018ad admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:53.521150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69683c41-d16d-4f74-820f-f85e97d9c780 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:53.522078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1156/2321] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:53 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:53.533516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69683c41-d16d-4f74-820f-f85e97d9c780 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:53.649618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097805e-3174-402b-bd8c-f6f692abe459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:53.651691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097805e-3174-402b-bd8c-f6f692abe459 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.652127 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097805e-3174-402b-bd8c-f6f692abe459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.652528 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097805e-3174-402b-bd8c-f6f692abe459 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:53.653762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097805e-3174-402b-bd8c-f6f692abe459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:53.656940 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097805e-3174-402b-bd8c-f6f692abe459 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:53.699462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1166/2322] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:53 2022] POST /identity/v3/users => generated 282 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:28:53.703188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32954b98-c921-4c37-b1cd-a6c9037018ad admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:53.741641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32954b98-c921-4c37-b1cd-a6c9037018ad admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:53.756031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0480bc-07de-4209-a710-4546f6ad108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:53.756791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0480bc-07de-4209-a710-4546f6ad108f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.757071 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0480bc-07de-4209-a710-4546f6ad108f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.757343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0480bc-07de-4209-a710-4546f6ad108f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:53.758582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0480bc-07de-4209-a710-4546f6ad108f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:53.760247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0480bc-07de-4209-a710-4546f6ad108f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:53.780872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1157/2323] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:53.785102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097805e-3174-402b-bd8c-f6f692abe459 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:53.803105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097805e-3174-402b-bd8c-f6f692abe459 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:53.813778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94525679-695f-4b5f-991c-9d90bca5bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:53.814539 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94525679-695f-4b5f-991c-9d90bca5bd1d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.814820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94525679-695f-4b5f-991c-9d90bca5bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.815132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94525679-695f-4b5f-991c-9d90bca5bd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:53.815871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94525679-695f-4b5f-991c-9d90bca5bd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:53.817922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94525679-695f-4b5f-991c-9d90bca5bd1d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:53.831228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1167/2324] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:53.836104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0480bc-07de-4209-a710-4546f6ad108f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:53.847443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0480bc-07de-4209-a710-4546f6ad108f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:53.853162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336f223-1d51-4892-b59c-f53984f18d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:53.854838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336f223-1d51-4892-b59c-f53984f18d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.855114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336f223-1d51-4892-b59c-f53984f18d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.855428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336f223-1d51-4892-b59c-f53984f18d50 admin admin] PATH_INFO: `/v3/projects/d41249482c824463b6d15daa12e5e777/users/8f5bf334c4944925a489d8fa9e7328d0/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:53.893063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336f223-1d51-4892-b59c-f53984f18d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41249482c824463b6d15daa12e5e777, user_id=8f5bf334c4944925a489d8fa9e7328d0, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:53.896446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336f223-1d51-4892-b59c-f53984f18d50 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:53.917622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:53.938624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1158/2325] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:53 2022] PUT /identity/v3/projects/d41249482c824463b6d15daa12e5e777/users/8f5bf334c4944925a489d8fa9e7328d0/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:53.951540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f41bc9-5e0f-4b15-add1-74b8850a5683 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.952568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f41bc9-5e0f-4b15-add1-74b8850a5683 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.952568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f41bc9-5e0f-4b15-add1-74b8850a5683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:54.003274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-75f41bc9-5e0f-4b15-add1-74b8850a5683 None None] MFA Rules not processed for user `8f5bf334c4944925a489d8fa9e7328d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:54.005185 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-75f41bc9-5e0f-4b15-add1-74b8850a5683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:54.146670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1168/2326] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:54.154504 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336f223-1d51-4892-b59c-f53984f18d50 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:54.156413 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b336f223-1d51-4892-b59c-f53984f18d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:54.283598 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336f223-1d51-4892-b59c-f53984f18d50 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:54.288304 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45e267-20ad-43aa-92b6-e993f185bb86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:54.289769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45e267-20ad-43aa-92b6-e993f185bb86 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:54.290167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45e267-20ad-43aa-92b6-e993f185bb86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:54.290554 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45e267-20ad-43aa-92b6-e993f185bb86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:54.304088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45e267-20ad-43aa-92b6-e993f185bb86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:54.305995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45e267-20ad-43aa-92b6-e993f185bb86 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:54.333688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1159/2327] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:55.399432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82d9bc-c90b-4675-8b0e-d410aa401bc2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:55.399904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82d9bc-c90b-4675-8b0e-d410aa401bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:55.399996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82d9bc-c90b-4675-8b0e-d410aa401bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:55.439660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1a82d9bc-c90b-4675-8b0e-d410aa401bc2 None None] MFA Rules not processed for user `4185cf0e97934e288a0d6eddc611d343`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:55.441702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1a82d9bc-c90b-4675-8b0e-d410aa401bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:55.480419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:55.557053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1169/2328] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:28:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:55.561321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45e267-20ad-43aa-92b6-e993f185bb86 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:55.562854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6d45e267-20ad-43aa-92b6-e993f185bb86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:55.619203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7909d-1e6a-4687-89a9-f5a74fe6169d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:55.619493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7909d-1e6a-4687-89a9-f5a74fe6169d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:55.619776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7909d-1e6a-4687-89a9-f5a74fe6169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:55.652038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-13c7909d-1e6a-4687-89a9-f5a74fe6169d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:55.653235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-13c7909d-1e6a-4687-89a9-f5a74fe6169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:55.677899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45e267-20ad-43aa-92b6-e993f185bb86 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:55.683854 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2ab94-eb48-410f-af35-1666d718dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:55.684968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2ab94-eb48-410f-af35-1666d718dd0e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:55.685311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2ab94-eb48-410f-af35-1666d718dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:55.685666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2ab94-eb48-410f-af35-1666d718dd0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:55.686593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2ab94-eb48-410f-af35-1666d718dd0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:55.688847 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2ab94-eb48-410f-af35-1666d718dd0e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:55.726286 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1160/2329] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:28:55 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:55.731208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2ab94-eb48-410f-af35-1666d718dd0e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:55.738763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1170/2330] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Jul 21 08:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:55.764328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7909d-1e6a-4687-89a9-f5a74fe6169d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:55.765983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-13c7909d-1e6a-4687-89a9-f5a74fe6169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:55.853303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2ab94-eb48-410f-af35-1666d718dd0e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:55.859067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6f8b7-f8fb-4f5a-8693-4c47af2defe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:55.859768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6f8b7-f8fb-4f5a-8693-4c47af2defe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:55.860039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6f8b7-f8fb-4f5a-8693-4c47af2defe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:55.861322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6f8b7-f8fb-4f5a-8693-4c47af2defe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:55.862379 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6f8b7-f8fb-4f5a-8693-4c47af2defe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:55.866478 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6f8b7-f8fb-4f5a-8693-4c47af2defe8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:55.872526 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7909d-1e6a-4687-89a9-f5a74fe6169d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:55.920551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1161/2331] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:28:55 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:28:55.923936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6f8b7-f8fb-4f5a-8693-4c47af2defe8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:55.941957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6f8b7-f8fb-4f5a-8693-4c47af2defe8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:55.951999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a75d9-cfc3-4cf0-8164-95049be06456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:55.952734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a75d9-cfc3-4cf0-8164-95049be06456 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:55.953016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a75d9-cfc3-4cf0-8164-95049be06456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:55.953293 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a75d9-cfc3-4cf0-8164-95049be06456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:55.954040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a75d9-cfc3-4cf0-8164-95049be06456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:55.955752 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a75d9-cfc3-4cf0-8164-95049be06456 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:55.982585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1162/2332] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:28:55.985606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a75d9-cfc3-4cf0-8164-95049be06456 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:55.990999 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:55.996144 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:56.004333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7a9d2-dac9-40cb-bbd3-fce265d8c84e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:56.005149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7a9d2-dac9-40cb-bbd3-fce265d8c84e service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:56.005503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7a9d2-dac9-40cb-bbd3-fce265d8c84e service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:56.005664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a75d9-cfc3-4cf0-8164-95049be06456 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:56.006140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7a9d2-dac9-40cb-bbd3-fce265d8c84e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:56.013685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a1b70-0905-4ddc-95f0-3e4289b0b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:56.015253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a1b70-0905-4ddc-95f0-3e4289b0b2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:56.015532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a1b70-0905-4ddc-95f0-3e4289b0b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:56.016354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a1b70-0905-4ddc-95f0-3e4289b0b2e8 admin admin] PATH_INFO: `/v3/projects/d81921827a5548ce85a27bdcf623f6e5/users/00691bfafac8435fb73f590c3b6f07dc/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:56.016953 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7a9d2-dac9-40cb-bbd3-fce265d8c84e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:56.018854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7a9d2-dac9-40cb-bbd3-fce265d8c84e service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:56.030150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1171/2333] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:28:56.039292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a1b70-0905-4ddc-95f0-3e4289b0b2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81921827a5548ce85a27bdcf623f6e5, user_id=00691bfafac8435fb73f590c3b6f07dc, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:56.044521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a1b70-0905-4ddc-95f0-3e4289b0b2e8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:56.077243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1163/2334] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:55 2022] PUT /identity/v3/projects/d81921827a5548ce85a27bdcf623f6e5/users/00691bfafac8435fb73f590c3b6f07dc/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:28:56.083310 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7a9d2-dac9-40cb-bbd3-fce265d8c84e service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:56.105208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7a9d2-dac9-40cb-bbd3-fce265d8c84e service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:56.202822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af788b0-8785-4100-87d1-7be9a3a30f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:56.203606 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af788b0-8785-4100-87d1-7be9a3a30f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:56.203996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af788b0-8785-4100-87d1-7be9a3a30f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:56.204516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af788b0-8785-4100-87d1-7be9a3a30f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:56.205329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af788b0-8785-4100-87d1-7be9a3a30f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:56.207702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af788b0-8785-4100-87d1-7be9a3a30f2a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:56.223278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1172/2335] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:28:56.228198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a1b70-0905-4ddc-95f0-3e4289b0b2e8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:56.242378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a1b70-0905-4ddc-95f0-3e4289b0b2e8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:56.250223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e494e-f2a9-46ab-a27c-752f2f888151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:56.251601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e494e-f2a9-46ab-a27c-752f2f888151 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:56.251946 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e494e-f2a9-46ab-a27c-752f2f888151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:56.252378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e494e-f2a9-46ab-a27c-752f2f888151 admin admin] PATH_INFO: `/v3/projects/d81921827a5548ce85a27bdcf623f6e5/users/00691bfafac8435fb73f590c3b6f07dc/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:56.254802 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e494e-f2a9-46ab-a27c-752f2f888151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81921827a5548ce85a27bdcf623f6e5, user_id=00691bfafac8435fb73f590c3b6f07dc, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:56.258197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e494e-f2a9-46ab-a27c-752f2f888151 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:56.271964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1164/2336] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:28:56 2022] PUT /identity/v3/projects/d81921827a5548ce85a27bdcf623f6e5/users/00691bfafac8435fb73f590c3b6f07dc/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:29:04.068480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d289b2-b826-4719-bdac-2db71f5563a4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:04.069147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d289b2-b826-4719-bdac-2db71f5563a4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:04.070222 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d289b2-b826-4719-bdac-2db71f5563a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:04.173114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c9d289b2-b826-4719-bdac-2db71f5563a4 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:04.174911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c9d289b2-b826-4719-bdac-2db71f5563a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:04.360527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1173/2337] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Jul 21 08:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:04.771030 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e38354-3ab0-4cc7-b9d6-2ac76a253fb6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:04.771582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e38354-3ab0-4cc7-b9d6-2ac76a253fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:04.771582 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e38354-3ab0-4cc7-b9d6-2ac76a253fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:04.787924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d289b2-b826-4719-bdac-2db71f5563a4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:04.858470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-94e38354-3ab0-4cc7-b9d6-2ac76a253fb6 None None] MFA Rules not processed for user `00691bfafac8435fb73f590c3b6f07dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:04.865912 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-94e38354-3ab0-4cc7-b9d6-2ac76a253fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:04.933644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d289b2-b826-4719-bdac-2db71f5563a4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:04.940071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739383b-e35c-47d2-b545-07d8010eb3e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:04.940826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739383b-e35c-47d2-b545-07d8010eb3e3 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:04.941110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739383b-e35c-47d2-b545-07d8010eb3e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:04.941394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739383b-e35c-47d2-b545-07d8010eb3e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:04.976150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739383b-e35c-47d2-b545-07d8010eb3e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:04.977947 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739383b-e35c-47d2-b545-07d8010eb3e3 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:05.004244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1174/2338] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:05.021568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1165/2339] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:29:04 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:05.127840 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739383b-e35c-47d2-b545-07d8010eb3e3 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:05.153363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739383b-e35c-47d2-b545-07d8010eb3e3 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:05.182957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec398c8-f336-497a-bafd-37128a6166e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:05.183853 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec398c8-f336-497a-bafd-37128a6166e6 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:05.184242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec398c8-f336-497a-bafd-37128a6166e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:05.184672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec398c8-f336-497a-bafd-37128a6166e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:05.197007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:05.323764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec398c8-f336-497a-bafd-37128a6166e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:05.325485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec398c8-f336-497a-bafd-37128a6166e6 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:05.340110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1175/2340] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:07.163422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e3413-717e-49c0-886f-04da4cd37026 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:07.163999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e3413-717e-49c0-886f-04da4cd37026 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:07.164866 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e3413-717e-49c0-886f-04da4cd37026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:07.200476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c30e3413-717e-49c0-886f-04da4cd37026 None None] MFA Rules not processed for user `4185cf0e97934e288a0d6eddc611d343`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:07.202045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c30e3413-717e-49c0-886f-04da4cd37026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:07.211377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1166/2341] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:29:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:10.382828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ded7-5ab5-4853-a329-3a9cdb2a9f2e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:10.383809 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ded7-5ab5-4853-a329-3a9cdb2a9f2e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:10.384339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ded7-5ab5-4853-a329-3a9cdb2a9f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:10.405402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d026ded7-5ab5-4853-a329-3a9cdb2a9f2e None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:10.408158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d026ded7-5ab5-4853-a329-3a9cdb2a9f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:10.545859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1176/2342] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:29:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:10.607604 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e3413-717e-49c0-886f-04da4cd37026 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:10.609365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c30e3413-717e-49c0-886f-04da4cd37026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:10.703783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e3413-717e-49c0-886f-04da4cd37026 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:10.709939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59b8d0-f6bb-4f8d-906b-f1351f6c0a09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:10.710616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59b8d0-f6bb-4f8d-906b-f1351f6c0a09 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:10.710894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59b8d0-f6bb-4f8d-906b-f1351f6c0a09 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:10.711398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59b8d0-f6bb-4f8d-906b-f1351f6c0a09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:10.721444 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59b8d0-f6bb-4f8d-906b-f1351f6c0a09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:10.723129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59b8d0-f6bb-4f8d-906b-f1351f6c0a09 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:10.742959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1167/2343] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:29:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:29:12.861759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cb05f-c089-4fb5-a5c2-7c240bc20c1c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:12.862772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cb05f-c089-4fb5-a5c2-7c240bc20c1c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:12.862772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cb05f-c089-4fb5-a5c2-7c240bc20c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:12.904838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-572cb05f-c089-4fb5-a5c2-7c240bc20c1c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:12.908995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-572cb05f-c089-4fb5-a5c2-7c240bc20c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:12.926919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1177/2344] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Jul 21 08:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:12.993469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59b8d0-f6bb-4f8d-906b-f1351f6c0a09 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:13.013326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59b8d0-f6bb-4f8d-906b-f1351f6c0a09 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:13.020602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51826192-e5c7-4cab-a119-10647b838787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:13.028213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51826192-e5c7-4cab-a119-10647b838787 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:13.028911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51826192-e5c7-4cab-a119-10647b838787 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:13.028911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51826192-e5c7-4cab-a119-10647b838787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:13.040049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51826192-e5c7-4cab-a119-10647b838787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:13.042245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51826192-e5c7-4cab-a119-10647b838787 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:13.054279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1168/2345] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:14.712135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9175a-5288-48fe-8572-f04b13a22961 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:14.712789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9175a-5288-48fe-8572-f04b13a22961 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:14.712789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9175a-5288-48fe-8572-f04b13a22961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:14.735488 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f3b9175a-5288-48fe-8572-f04b13a22961 None None] MFA Rules not processed for user `212edf0d95bd48b8a3d26a47ccf25f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:14.736913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f3b9175a-5288-48fe-8572-f04b13a22961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:14.817116 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1178/2346] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:29:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:17.148790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5491c-7583-4c0d-9529-c9d2a426d7ec None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:17.149446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5491c-7583-4c0d-9529-c9d2a426d7ec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:17.149446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5491c-7583-4c0d-9529-c9d2a426d7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:17.176606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5ab5491c-7583-4c0d-9529-c9d2a426d7ec None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:17.178057 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5ab5491c-7583-4c0d-9529-c9d2a426d7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:17.190616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1169/2347] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Jul 21 08:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:17.294328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9175a-5288-48fe-8572-f04b13a22961 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:17.297622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f3b9175a-5288-48fe-8572-f04b13a22961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:17.320308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9175a-5288-48fe-8572-f04b13a22961 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:17.328642 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271eae3-843a-4f54-9bc3-80474e2b5ff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:17.329880 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271eae3-843a-4f54-9bc3-80474e2b5ff1 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:17.330000 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271eae3-843a-4f54-9bc3-80474e2b5ff1 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:17.330317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271eae3-843a-4f54-9bc3-80474e2b5ff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:17.341003 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271eae3-843a-4f54-9bc3-80474e2b5ff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:17.344809 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271eae3-843a-4f54-9bc3-80474e2b5ff1 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:17.357513 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1179/2348] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:29:27.170031 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:27.351544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:33.386528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d10719-0123-4631-9ab5-6aa3e9c53965 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:33.387106 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d10719-0123-4631-9ab5-6aa3e9c53965 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:33.387106 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d10719-0123-4631-9ab5-6aa3e9c53965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:33.407934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b2d10719-0123-4631-9ab5-6aa3e9c53965 None None] MFA Rules not processed for user `66c7e12c0b5a42aa80742e69bfa7bbf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:33.409370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b2d10719-0123-4631-9ab5-6aa3e9c53965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:33.489205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1170/2349] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:29:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:29:37.636249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f99fb-6c11-4ca6-9871-3ee6bc9d5b89 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:37.636798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f99fb-6c11-4ca6-9871-3ee6bc9d5b89 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:37.636798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f99fb-6c11-4ca6-9871-3ee6bc9d5b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:37.659205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-366f99fb-6c11-4ca6-9871-3ee6bc9d5b89 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:37.660351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-366f99fb-6c11-4ca6-9871-3ee6bc9d5b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:37.668375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1180/2350] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:29:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:29:37.681594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d10719-0123-4631-9ab5-6aa3e9c53965 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:37.694831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d10719-0123-4631-9ab5-6aa3e9c53965 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:37.699804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06135039-4002-4663-9e6a-e10e5600620d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:37.700481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06135039-4002-4663-9e6a-e10e5600620d service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:37.700766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06135039-4002-4663-9e6a-e10e5600620d service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:37.701043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06135039-4002-4663-9e6a-e10e5600620d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:37.709625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06135039-4002-4663-9e6a-e10e5600620d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:37.711246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06135039-4002-4663-9e6a-e10e5600620d service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:37.719694 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1171/2351] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:29:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:29:38.264514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c2c34-3bae-4df4-bfe4-c9ae22a86763 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:38.264829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c2c34-3bae-4df4-bfe4-c9ae22a86763 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:38.265112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c2c34-3bae-4df4-bfe4-c9ae22a86763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:38.285071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ad6c2c34-3bae-4df4-bfe4-c9ae22a86763 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:38.286441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ad6c2c34-3bae-4df4-bfe4-c9ae22a86763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:38.304621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1181/2352] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:29:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:38.310760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06135039-4002-4663-9e6a-e10e5600620d service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:38.322694 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06135039-4002-4663-9e6a-e10e5600620d service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:38.328572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b3d71-679a-4a31-9831-b229aa22dce5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:38.329373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b3d71-679a-4a31-9831-b229aa22dce5 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:38.329725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b3d71-679a-4a31-9831-b229aa22dce5 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:38.330013 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b3d71-679a-4a31-9831-b229aa22dce5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:38.341164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b3d71-679a-4a31-9831-b229aa22dce5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:38.342957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b3d71-679a-4a31-9831-b229aa22dce5 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:38.355194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1172/2353] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:29:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:29:40.317247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d903fae-e3d0-4a3e-872f-a3f7571fb4c5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:40.318094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d903fae-e3d0-4a3e-872f-a3f7571fb4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:40.318529 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d903fae-e3d0-4a3e-872f-a3f7571fb4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:40.345712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2d903fae-e3d0-4a3e-872f-a3f7571fb4c5 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:40.347474 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2d903fae-e3d0-4a3e-872f-a3f7571fb4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:40.356189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1182/2354] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jul 21 08:29:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:40.370124 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b3d71-679a-4a31-9831-b229aa22dce5 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:40.387050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b3d71-679a-4a31-9831-b229aa22dce5 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:40.396810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf968674-3a28-41a2-871f-7d1701e5a2a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:40.398563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf968674-3a28-41a2-871f-7d1701e5a2a8 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:40.398563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf968674-3a28-41a2-871f-7d1701e5a2a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:40.398563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf968674-3a28-41a2-871f-7d1701e5a2a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:40.418415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf968674-3a28-41a2-871f-7d1701e5a2a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:40.420057 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf968674-3a28-41a2-871f-7d1701e5a2a8 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:40.429934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1173/2355] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:29:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:29:41.600216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82df1-2159-44d8-9f73-89225c138ed2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:41.601149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82df1-2159-44d8-9f73-89225c138ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:41.601419 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82df1-2159-44d8-9f73-89225c138ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:41.629848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f2b82df1-2159-44d8-9f73-89225c138ed2 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:41.631794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f2b82df1-2159-44d8-9f73-89225c138ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:41.678652 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1183/2356] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jul 21 08:29:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:41.714830 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf968674-3a28-41a2-871f-7d1701e5a2a8 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:41.730429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf968674-3a28-41a2-871f-7d1701e5a2a8 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:41.737016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7888436-d77a-4989-8a59-05bfd73a8244 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:41.737863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7888436-d77a-4989-8a59-05bfd73a8244 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:41.738360 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7888436-d77a-4989-8a59-05bfd73a8244 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:41.738737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7888436-d77a-4989-8a59-05bfd73a8244 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:41.750787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7888436-d77a-4989-8a59-05bfd73a8244 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:41.753661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7888436-d77a-4989-8a59-05bfd73a8244 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:41.772255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1174/2357] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:29:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:29:42.237597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac3aa4-1db6-4aa2-a953-ac81b8275045 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:42.239102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac3aa4-1db6-4aa2-a953-ac81b8275045 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:42.239626 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac3aa4-1db6-4aa2-a953-ac81b8275045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:42.278596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a7ac3aa4-1db6-4aa2-a953-ac81b8275045 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:42.280695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a7ac3aa4-1db6-4aa2-a953-ac81b8275045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:42.294341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1184/2358] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:29:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:29:42.329312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7888436-d77a-4989-8a59-05bfd73a8244 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:42.344808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7888436-d77a-4989-8a59-05bfd73a8244 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:42.361679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e8c7e-6d3e-406f-8c8f-0018b8fd13f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:42.362513 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e8c7e-6d3e-406f-8c8f-0018b8fd13f2 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:42.362804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e8c7e-6d3e-406f-8c8f-0018b8fd13f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:42.363082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e8c7e-6d3e-406f-8c8f-0018b8fd13f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:42.384642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e8c7e-6d3e-406f-8c8f-0018b8fd13f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:42.389490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e8c7e-6d3e-406f-8c8f-0018b8fd13f2 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:42.405632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1175/2359] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:29:43.095855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e312fa4-a1c0-4930-8836-0324b8fce030 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:43.096536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e312fa4-a1c0-4930-8836-0324b8fce030 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:43.096536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e312fa4-a1c0-4930-8836-0324b8fce030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:43.148571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4e312fa4-a1c0-4930-8836-0324b8fce030 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:43.149874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4e312fa4-a1c0-4930-8836-0324b8fce030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:43.167182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1185/2360] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jul 21 08:29:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:43.223312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e8c7e-6d3e-406f-8c8f-0018b8fd13f2 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:43.241105 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e8c7e-6d3e-406f-8c8f-0018b8fd13f2 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:43.258172 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3e6a0-35bb-4797-9002-b0253de0397d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:43.259213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3e6a0-35bb-4797-9002-b0253de0397d service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:43.259687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3e6a0-35bb-4797-9002-b0253de0397d service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:43.260665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3e6a0-35bb-4797-9002-b0253de0397d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:43.276442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3e6a0-35bb-4797-9002-b0253de0397d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:43.278110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3e6a0-35bb-4797-9002-b0253de0397d service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:43.339856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1176/2361] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:29:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:29:43.364088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e312fa4-a1c0-4930-8836-0324b8fce030 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:43.366489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4e312fa4-a1c0-4930-8836-0324b8fce030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:43.416785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e312fa4-a1c0-4930-8836-0324b8fce030 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:43.425923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:43.427125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:43.427582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:43.428253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] PATH_INFO: `/v3/users/f65d65ae8af34ee1a812edbb2e630b41` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:43.429920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65d65ae8af34ee1a812edbb2e630b41)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:43.432518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:43.503675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65d65ae8af34ee1a812edbb2e630b41'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:43.514071 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65d65ae8af34ee1a812edbb2e630b41'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:43.524979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65d65ae8af34ee1a812edbb2e630b41'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:43.561055 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65d65ae8af34ee1a812edbb2e630b41'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:43.562835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65d65ae8af34ee1a812edbb2e630b41'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:43.574042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1186/2362] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:29:43 2022] DELETE /identity/v3/users/f65d65ae8af34ee1a812edbb2e630b41 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:29:44.789884 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3e6a0-35bb-4797-9002-b0253de0397d service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:44.820029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3e6a0-35bb-4797-9002-b0253de0397d service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:44.926832 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a638f-0434-4276-99de-2d4f0ffa2d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:44.928370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a638f-0434-4276-99de-2d4f0ffa2d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:44.928981 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a638f-0434-4276-99de-2d4f0ffa2d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:44.929655 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a638f-0434-4276-99de-2d4f0ffa2d3b admin admin] PATH_INFO: `/v3/projects/8b690be94c374751a188e9f112a81f13` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:44.931549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a638f-0434-4276-99de-2d4f0ffa2d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b690be94c374751a188e9f112a81f13)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:44.937574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a638f-0434-4276-99de-2d4f0ffa2d3b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:45.035915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:45.072154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-826a638f-0434-4276-99de-2d4f0ffa2d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b690be94c374751a188e9f112a81f13', 'request_id': 'req-826a638f-0434-4276-99de-2d4f0ffa2d3b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:45.090386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-826a638f-0434-4276-99de-2d4f0ffa2d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b690be94c374751a188e9f112a81f13', 'request_id': 'req-826a638f-0434-4276-99de-2d4f0ffa2d3b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:45.105108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-826a638f-0434-4276-99de-2d4f0ffa2d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b690be94c374751a188e9f112a81f13', 'request_id': 'req-826a638f-0434-4276-99de-2d4f0ffa2d3b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:45.128171 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-826a638f-0434-4276-99de-2d4f0ffa2d3b admin admin] The token cache is being invalidate because project 8b690be94c374751a188e9f112a81f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:29:45.141837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-826a638f-0434-4276-99de-2d4f0ffa2d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:45.144119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-826a638f-0434-4276-99de-2d4f0ffa2d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:45.181361 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1177/2363] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:29:44 2022] DELETE /identity/v3/projects/8b690be94c374751a188e9f112a81f13 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:29:46.480574 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:46.483052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:46.525258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2b525-64dc-4f5e-95cb-b24c54b223aa admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:46.693280 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:46.694347 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:46.694778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:46.695062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] PATH_INFO: `/v3/users/90ebeb777931402184d9471f86e111ca` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:46.696524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ebeb777931402184d9471f86e111ca)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:46.698773 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:46.765653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:46.783282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ebeb777931402184d9471f86e111ca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:46.799190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ebeb777931402184d9471f86e111ca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:46.828534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ebeb777931402184d9471f86e111ca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:46.855201 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ebeb777931402184d9471f86e111ca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:46.856020 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ebeb777931402184d9471f86e111ca'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:46.872002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1187/2364] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:29:46 2022] DELETE /identity/v3/users/90ebeb777931402184d9471f86e111ca => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:29:46.877674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e499c-4fea-4a30-9d9d-da794d66adbe None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:46.878471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e499c-4fea-4a30-9d9d-da794d66adbe None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:46.879064 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e499c-4fea-4a30-9d9d-da794d66adbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:46.948269 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2c4e499c-4fea-4a30-9d9d-da794d66adbe None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:46.965055 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2c4e499c-4fea-4a30-9d9d-da794d66adbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:47.172654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1178/2365] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:47.181578 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:47.184950 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:47.257460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81893035-ebf0-4257-baf1-e367c30c4509 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:47.261744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab277f8-fbf4-45d1-87fa-c054dabe1fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:47.262532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab277f8-fbf4-45d1-87fa-c054dabe1fdb service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:47.262927 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab277f8-fbf4-45d1-87fa-c054dabe1fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:47.263953 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab277f8-fbf4-45d1-87fa-c054dabe1fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:47.279099 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab277f8-fbf4-45d1-87fa-c054dabe1fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:47.280395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab277f8-fbf4-45d1-87fa-c054dabe1fdb service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:47.295245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1188/2366] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:47.609385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e499c-4fea-4a30-9d9d-da794d66adbe None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:47.610903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2c4e499c-4fea-4a30-9d9d-da794d66adbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:47.641969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e499c-4fea-4a30-9d9d-da794d66adbe None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:47.656427 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:47.658509 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:47.661757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:47.661975 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c admin admin] PATH_INFO: `/v3/projects/a151847750d14a3eaeb4bc84995832db` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:47.663885 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a151847750d14a3eaeb4bc84995832db)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:47.666885 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:47.764980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a151847750d14a3eaeb4bc84995832db', 'request_id': 'req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:47.784484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a151847750d14a3eaeb4bc84995832db', 'request_id': 'req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:47.792402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a151847750d14a3eaeb4bc84995832db', 'request_id': 'req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:47.816074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c admin admin] The token cache is being invalidate because project a151847750d14a3eaeb4bc84995832db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:29:47.818260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:47.819103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9bbd9113-7d43-4a80-9ff8-150bf4d6604c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:47.826118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1179/2367] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:29:47 2022] DELETE /identity/v3/projects/a151847750d14a3eaeb4bc84995832db => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:29:51.137321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab277f8-fbf4-45d1-87fa-c054dabe1fdb service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:51.139313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1ab277f8-fbf4-45d1-87fa-c054dabe1fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:51.158920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab277f8-fbf4-45d1-87fa-c054dabe1fdb service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:51.305296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:51.306915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:51.307454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:51.307828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] PATH_INFO: `/v3/users/8f5bf334c4944925a489d8fa9e7328d0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:51.310543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5bf334c4944925a489d8fa9e7328d0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:51.318484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:51.394985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5bf334c4944925a489d8fa9e7328d0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:51.410657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5bf334c4944925a489d8fa9e7328d0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:51.413664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:51.423812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5bf334c4944925a489d8fa9e7328d0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:51.440919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5bf334c4944925a489d8fa9e7328d0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:51.441657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5bf334c4944925a489d8fa9e7328d0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:51.449814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1189/2368] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:29:51 2022] DELETE /identity/v3/users/8f5bf334c4944925a489d8fa9e7328d0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:29:51.454092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974d60-d12c-4c73-9dbc-c7e9ef2062d6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:51.454594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974d60-d12c-4c73-9dbc-c7e9ef2062d6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:51.454844 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974d60-d12c-4c73-9dbc-c7e9ef2062d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:51.482507 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-52974d60-d12c-4c73-9dbc-c7e9ef2062d6 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:51.484159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-52974d60-d12c-4c73-9dbc-c7e9ef2062d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:51.525488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:51.569869 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1180/2369] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:29:51.580420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:51.581989 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:51.662368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9770550-e0f6-47c9-9aeb-9196e8b75e83 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:51.669145 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165957d-e5b7-4816-8744-2b814956b418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:51.669996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165957d-e5b7-4816-8744-2b814956b418 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:51.670473 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165957d-e5b7-4816-8744-2b814956b418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:51.670587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165957d-e5b7-4816-8744-2b814956b418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:51.683945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165957d-e5b7-4816-8744-2b814956b418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:51.685535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165957d-e5b7-4816-8744-2b814956b418 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:51.696960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1190/2370] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:52.239208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974d60-d12c-4c73-9dbc-c7e9ef2062d6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:52.240909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-52974d60-d12c-4c73-9dbc-c7e9ef2062d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:52.279388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974d60-d12c-4c73-9dbc-c7e9ef2062d6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:52.290336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3afb64-85e7-44a0-a290-5cae39c2c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:52.292275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3afb64-85e7-44a0-a290-5cae39c2c090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:52.292588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3afb64-85e7-44a0-a290-5cae39c2c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:52.292869 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3afb64-85e7-44a0-a290-5cae39c2c090 admin admin] PATH_INFO: `/v3/projects/d41249482c824463b6d15daa12e5e777` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:52.300851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3afb64-85e7-44a0-a290-5cae39c2c090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41249482c824463b6d15daa12e5e777)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:52.300851 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3afb64-85e7-44a0-a290-5cae39c2c090 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:52.476112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ac3afb64-85e7-44a0-a290-5cae39c2c090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41249482c824463b6d15daa12e5e777', 'request_id': 'req-ac3afb64-85e7-44a0-a290-5cae39c2c090'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:52.503126 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ac3afb64-85e7-44a0-a290-5cae39c2c090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41249482c824463b6d15daa12e5e777', 'request_id': 'req-ac3afb64-85e7-44a0-a290-5cae39c2c090'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:52.518654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ac3afb64-85e7-44a0-a290-5cae39c2c090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41249482c824463b6d15daa12e5e777', 'request_id': 'req-ac3afb64-85e7-44a0-a290-5cae39c2c090'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:52.541713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ac3afb64-85e7-44a0-a290-5cae39c2c090 admin admin] The token cache is being invalidate because project d41249482c824463b6d15daa12e5e777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:29:52.542008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ac3afb64-85e7-44a0-a290-5cae39c2c090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:52.542689 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ac3afb64-85e7-44a0-a290-5cae39c2c090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:29:52.547838 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1181/2371] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:29:52 2022] DELETE /identity/v3/projects/d41249482c824463b6d15daa12e5e777 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:29:52.549820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0cd91-753c-44ec-92d8-a1956a47862e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:52.550312 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0cd91-753c-44ec-92d8-a1956a47862e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:52.551036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0cd91-753c-44ec-92d8-a1956a47862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:52.586960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0bb0cd91-753c-44ec-92d8-a1956a47862e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:52.597049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0bb0cd91-753c-44ec-92d8-a1956a47862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:52.797163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1191/2372] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:52.907812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a129c-f3e3-4a27-b1cf-5dd011f33e0b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:52.908115 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a129c-f3e3-4a27-b1cf-5dd011f33e0b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:52.908418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a129c-f3e3-4a27-b1cf-5dd011f33e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:52.946599 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-755a129c-f3e3-4a27-b1cf-5dd011f33e0b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:52.947756 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-755a129c-f3e3-4a27-b1cf-5dd011f33e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:52.957845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1182/2373] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:52.962450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0cd91-753c-44ec-92d8-a1956a47862e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:52.980063 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0cd91-753c-44ec-92d8-a1956a47862e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:52.997953 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa5f3-0115-4215-a121-6a13fa9a7978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:52.998734 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa5f3-0115-4215-a121-6a13fa9a7978 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:52.999090 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa5f3-0115-4215-a121-6a13fa9a7978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:52.999437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa5f3-0115-4215-a121-6a13fa9a7978 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:53.000267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fa5f3-0115-4215-a121-6a13fa9a7978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:29:53.000684 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fa5f3-0115-4215-a121-6a13fa9a7978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:53.003265 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fa5f3-0115-4215-a121-6a13fa9a7978 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:53.039680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1192/2374] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:29:53.043107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a129c-f3e3-4a27-b1cf-5dd011f33e0b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:53.056273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a129c-f3e3-4a27-b1cf-5dd011f33e0b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:53.069579 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d175c7d-9036-41a2-9b2b-fa84d8dbd5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:53.079208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d175c7d-9036-41a2-9b2b-fa84d8dbd5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:53.079627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d175c7d-9036-41a2-9b2b-fa84d8dbd5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:53.079918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d175c7d-9036-41a2-9b2b-fa84d8dbd5c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:53.080777 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d175c7d-9036-41a2-9b2b-fa84d8dbd5c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:53.083451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d175c7d-9036-41a2-9b2b-fa84d8dbd5c4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:53.137015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa5f3-0115-4215-a121-6a13fa9a7978 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:53.153686 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1183/2375] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:29:53 2022] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:29:53.159916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa5f3-0115-4215-a121-6a13fa9a7978 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:53.254061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa19e8-cdd7-4acc-9146-f44c66b3a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:53.254773 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa19e8-cdd7-4acc-9146-f44c66b3a67f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:53.255059 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa19e8-cdd7-4acc-9146-f44c66b3a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:53.255336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa19e8-cdd7-4acc-9146-f44c66b3a67f admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:53.257538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa19e8-cdd7-4acc-9146-f44c66b3a67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:53.259660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa19e8-cdd7-4acc-9146-f44c66b3a67f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:53.284021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:53.313698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1193/2376] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:29:53 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:29:53.316390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d175c7d-9036-41a2-9b2b-fa84d8dbd5c4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:53.337088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d175c7d-9036-41a2-9b2b-fa84d8dbd5c4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:53.343983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0a94-4e5e-4936-a886-d15ed080aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:53.345315 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0a94-4e5e-4936-a886-d15ed080aed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:53.345849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0a94-4e5e-4936-a886-d15ed080aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:53.346530 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0a94-4e5e-4936-a886-d15ed080aed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:53.347537 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b0a94-4e5e-4936-a886-d15ed080aed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:53.349920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b0a94-4e5e-4936-a886-d15ed080aed5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:53.365322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1184/2377] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:29:53.371244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa19e8-cdd7-4acc-9146-f44c66b3a67f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:53.396342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa19e8-cdd7-4acc-9146-f44c66b3a67f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:53.406201 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a369569-d1af-4ee7-803e-b602db958d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:53.407272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a369569-d1af-4ee7-803e-b602db958d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:53.407518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a369569-d1af-4ee7-803e-b602db958d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:53.407933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a369569-d1af-4ee7-803e-b602db958d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:53.408886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a369569-d1af-4ee7-803e-b602db958d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:53.410764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a369569-d1af-4ee7-803e-b602db958d96 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:53.439454 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0a94-4e5e-4936-a886-d15ed080aed5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:53.444081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1194/2378] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:29:53.457177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0a94-4e5e-4936-a886-d15ed080aed5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:53.466477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c797a-1718-45e0-ba7a-1056c3a32b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:53.470824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c797a-1718-45e0-ba7a-1056c3a32b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:53.471232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c797a-1718-45e0-ba7a-1056c3a32b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:53.471601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c797a-1718-45e0-ba7a-1056c3a32b70 admin admin] PATH_INFO: `/v3/projects/9631c81e8e2a491894ccbfb61f9a531f/users/1f2bd8cf70654a5e8113f33dfa23cb57/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:53.516389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c797a-1718-45e0-ba7a-1056c3a32b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9631c81e8e2a491894ccbfb61f9a531f, user_id=1f2bd8cf70654a5e8113f33dfa23cb57, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:53.519817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c797a-1718-45e0-ba7a-1056c3a32b70 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:53.545964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1185/2379] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:29:53 2022] PUT /identity/v3/projects/9631c81e8e2a491894ccbfb61f9a531f/users/1f2bd8cf70654a5e8113f33dfa23cb57/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:29:53.556168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef1d53-b6c1-4d28-b9a4-c2cba8928cf6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:53.556751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef1d53-b6c1-4d28-b9a4-c2cba8928cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:53.556751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef1d53-b6c1-4d28-b9a4-c2cba8928cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:53.612554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bdef1d53-b6c1-4d28-b9a4-c2cba8928cf6 None None] MFA Rules not processed for user `1f2bd8cf70654a5e8113f33dfa23cb57`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:53.616149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bdef1d53-b6c1-4d28-b9a4-c2cba8928cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:53.738746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1195/2380] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:29:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:53.750642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c797a-1718-45e0-ba7a-1056c3a32b70 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:53.752581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-601c797a-1718-45e0-ba7a-1056c3a32b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:53.854837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c797a-1718-45e0-ba7a-1056c3a32b70 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:53.859754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56789e6d-7fbb-4ed6-bd11-a249fbcf5f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:53.860554 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56789e6d-7fbb-4ed6-bd11-a249fbcf5f14 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:53.860905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56789e6d-7fbb-4ed6-bd11-a249fbcf5f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:53.861254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56789e6d-7fbb-4ed6-bd11-a249fbcf5f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:53.876421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56789e6d-7fbb-4ed6-bd11-a249fbcf5f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:53.878176 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56789e6d-7fbb-4ed6-bd11-a249fbcf5f14 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:53.889875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1186/2381] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:01.720009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef1d53-b6c1-4d28-b9a4-c2cba8928cf6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:01.722190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bdef1d53-b6c1-4d28-b9a4-c2cba8928cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:01.802280 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef1d53-b6c1-4d28-b9a4-c2cba8928cf6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:01.807467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d20fd-2efd-4f69-8332-1122abf80290 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd9ea435d7b48cb8b1b2a27d79cfa91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:01.808121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d20fd-2efd-4f69-8332-1122abf80290 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:01.808402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d20fd-2efd-4f69-8332-1122abf80290 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:01.808702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d20fd-2efd-4f69-8332-1122abf80290 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:01.810547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-821d20fd-2efd-4f69-8332-1122abf80290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:01.822132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d20fd-2efd-4f69-8332-1122abf80290 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:01.823744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d20fd-2efd-4f69-8332-1122abf80290 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:01.833869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1196/2382] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:03.085728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f82093-31ff-4b4b-9419-aabb64ce60d4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:03.086213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f82093-31ff-4b4b-9419-aabb64ce60d4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:03.086296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f82093-31ff-4b4b-9419-aabb64ce60d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:03.096641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:03.117070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-18f82093-31ff-4b4b-9419-aabb64ce60d4 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:03.118281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-18f82093-31ff-4b4b-9419-aabb64ce60d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:03.191221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1187/2383] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Jul 21 08:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:03.215653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d20fd-2efd-4f69-8332-1122abf80290 service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:03.217467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-821d20fd-2efd-4f69-8332-1122abf80290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:03.311525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:03.335649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056a346-086d-46d3-baa4-b1b5a39e7839 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:03.336051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056a346-086d-46d3-baa4-b1b5a39e7839 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:03.336486 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056a346-086d-46d3-baa4-b1b5a39e7839 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:03.338154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1188/2384] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:03.345530 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fb404-45f5-4027-bd9d-90dc8a7d0eb6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:03.346222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fb404-45f5-4027-bd9d-90dc8a7d0eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:03.346731 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fb404-45f5-4027-bd9d-90dc8a7d0eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:03.357842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d20fd-2efd-4f69-8332-1122abf80290 service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:03.364189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0ef0d-f6ad-459a-b31b-1e2e774ff3b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:03.364933 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0ef0d-f6ad-459a-b31b-1e2e774ff3b3 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:03.365212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0ef0d-f6ad-459a-b31b-1e2e774ff3b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:03.365486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0ef0d-f6ad-459a-b31b-1e2e774ff3b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:03.371113 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2c0fb404-45f5-4027-bd9d-90dc8a7d0eb6 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:03.372857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2c0fb404-45f5-4027-bd9d-90dc8a7d0eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:03.378492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0ef0d-f6ad-459a-b31b-1e2e774ff3b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:03.380247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0ef0d-f6ad-459a-b31b-1e2e774ff3b3 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:03.386853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1189/2385] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:30:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:03.396317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1197/2386] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:03.415924 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fb404-45f5-4027-bd9d-90dc8a7d0eb6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:03.417587 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2c0fb404-45f5-4027-bd9d-90dc8a7d0eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:03.487750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fb404-45f5-4027-bd9d-90dc8a7d0eb6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:03.492276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff6388-3a8e-4152-8495-510c9d4ecd8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f9a6f6d6d840d6bc29fd0ab26ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:03.492906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff6388-3a8e-4152-8495-510c9d4ecd8f service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:03.493185 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff6388-3a8e-4152-8495-510c9d4ecd8f service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:03.493467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff6388-3a8e-4152-8495-510c9d4ecd8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:03.506390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff6388-3a8e-4152-8495-510c9d4ecd8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:03.508044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff6388-3a8e-4152-8495-510c9d4ecd8f service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:03.521483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1190/2387] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:30:03.611650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbc003-99e1-40a5-8082-c9666bdc57ff None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:03.611962 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbc003-99e1-40a5-8082-c9666bdc57ff None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:03.612245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbc003-99e1-40a5-8082-c9666bdc57ff None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:03.613830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1198/2388] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:30:03.618790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b5009-85e0-4e28-9c64-88fef06029d4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:03.619084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b5009-85e0-4e28-9c64-88fef06029d4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:03.619477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b5009-85e0-4e28-9c64-88fef06029d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:03.639800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-826b5009-85e0-4e28-9c64-88fef06029d4 None None] MFA Rules not processed for user `06a267cec6fb4dbea619f0a77b5674dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:03.641074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-826b5009-85e0-4e28-9c64-88fef06029d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:03.698719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1191/2389] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:30:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:03.710738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbc003-99e1-40a5-8082-c9666bdc57ff None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:03.712686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e3bbc003-99e1-40a5-8082-c9666bdc57ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:03.727621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbc003-99e1-40a5-8082-c9666bdc57ff None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:03.731554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e681c-433d-4baf-824e-d822371e5318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:03.732244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e681c-433d-4baf-824e-d822371e5318 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:03.732514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e681c-433d-4baf-824e-d822371e5318 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:03.732822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e681c-433d-4baf-824e-d822371e5318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:03.740281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e681c-433d-4baf-824e-d822371e5318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:03.741765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e681c-433d-4baf-824e-d822371e5318 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:03.749782 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1199/2390] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:03.841094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b305a4-1663-4d10-91f0-d8bc8403af85 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:03.841406 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b305a4-1663-4d10-91f0-d8bc8403af85 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:03.841684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b305a4-1663-4d10-91f0-d8bc8403af85 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:03.843101 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1192/2391] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:03.849242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ce25f-c74f-4285-bcb6-4a71b415e198 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:03.849566 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ce25f-c74f-4285-bcb6-4a71b415e198 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:03.849838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ce25f-c74f-4285-bcb6-4a71b415e198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:03.868798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-721ce25f-c74f-4285-bcb6-4a71b415e198 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:03.870012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-721ce25f-c74f-4285-bcb6-4a71b415e198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:03.880767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1200/2392] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:30:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:03.894207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b305a4-1663-4d10-91f0-d8bc8403af85 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:03.907940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b305a4-1663-4d10-91f0-d8bc8403af85 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:03.911725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac4558-210e-4469-8f81-a9f78bfcb1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:03.912375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac4558-210e-4469-8f81-a9f78bfcb1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:03.912685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac4558-210e-4469-8f81-a9f78bfcb1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:03.912963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac4558-210e-4469-8f81-a9f78bfcb1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:03.926682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac4558-210e-4469-8f81-a9f78bfcb1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:03.928215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac4558-210e-4469-8f81-a9f78bfcb1d7 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:03.939894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1193/2393] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:04.445479 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ce25f-c74f-4285-bcb6-4a71b415e198 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:04.456734 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ce25f-c74f-4285-bcb6-4a71b415e198 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:04.461984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:04.462894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:04.463174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:04.463451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] PATH_INFO: `/v3/users/1f2bd8cf70654a5e8113f33dfa23cb57` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:04.464728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f2bd8cf70654a5e8113f33dfa23cb57)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:04.466660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:04.521234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f2bd8cf70654a5e8113f33dfa23cb57'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:04.530802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f2bd8cf70654a5e8113f33dfa23cb57'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:04.538757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f2bd8cf70654a5e8113f33dfa23cb57'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:04.552688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f2bd8cf70654a5e8113f33dfa23cb57'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:04.553764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f2bd8cf70654a5e8113f33dfa23cb57'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:04.563649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1201/2394] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:30:04 2022] DELETE /identity/v3/users/1f2bd8cf70654a5e8113f33dfa23cb57 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:04.568304 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60185b-f4ed-4f5f-96a1-794dbefded87 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:04.568806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60185b-f4ed-4f5f-96a1-794dbefded87 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:04.569524 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60185b-f4ed-4f5f-96a1-794dbefded87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:04.587383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5a60185b-f4ed-4f5f-96a1-794dbefded87 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:04.588757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5a60185b-f4ed-4f5f-96a1-794dbefded87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:04.620285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:04.650270 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1194/2395] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:04.660372 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:04.662081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:04.724158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a449ea-700d-434d-957b-a88d247a6291 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:04.727777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05622d6-c305-4866-ba85-7193e4c875d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:04.728426 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05622d6-c305-4866-ba85-7193e4c875d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:04.728733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05622d6-c305-4866-ba85-7193e4c875d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:04.728996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05622d6-c305-4866-ba85-7193e4c875d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:04.740290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05622d6-c305-4866-ba85-7193e4c875d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:04.741851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05622d6-c305-4866-ba85-7193e4c875d7 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:04.753637 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1202/2396] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:05.038429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60185b-f4ed-4f5f-96a1-794dbefded87 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:05.039987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5a60185b-f4ed-4f5f-96a1-794dbefded87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:05.052395 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60185b-f4ed-4f5f-96a1-794dbefded87 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:05.057061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:05.057941 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:05.058223 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:05.058494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3 admin admin] PATH_INFO: `/v3/projects/9631c81e8e2a491894ccbfb61f9a531f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:05.059815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9631c81e8e2a491894ccbfb61f9a531f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:05.061796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:05.113581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9631c81e8e2a491894ccbfb61f9a531f', 'request_id': 'req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:05.122648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9631c81e8e2a491894ccbfb61f9a531f', 'request_id': 'req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:05.129174 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9631c81e8e2a491894ccbfb61f9a531f', 'request_id': 'req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:05.143048 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3 admin admin] The token cache is being invalidate because project 9631c81e8e2a491894ccbfb61f9a531f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:30:05.143584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:05.144809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d6d9e7f-ce59-4dfa-8b1a-6cbdbfa3fab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:30:05.147563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1195/2397] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:30:05 2022] DELETE /identity/v3/projects/9631c81e8e2a491894ccbfb61f9a531f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:30:06.755290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05622d6-c305-4866-ba85-7193e4c875d7 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:06.756958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a05622d6-c305-4866-ba85-7193e4c875d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:06.769314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05622d6-c305-4866-ba85-7193e4c875d7 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:06.815487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:06.827535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc7f3-174f-40c2-aca4-18e92d90ce94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:06.828398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc7f3-174f-40c2-aca4-18e92d90ce94 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:06.828714 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc7f3-174f-40c2-aca4-18e92d90ce94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:06.828993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc7f3-174f-40c2-aca4-18e92d90ce94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:06.831358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b91bc7f3-174f-40c2-aca4-18e92d90ce94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:06.897656 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bc7f3-174f-40c2-aca4-18e92d90ce94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:06.899115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bc7f3-174f-40c2-aca4-18e92d90ce94 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:06.909884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1203/2398] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:06 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:07.443654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def37e34-5f08-4952-865d-b5c68c97941d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:07.444262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def37e34-5f08-4952-865d-b5c68c97941d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:07.444262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def37e34-5f08-4952-865d-b5c68c97941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:07.463677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-def37e34-5f08-4952-865d-b5c68c97941d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:07.464942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-def37e34-5f08-4952-865d-b5c68c97941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:07.530581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1196/2399] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Jul 21 08:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:07.552168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc7f3-174f-40c2-aca4-18e92d90ce94 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:07.553739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b91bc7f3-174f-40c2-aca4-18e92d90ce94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:07.648057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc7f3-174f-40c2-aca4-18e92d90ce94 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:07.654313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d9359-216f-4dde-a7fd-2c16bb6d5542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:07.655591 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d9359-216f-4dde-a7fd-2c16bb6d5542 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:07.655892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d9359-216f-4dde-a7fd-2c16bb6d5542 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:07.656250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d9359-216f-4dde-a7fd-2c16bb6d5542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:07.669823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d9359-216f-4dde-a7fd-2c16bb6d5542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:07.671538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d9359-216f-4dde-a7fd-2c16bb6d5542 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:07.684075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1204/2400] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:10.247562 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dce523-0f4d-4fc4-b9b4-5a7e4ebf8380 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:10.248061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dce523-0f4d-4fc4-b9b4-5a7e4ebf8380 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:10.248149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dce523-0f4d-4fc4-b9b4-5a7e4ebf8380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:10.266911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d1dce523-0f4d-4fc4-b9b4-5a7e4ebf8380 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:10.268180 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d1dce523-0f4d-4fc4-b9b4-5a7e4ebf8380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:10.335412 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1197/2401] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:30:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:10.360669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d9359-216f-4dde-a7fd-2c16bb6d5542 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:10.362745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-305d9359-216f-4dde-a7fd-2c16bb6d5542 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:10.437288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d9359-216f-4dde-a7fd-2c16bb6d5542 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:10.443843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026e501-5da2-4e53-a92f-538f4cbf7be1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:10.444534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026e501-5da2-4e53-a92f-538f4cbf7be1 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:10.444866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026e501-5da2-4e53-a92f-538f4cbf7be1 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:10.445140 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026e501-5da2-4e53-a92f-538f4cbf7be1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:10.454945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026e501-5da2-4e53-a92f-538f4cbf7be1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:10.456785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026e501-5da2-4e53-a92f-538f4cbf7be1 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:10.465487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1205/2402] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:30:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:30:10.499376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381ea74-3f4d-4485-b5c2-6a93676548a6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:10.499669 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381ea74-3f4d-4485-b5c2-6a93676548a6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:10.499955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381ea74-3f4d-4485-b5c2-6a93676548a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:10.509422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:10.523282 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1381ea74-3f4d-4485-b5c2-6a93676548a6 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:10.526295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1381ea74-3f4d-4485-b5c2-6a93676548a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:10.537108 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1198/2403] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Jul 21 08:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:10.577204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026e501-5da2-4e53-a92f-538f4cbf7be1 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:10.595239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026e501-5da2-4e53-a92f-538f4cbf7be1 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:10.604820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e1883-dfb2-40c0-a2f4-ae6bd6223441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:10.606175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e1883-dfb2-40c0-a2f4-ae6bd6223441 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:10.606474 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e1883-dfb2-40c0-a2f4-ae6bd6223441 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:10.606931 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e1883-dfb2-40c0-a2f4-ae6bd6223441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:10.615497 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:10.623836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e1883-dfb2-40c0-a2f4-ae6bd6223441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:10.627445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e1883-dfb2-40c0-a2f4-ae6bd6223441 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:10.643979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1206/2404] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:20.530153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:20.637046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:27.089131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a7e2c-943a-400e-aa9e-6e8842392412 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:27.089728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a7e2c-943a-400e-aa9e-6e8842392412 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:27.089728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a7e2c-943a-400e-aa9e-6e8842392412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:27.113146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a91a7e2c-943a-400e-aa9e-6e8842392412 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:27.114381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a91a7e2c-943a-400e-aa9e-6e8842392412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:27.124280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1199/2405] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Jul 21 08:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:27.165892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e1883-dfb2-40c0-a2f4-ae6bd6223441 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:27.167440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d19e1883-dfb2-40c0-a2f4-ae6bd6223441 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:27.183018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e1883-dfb2-40c0-a2f4-ae6bd6223441 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:27.189966 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26608427-27c1-4985-83ee-8026d2771d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:27.190736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26608427-27c1-4985-83ee-8026d2771d43 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:27.191007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26608427-27c1-4985-83ee-8026d2771d43 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:27.191288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26608427-27c1-4985-83ee-8026d2771d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:27.200009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26608427-27c1-4985-83ee-8026d2771d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:27.201679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26608427-27c1-4985-83ee-8026d2771d43 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:27.212527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1207/2406] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:31.225660 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff5dfa-a9d0-4807-8d4c-c467ebf0f8a0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:31.226302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff5dfa-a9d0-4807-8d4c-c467ebf0f8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:31.226302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff5dfa-a9d0-4807-8d4c-c467ebf0f8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:31.245348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4fff5dfa-a9d0-4807-8d4c-c467ebf0f8a0 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:31.246652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4fff5dfa-a9d0-4807-8d4c-c467ebf0f8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:31.254198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1200/2407] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jul 21 08:30:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:31.267318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26608427-27c1-4985-83ee-8026d2771d43 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:31.278886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26608427-27c1-4985-83ee-8026d2771d43 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:31.283883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf12d06-b832-4604-b11a-df5b669e46e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:31.284584 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf12d06-b832-4604-b11a-df5b669e46e4 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:31.284869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf12d06-b832-4604-b11a-df5b669e46e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:31.285143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf12d06-b832-4604-b11a-df5b669e46e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:31.294240 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf12d06-b832-4604-b11a-df5b669e46e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:31.295863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf12d06-b832-4604-b11a-df5b669e46e4 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:31.305767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1208/2408] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:30:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:30:32.320132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b43cb-95bb-47d3-9606-38524d10220e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:32.320693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b43cb-95bb-47d3-9606-38524d10220e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:32.320950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b43cb-95bb-47d3-9606-38524d10220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:32.341214 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-978b43cb-95bb-47d3-9606-38524d10220e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:32.342546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-978b43cb-95bb-47d3-9606-38524d10220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:32.351589 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1201/2409] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Jul 21 08:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:32.373352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf12d06-b832-4604-b11a-df5b669e46e4 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:32.386587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf12d06-b832-4604-b11a-df5b669e46e4 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:32.394790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c9238-b862-4210-862a-51edb7cc1e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:32.395464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c9238-b862-4210-862a-51edb7cc1e38 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:32.395810 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c9238-b862-4210-862a-51edb7cc1e38 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:32.396141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c9238-b862-4210-862a-51edb7cc1e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:32.405586 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c9238-b862-4210-862a-51edb7cc1e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:32.407184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c9238-b862-4210-862a-51edb7cc1e38 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:32.418394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1209/2410] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:42.335441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=9 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:42.413456 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=18 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:02.142041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b43cb-95bb-47d3-9606-38524d10220e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:02.144222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-978b43cb-95bb-47d3-9606-38524d10220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.158144 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b43cb-95bb-47d3-9606-38524d10220e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:02.163400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1ffc6-3045-478d-8c5c-4ea82369681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:02.164352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1ffc6-3045-478d-8c5c-4ea82369681c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.164470 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1ffc6-3045-478d-8c5c-4ea82369681c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.165094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1ffc6-3045-478d-8c5c-4ea82369681c admin admin] PATH_INFO: `/v3/users/66c7e12c0b5a42aa80742e69bfa7bbf8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.166287 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1ffc6-3045-478d-8c5c-4ea82369681c admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c7e12c0b5a42aa80742e69bfa7bbf8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:02.168355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1ffc6-3045-478d-8c5c-4ea82369681c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:02.237679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1ca1ffc6-3045-478d-8c5c-4ea82369681c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c7e12c0b5a42aa80742e69bfa7bbf8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.245874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1ca1ffc6-3045-478d-8c5c-4ea82369681c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c7e12c0b5a42aa80742e69bfa7bbf8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.259294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1ca1ffc6-3045-478d-8c5c-4ea82369681c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c7e12c0b5a42aa80742e69bfa7bbf8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.260073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1ca1ffc6-3045-478d-8c5c-4ea82369681c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c7e12c0b5a42aa80742e69bfa7bbf8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.260793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1ca1ffc6-3045-478d-8c5c-4ea82369681c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c7e12c0b5a42aa80742e69bfa7bbf8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.277282 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1202/2411] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:31:02 2022] DELETE /identity/v3/users/66c7e12c0b5a42aa80742e69bfa7bbf8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:02.478003 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c9238-b862-4210-862a-51edb7cc1e38 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:02.488764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c9238-b862-4210-862a-51edb7cc1e38 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:02.557663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734847e7-4a8b-4600-9964-d10880ebd894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:02.558468 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734847e7-4a8b-4600-9964-d10880ebd894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.558737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734847e7-4a8b-4600-9964-d10880ebd894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.559012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734847e7-4a8b-4600-9964-d10880ebd894 admin admin] PATH_INFO: `/v3/projects/605630ab17a04907bc7f5c916a3f4603` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.560247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734847e7-4a8b-4600-9964-d10880ebd894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=605630ab17a04907bc7f5c916a3f4603)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:02.562267 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734847e7-4a8b-4600-9964-d10880ebd894 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:02.628452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-734847e7-4a8b-4600-9964-d10880ebd894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605630ab17a04907bc7f5c916a3f4603', 'request_id': 'req-734847e7-4a8b-4600-9964-d10880ebd894'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.635398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-734847e7-4a8b-4600-9964-d10880ebd894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605630ab17a04907bc7f5c916a3f4603', 'request_id': 'req-734847e7-4a8b-4600-9964-d10880ebd894'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.642184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-734847e7-4a8b-4600-9964-d10880ebd894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605630ab17a04907bc7f5c916a3f4603', 'request_id': 'req-734847e7-4a8b-4600-9964-d10880ebd894'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.656016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-734847e7-4a8b-4600-9964-d10880ebd894 admin admin] The token cache is being invalidate because project 605630ab17a04907bc7f5c916a3f4603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:31:02.656337 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-734847e7-4a8b-4600-9964-d10880ebd894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.657031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-734847e7-4a8b-4600-9964-d10880ebd894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:31:02.658633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1210/2412] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:31:02 2022] DELETE /identity/v3/projects/605630ab17a04907bc7f5c916a3f4603 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:02.664023 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568799b2-6aed-4db0-8c6e-b038c430a636 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.664316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568799b2-6aed-4db0-8c6e-b038c430a636 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.664651 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568799b2-6aed-4db0-8c6e-b038c430a636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.686597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-568799b2-6aed-4db0-8c6e-b038c430a636 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:02.687886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-568799b2-6aed-4db0-8c6e-b038c430a636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.754957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1203/2413] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:02.824824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422055ae-1865-4930-b48d-f478f92b5233 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.825059 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422055ae-1865-4930-b48d-f478f92b5233 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.825458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422055ae-1865-4930-b48d-f478f92b5233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.846510 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-422055ae-1865-4930-b48d-f478f92b5233 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:02.847789 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-422055ae-1865-4930-b48d-f478f92b5233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.856530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1211/2414] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:02.861449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568799b2-6aed-4db0-8c6e-b038c430a636 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:02.872242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568799b2-6aed-4db0-8c6e-b038c430a636 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:02.877411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f858c71-2c91-45da-99b4-2aa77a497ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:02.878102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f858c71-2c91-45da-99b4-2aa77a497ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.878386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f858c71-2c91-45da-99b4-2aa77a497ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.878665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f858c71-2c91-45da-99b4-2aa77a497ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.879422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f858c71-2c91-45da-99b4-2aa77a497ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:31:02.879728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f858c71-2c91-45da-99b4-2aa77a497ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:02.881413 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f858c71-2c91-45da-99b4-2aa77a497ae6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:02.895499 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1204/2415] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:31:02.901277 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422055ae-1865-4930-b48d-f478f92b5233 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:02.911941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422055ae-1865-4930-b48d-f478f92b5233 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:02.916820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ac74a-10fe-422b-8f2c-1f3e725f68f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:02.917495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ac74a-10fe-422b-8f2c-1f3e725f68f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.917765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ac74a-10fe-422b-8f2c-1f3e725f68f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.918043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ac74a-10fe-422b-8f2c-1f3e725f68f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.918737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ac74a-10fe-422b-8f2c-1f3e725f68f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:02.920720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ac74a-10fe-422b-8f2c-1f3e725f68f4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:02.949337 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1212/2416] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:02 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:02.954279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f858c71-2c91-45da-99b4-2aa77a497ae6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:02.965148 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f858c71-2c91-45da-99b4-2aa77a497ae6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:03.034154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb666824-e8db-4d35-b00f-85d35690e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:03.034853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb666824-e8db-4d35-b00f-85d35690e959 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.035132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb666824-e8db-4d35-b00f-85d35690e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.035523 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb666824-e8db-4d35-b00f-85d35690e959 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.036116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb666824-e8db-4d35-b00f-85d35690e959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:03.038137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb666824-e8db-4d35-b00f-85d35690e959 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:03.045546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:03.062502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1205/2417] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:02 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:31:03.066560 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ac74a-10fe-422b-8f2c-1f3e725f68f4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:03.077905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ac74a-10fe-422b-8f2c-1f3e725f68f4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:03.082774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d89de2-620e-430d-b8bb-b41fe1708879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:03.083454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d89de2-620e-430d-b8bb-b41fe1708879 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.083729 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d89de2-620e-430d-b8bb-b41fe1708879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.083996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d89de2-620e-430d-b8bb-b41fe1708879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.084767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d89de2-620e-430d-b8bb-b41fe1708879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:03.086672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d89de2-620e-430d-b8bb-b41fe1708879 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:03.101405 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1213/2418] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:03.108050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb666824-e8db-4d35-b00f-85d35690e959 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:03.122393 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb666824-e8db-4d35-b00f-85d35690e959 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:03.127459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32001817-4e9d-4708-9e08-a85b4f158ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:03.128230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32001817-4e9d-4708-9e08-a85b4f158ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.128574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32001817-4e9d-4708-9e08-a85b4f158ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.128856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32001817-4e9d-4708-9e08-a85b4f158ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.129591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32001817-4e9d-4708-9e08-a85b4f158ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:03.131321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32001817-4e9d-4708-9e08-a85b4f158ef7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:03.142861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1206/2419] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:03.147253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d89de2-620e-430d-b8bb-b41fe1708879 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:03.161704 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d89de2-620e-430d-b8bb-b41fe1708879 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:03.168318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28052bc1-0151-48ed-ac5f-dd3d2166687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:03.169309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28052bc1-0151-48ed-ac5f-dd3d2166687a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.169640 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28052bc1-0151-48ed-ac5f-dd3d2166687a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.169910 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28052bc1-0151-48ed-ac5f-dd3d2166687a admin admin] PATH_INFO: `/v3/projects/13f1b3efddab4bc0b0593b06d5898559/users/2c36c4822532468babda677277f345b3/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.188193 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28052bc1-0151-48ed-ac5f-dd3d2166687a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f1b3efddab4bc0b0593b06d5898559, user_id=2c36c4822532468babda677277f345b3, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:03.191015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28052bc1-0151-48ed-ac5f-dd3d2166687a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:03.210032 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1214/2420] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:03 2022] PUT /identity/v3/projects/13f1b3efddab4bc0b0593b06d5898559/users/2c36c4822532468babda677277f345b3/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:03.216231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e00fb-7f74-4064-bb52-b97a606409ef None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.216515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e00fb-7f74-4064-bb52-b97a606409ef None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.217018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e00fb-7f74-4064-bb52-b97a606409ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.236171 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bb0e00fb-7f74-4064-bb52-b97a606409ef None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:03.237495 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bb0e00fb-7f74-4064-bb52-b97a606409ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:03.303623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1207/2421] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:03.314029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28052bc1-0151-48ed-ac5f-dd3d2166687a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:03.316187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-28052bc1-0151-48ed-ac5f-dd3d2166687a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:03.356974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:03.390571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28052bc1-0151-48ed-ac5f-dd3d2166687a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:03.394246 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77133054-9a0f-4be2-b932-c9c04fc06629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:03.394907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77133054-9a0f-4be2-b932-c9c04fc06629 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:03.395188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77133054-9a0f-4be2-b932-c9c04fc06629 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:03.395462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77133054-9a0f-4be2-b932-c9c04fc06629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:03.404909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77133054-9a0f-4be2-b932-c9c04fc06629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:03.406726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77133054-9a0f-4be2-b932-c9c04fc06629 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:03.416408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1215/2422] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:07.864807 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65870b-60a6-4905-889e-cce34bc64429 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.865399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65870b-60a6-4905-889e-cce34bc64429 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.865399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65870b-60a6-4905-889e-cce34bc64429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.902158 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2c65870b-60a6-4905-889e-cce34bc64429 None None] MFA Rules not processed for user `2c36c4822532468babda677277f345b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:07.903468 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2c65870b-60a6-4905-889e-cce34bc64429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:07.992382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1208/2423] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:31:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:07.997081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77133054-9a0f-4be2-b932-c9c04fc06629 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.008795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77133054-9a0f-4be2-b932-c9c04fc06629 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.015316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca82c7-aead-42ae-a680-3ed281468646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.016029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca82c7-aead-42ae-a680-3ed281468646 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.016347 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca82c7-aead-42ae-a680-3ed281468646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.016715 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca82c7-aead-42ae-a680-3ed281468646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.017509 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca82c7-aead-42ae-a680-3ed281468646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.019512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca82c7-aead-42ae-a680-3ed281468646 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.050571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1216/2424] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:31:07 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:31:08.055065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65870b-60a6-4905-889e-cce34bc64429 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.068071 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65870b-60a6-4905-889e-cce34bc64429 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.156321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7096611-902c-4f3a-9400-c625ed9df813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.157086 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7096611-902c-4f3a-9400-c625ed9df813 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.157511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7096611-902c-4f3a-9400-c625ed9df813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.157918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7096611-902c-4f3a-9400-c625ed9df813 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.158814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7096611-902c-4f3a-9400-c625ed9df813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.161033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7096611-902c-4f3a-9400-c625ed9df813 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.183203 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:08.190941 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1209/2425] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:31:08 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:31:08.196955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca82c7-aead-42ae-a680-3ed281468646 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.212647 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca82c7-aead-42ae-a680-3ed281468646 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.219190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e5e4d-3474-48b1-ae6f-e0c371c805f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.220227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5e4d-3474-48b1-ae6f-e0c371c805f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.223035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5e4d-3474-48b1-ae6f-e0c371c805f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.223035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5e4d-3474-48b1-ae6f-e0c371c805f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.223035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e5e4d-3474-48b1-ae6f-e0c371c805f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.224407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e5e4d-3474-48b1-ae6f-e0c371c805f2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.240542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1217/2426] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:08.242557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7096611-902c-4f3a-9400-c625ed9df813 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.254545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7096611-902c-4f3a-9400-c625ed9df813 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.267285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd1510-1207-47dc-89cb-0db5bfc0aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.268382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd1510-1207-47dc-89cb-0db5bfc0aea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.268822 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd1510-1207-47dc-89cb-0db5bfc0aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.269164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd1510-1207-47dc-89cb-0db5bfc0aea8 admin admin] PATH_INFO: `/v3/projects/adbbc4b3d5474ee196cf82be12eeaeee/users/fc9de27217ee4614b5996896735195d8/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.288081 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd1510-1207-47dc-89cb-0db5bfc0aea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbbc4b3d5474ee196cf82be12eeaeee, user_id=fc9de27217ee4614b5996896735195d8, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.294138 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd1510-1207-47dc-89cb-0db5bfc0aea8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.327111 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1210/2427] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:08 2022] PUT /identity/v3/projects/adbbc4b3d5474ee196cf82be12eeaeee/users/fc9de27217ee4614b5996896735195d8/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:31:08.331582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e5e4d-3474-48b1-ae6f-e0c371c805f2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.342895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e5e4d-3474-48b1-ae6f-e0c371c805f2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.422699 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036065-48a0-45f3-a923-e441082a6e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.423520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036065-48a0-45f3-a923-e441082a6e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.423800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036065-48a0-45f3-a923-e441082a6e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.424073 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036065-48a0-45f3-a923-e441082a6e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.425038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2036065-48a0-45f3-a923-e441082a6e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.426695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2036065-48a0-45f3-a923-e441082a6e49 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.441232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1218/2428] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:08.442650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd1510-1207-47dc-89cb-0db5bfc0aea8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.454787 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd1510-1207-47dc-89cb-0db5bfc0aea8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.459821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5935ae2-0ab6-4d1d-942d-1f27c5d5c0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.460785 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5935ae2-0ab6-4d1d-942d-1f27c5d5c0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.461036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5935ae2-0ab6-4d1d-942d-1f27c5d5c0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.461345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5935ae2-0ab6-4d1d-942d-1f27c5d5c0bf admin admin] PATH_INFO: `/v3/projects/adbbc4b3d5474ee196cf82be12eeaeee/users/fc9de27217ee4614b5996896735195d8/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.463464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5935ae2-0ab6-4d1d-942d-1f27c5d5c0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbbc4b3d5474ee196cf82be12eeaeee, user_id=fc9de27217ee4614b5996896735195d8, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.469377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5935ae2-0ab6-4d1d-942d-1f27c5d5c0bf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.477717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1211/2429] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:31:08 2022] PUT /identity/v3/projects/adbbc4b3d5474ee196cf82be12eeaeee/users/fc9de27217ee4614b5996896735195d8/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:31:13.235640 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704976c-b4ee-4e76-b562-12a84b866eab None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.236713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704976c-b4ee-4e76-b562-12a84b866eab None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.237436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704976c-b4ee-4e76-b562-12a84b866eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.276882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b704976c-b4ee-4e76-b562-12a84b866eab None None] MFA Rules not processed for user `fc9de27217ee4614b5996896735195d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:13.278150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b704976c-b4ee-4e76-b562-12a84b866eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:13.389469 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1219/2430] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:31:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:13.402995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5935ae2-0ab6-4d1d-942d-1f27c5d5c0bf admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:13.406159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e5935ae2-0ab6-4d1d-942d-1f27c5d5c0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:13.487084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5935ae2-0ab6-4d1d-942d-1f27c5d5c0bf admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:13.494440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0e47a-a15d-40a1-aaf3-c323bceaa618 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f9a6f6d6d840d6bc29fd0ab26ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:13.495750 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0e47a-a15d-40a1-aaf3-c323bceaa618 service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.496407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0e47a-a15d-40a1-aaf3-c323bceaa618 service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.497291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0e47a-a15d-40a1-aaf3-c323bceaa618 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.580555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0e47a-a15d-40a1-aaf3-c323bceaa618 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:13.582535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0e47a-a15d-40a1-aaf3-c323bceaa618 service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:13.599899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1212/2431] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:13.737628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164c56-1a49-46a1-ad39-77ebdd1b5d81 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.737913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164c56-1a49-46a1-ad39-77ebdd1b5d81 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.738341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164c56-1a49-46a1-ad39-77ebdd1b5d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.758892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-eb164c56-1a49-46a1-ad39-77ebdd1b5d81 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:13.761033 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-eb164c56-1a49-46a1-ad39-77ebdd1b5d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:13.789114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:13.863294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1220/2432] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:31:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:13.897447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0e47a-a15d-40a1-aaf3-c323bceaa618 service glance] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:13.899228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-32f0e47a-a15d-40a1-aaf3-c323bceaa618 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:13.990737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0e47a-a15d-40a1-aaf3-c323bceaa618 service glance] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:13.999126 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d8f97-225f-4d68-beeb-810bcc6a3fac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:14.000116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d8f97-225f-4d68-beeb-810bcc6a3fac service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:14.000763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d8f97-225f-4d68-beeb-810bcc6a3fac service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:14.001054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d8f97-225f-4d68-beeb-810bcc6a3fac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:14.014435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d8f97-225f-4d68-beeb-810bcc6a3fac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:14.016267 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d8f97-225f-4d68-beeb-810bcc6a3fac service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:14.027157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1213/2433] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:31:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:31:15.007484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28a57c-99b7-4666-b68d-a83f9afadd7a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:15.008338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28a57c-99b7-4666-b68d-a83f9afadd7a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:15.009103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28a57c-99b7-4666-b68d-a83f9afadd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:15.085595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bc28a57c-99b7-4666-b68d-a83f9afadd7a None None] MFA Rules not processed for user `212edf0d95bd48b8a3d26a47ccf25f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:15.087960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bc28a57c-99b7-4666-b68d-a83f9afadd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:15.235085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1221/2434] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:31:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:24.023292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:25.222139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=42 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:26.392272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2f8d0-bc31-4fcf-a579-ffb0997b18af None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:26.392782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2f8d0-bc31-4fcf-a579-ffb0997b18af None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:26.393060 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2f8d0-bc31-4fcf-a579-ffb0997b18af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:26.411965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-eef2f8d0-bc31-4fcf-a579-ffb0997b18af None None] MFA Rules not processed for user `2c36c4822532468babda677277f345b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:26.413980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eef2f8d0-bc31-4fcf-a579-ffb0997b18af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:26.421624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1214/2435] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:31:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:26.699837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b7ba2-0fd9-43b6-acac-e04eb1c2c971 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:26.702016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b7ba2-0fd9-43b6-acac-e04eb1c2c971 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:26.702639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b7ba2-0fd9-43b6-acac-e04eb1c2c971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:26.739587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-601b7ba2-0fd9-43b6-acac-e04eb1c2c971 None None] MFA Rules not processed for user `2fc696f590374358aee6e70563219321`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:26.741922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-601b7ba2-0fd9-43b6-acac-e04eb1c2c971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:26.822664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1222/2436] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:31:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:31:28.726546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f467-5702-429a-8eb4-a5ae7492527c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.727163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f467-5702-429a-8eb4-a5ae7492527c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.728366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f467-5702-429a-8eb4-a5ae7492527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.750737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dff0f467-5702-429a-8eb4-a5ae7492527c None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:28.752136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dff0f467-5702-429a-8eb4-a5ae7492527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:28.760804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1215/2437] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:31:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:28.776104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b7ba2-0fd9-43b6-acac-e04eb1c2c971 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:28.791062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b7ba2-0fd9-43b6-acac-e04eb1c2c971 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:28.799977 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8d8dc-edc7-4b70-984d-16c422fd9f96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:28.800806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8d8dc-edc7-4b70-984d-16c422fd9f96 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:28.806279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8d8dc-edc7-4b70-984d-16c422fd9f96 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:28.807231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8d8dc-edc7-4b70-984d-16c422fd9f96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:28.821422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8d8dc-edc7-4b70-984d-16c422fd9f96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:28.825189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8d8dc-edc7-4b70-984d-16c422fd9f96 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:28.839206 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1223/2438] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:31:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:31:32.897218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab1dfc-2686-4b38-89a5-5cadf07d3f9a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:32.897969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab1dfc-2686-4b38-89a5-5cadf07d3f9a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:32.897969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab1dfc-2686-4b38-89a5-5cadf07d3f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:32.917421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-12ab1dfc-2686-4b38-89a5-5cadf07d3f9a None None] MFA Rules not processed for user `402c84b80e4b4996af901e79bf82c4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:32.919107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-12ab1dfc-2686-4b38-89a5-5cadf07d3f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:32.989629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1216/2439] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:31:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:38.833958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=31 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:42.981391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=31 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:52.315048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8d8dc-edc7-4b70-984d-16c422fd9f96 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:52.377630 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8d8dc-edc7-4b70-984d-16c422fd9f96 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:52.381625 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41594325-184f-4e75-b3a2-26873491d902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:52.382342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41594325-184f-4e75-b3a2-26873491d902 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:52.382583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41594325-184f-4e75-b3a2-26873491d902 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:52.382859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41594325-184f-4e75-b3a2-26873491d902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:52.385197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-41594325-184f-4e75-b3a2-26873491d902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:52.464272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41594325-184f-4e75-b3a2-26873491d902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:52.466388 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41594325-184f-4e75-b3a2-26873491d902 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:52.478387 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1224/2440] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:52.679782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab1dfc-2686-4b38-89a5-5cadf07d3f9a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:52.681497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-12ab1dfc-2686-4b38-89a5-5cadf07d3f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:52.696336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab1dfc-2686-4b38-89a5-5cadf07d3f9a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:52.700891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65b2cf-a10f-4d83-8fa4-982f6bf8d5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:52.701791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65b2cf-a10f-4d83-8fa4-982f6bf8d5cf service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:52.702235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65b2cf-a10f-4d83-8fa4-982f6bf8d5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:52.702712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65b2cf-a10f-4d83-8fa4-982f6bf8d5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:52.704957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8a65b2cf-a10f-4d83-8fa4-982f6bf8d5cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:52.722336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65b2cf-a10f-4d83-8fa4-982f6bf8d5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:52.724250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65b2cf-a10f-4d83-8fa4-982f6bf8d5cf service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:52.737809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1217/2441] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:54.190691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41594325-184f-4e75-b3a2-26873491d902 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:54.199869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41594325-184f-4e75-b3a2-26873491d902 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:54.204184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a8b49-0072-45ba-8258-639d7797cb8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:54.204967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a8b49-0072-45ba-8258-639d7797cb8e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.205310 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a8b49-0072-45ba-8258-639d7797cb8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.205547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a8b49-0072-45ba-8258-639d7797cb8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.215427 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a8b49-0072-45ba-8258-639d7797cb8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:54.216947 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a8b49-0072-45ba-8258-639d7797cb8e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:54.229866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1225/2442] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:02.234641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65b2cf-a10f-4d83-8fa4-982f6bf8d5cf service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:02.244656 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65b2cf-a10f-4d83-8fa4-982f6bf8d5cf service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:02.249567 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c19a7-cc1f-49e7-9623-7f1d04d91abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:02.250232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c19a7-cc1f-49e7-9623-7f1d04d91abe service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:02.250646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c19a7-cc1f-49e7-9623-7f1d04d91abe service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:02.250932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c19a7-cc1f-49e7-9623-7f1d04d91abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:02.253103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9e0c19a7-cc1f-49e7-9623-7f1d04d91abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:02.266072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c19a7-cc1f-49e7-9623-7f1d04d91abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:02.267533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c19a7-cc1f-49e7-9623-7f1d04d91abe service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:02.277786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1218/2443] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:04.222805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=60 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:12.273202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=12 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:19.049161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a8b49-0072-45ba-8258-639d7797cb8e service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:19.059019 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a8b49-0072-45ba-8258-639d7797cb8e service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:19.066160 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf3757-9b5f-4cc3-ad47-49a4ecbe0521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:19.067097 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf3757-9b5f-4cc3-ad47-49a4ecbe0521 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:19.067440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf3757-9b5f-4cc3-ad47-49a4ecbe0521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:19.067719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf3757-9b5f-4cc3-ad47-49a4ecbe0521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:19.070954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9dcf3757-9b5f-4cc3-ad47-49a4ecbe0521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:19.171532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf3757-9b5f-4cc3-ad47-49a4ecbe0521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:19.172934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf3757-9b5f-4cc3-ad47-49a4ecbe0521 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:19.185027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1226/2444] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:23.178322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c19a7-cc1f-49e7-9623-7f1d04d91abe service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:23.182253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9e0c19a7-cc1f-49e7-9623-7f1d04d91abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:23.216035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c19a7-cc1f-49e7-9623-7f1d04d91abe service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:23.226996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71374555-0cc7-4a3f-a754-2ce3070581a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:23.228446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71374555-0cc7-4a3f-a754-2ce3070581a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:23.229002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71374555-0cc7-4a3f-a754-2ce3070581a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:23.229501 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71374555-0cc7-4a3f-a754-2ce3070581a5 admin admin] PATH_INFO: `/v3/users/212edf0d95bd48b8a3d26a47ccf25f01` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:23.233057 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71374555-0cc7-4a3f-a754-2ce3070581a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=212edf0d95bd48b8a3d26a47ccf25f01)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:23.237239 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71374555-0cc7-4a3f-a754-2ce3070581a5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:23.326893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-71374555-0cc7-4a3f-a754-2ce3070581a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212edf0d95bd48b8a3d26a47ccf25f01'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:23.346713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-71374555-0cc7-4a3f-a754-2ce3070581a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212edf0d95bd48b8a3d26a47ccf25f01'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:23.362741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-71374555-0cc7-4a3f-a754-2ce3070581a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212edf0d95bd48b8a3d26a47ccf25f01'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:23.363502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-71374555-0cc7-4a3f-a754-2ce3070581a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212edf0d95bd48b8a3d26a47ccf25f01'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:23.364094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-71374555-0cc7-4a3f-a754-2ce3070581a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212edf0d95bd48b8a3d26a47ccf25f01'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:23.383693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1219/2445] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:23 2022] DELETE /identity/v3/users/212edf0d95bd48b8a3d26a47ccf25f01 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:23.591155 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf3757-9b5f-4cc3-ad47-49a4ecbe0521 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:23.605418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf3757-9b5f-4cc3-ad47-49a4ecbe0521 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:23.673166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4608a54-a4e3-4df0-8791-8303e66ba529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:23.674124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4608a54-a4e3-4df0-8791-8303e66ba529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:23.674532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4608a54-a4e3-4df0-8791-8303e66ba529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:23.674922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4608a54-a4e3-4df0-8791-8303e66ba529 admin admin] PATH_INFO: `/v3/projects/3f6c0cd4036744a1b53faf790f6b9ed4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:23.676417 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4608a54-a4e3-4df0-8791-8303e66ba529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6c0cd4036744a1b53faf790f6b9ed4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:23.678688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4608a54-a4e3-4df0-8791-8303e66ba529 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:23.733502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f4608a54-a4e3-4df0-8791-8303e66ba529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6c0cd4036744a1b53faf790f6b9ed4', 'request_id': 'req-f4608a54-a4e3-4df0-8791-8303e66ba529'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:23.740936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f4608a54-a4e3-4df0-8791-8303e66ba529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6c0cd4036744a1b53faf790f6b9ed4', 'request_id': 'req-f4608a54-a4e3-4df0-8791-8303e66ba529'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:23.748068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f4608a54-a4e3-4df0-8791-8303e66ba529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6c0cd4036744a1b53faf790f6b9ed4', 'request_id': 'req-f4608a54-a4e3-4df0-8791-8303e66ba529'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:23.764210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f4608a54-a4e3-4df0-8791-8303e66ba529 admin admin] The token cache is being invalidate because project 3f6c0cd4036744a1b53faf790f6b9ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:23.764527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f4608a54-a4e3-4df0-8791-8303e66ba529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:23.765235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f4608a54-a4e3-4df0-8791-8303e66ba529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:23.766879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1227/2446] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:23 2022] DELETE /identity/v3/projects/3f6c0cd4036744a1b53faf790f6b9ed4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:23.772669 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c406fcb-13b3-4ca9-ba3f-01659b9ed8a4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:23.772991 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c406fcb-13b3-4ca9-ba3f-01659b9ed8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:23.773238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c406fcb-13b3-4ca9-ba3f-01659b9ed8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:23.793483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0c406fcb-13b3-4ca9-ba3f-01659b9ed8a4 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:23.794786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0c406fcb-13b3-4ca9-ba3f-01659b9ed8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:23.866228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1220/2447] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:32:23.874990 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5721e06-85d8-4e8c-9411-86195234f232 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:23.875274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5721e06-85d8-4e8c-9411-86195234f232 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:23.875648 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5721e06-85d8-4e8c-9411-86195234f232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:23.896183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e5721e06-85d8-4e8c-9411-86195234f232 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:23.897447 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e5721e06-85d8-4e8c-9411-86195234f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:23.905960 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1228/2448] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:23.911025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c406fcb-13b3-4ca9-ba3f-01659b9ed8a4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:23.924510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c406fcb-13b3-4ca9-ba3f-01659b9ed8a4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:23.932713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd54a47-9893-4760-98c5-dea0ee4b0017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:23.933815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54a47-9893-4760-98c5-dea0ee4b0017 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:23.934109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54a47-9893-4760-98c5-dea0ee4b0017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:23.934391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54a47-9893-4760-98c5-dea0ee4b0017 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:23.935776 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd54a47-9893-4760-98c5-dea0ee4b0017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:23.936328 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd54a47-9893-4760-98c5-dea0ee4b0017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:23.939687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd54a47-9893-4760-98c5-dea0ee4b0017 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:23.961508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1221/2449] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:32:23.966269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5721e06-85d8-4e8c-9411-86195234f232 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:23.977689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5721e06-85d8-4e8c-9411-86195234f232 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:23.984759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df075e84-829f-45df-99ce-2121767f6050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:23.985833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df075e84-829f-45df-99ce-2121767f6050 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:23.986307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df075e84-829f-45df-99ce-2121767f6050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:23.986790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df075e84-829f-45df-99ce-2121767f6050 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:23.987772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df075e84-829f-45df-99ce-2121767f6050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:23.991123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df075e84-829f-45df-99ce-2121767f6050 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:24.009319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:24.026345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1229/2450] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:23 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:24.031199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd54a47-9893-4760-98c5-dea0ee4b0017 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:24.042175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd54a47-9893-4760-98c5-dea0ee4b0017 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:24.110930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb3f81-63c3-456d-8eb2-1128a71e5a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:24.111628 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3f81-63c3-456d-8eb2-1128a71e5a06 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:24.111910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3f81-63c3-456d-8eb2-1128a71e5a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:24.112189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3f81-63c3-456d-8eb2-1128a71e5a06 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:24.112942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb3f81-63c3-456d-8eb2-1128a71e5a06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:24.114962 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb3f81-63c3-456d-8eb2-1128a71e5a06 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:24.122233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:24.140967 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1222/2451] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:24 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:24.143771 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df075e84-829f-45df-99ce-2121767f6050 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:24.155130 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df075e84-829f-45df-99ce-2121767f6050 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:24.160300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0871aea-3a8c-444f-b1aa-8d6d85f06786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:24.161068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0871aea-3a8c-444f-b1aa-8d6d85f06786 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:24.161391 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0871aea-3a8c-444f-b1aa-8d6d85f06786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:24.161670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0871aea-3a8c-444f-b1aa-8d6d85f06786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:24.162517 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0871aea-3a8c-444f-b1aa-8d6d85f06786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:24.164462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0871aea-3a8c-444f-b1aa-8d6d85f06786 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:24.178403 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1230/2452] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:24.183748 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb3f81-63c3-456d-8eb2-1128a71e5a06 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:24.196666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb3f81-63c3-456d-8eb2-1128a71e5a06 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:24.201679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73af01-f00b-4883-8df2-1bf8f2d16d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:24.202373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73af01-f00b-4883-8df2-1bf8f2d16d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:24.202655 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73af01-f00b-4883-8df2-1bf8f2d16d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:24.202925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73af01-f00b-4883-8df2-1bf8f2d16d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:24.203664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73af01-f00b-4883-8df2-1bf8f2d16d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:24.205370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73af01-f00b-4883-8df2-1bf8f2d16d58 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:24.221684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1223/2453] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:24.227893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0871aea-3a8c-444f-b1aa-8d6d85f06786 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:24.244869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0871aea-3a8c-444f-b1aa-8d6d85f06786 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:24.252342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7a3aa-42fd-43a3-814a-02754e2c548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:24.253663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7a3aa-42fd-43a3-814a-02754e2c548b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:24.254159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7a3aa-42fd-43a3-814a-02754e2c548b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:24.254632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7a3aa-42fd-43a3-814a-02754e2c548b admin admin] PATH_INFO: `/v3/projects/19077b3445614a81b498307943c19e99/users/378b8f4d639648b98b6a33e4dcefc7a7/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:24.278998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7a3aa-42fd-43a3-814a-02754e2c548b admin admin] RBAC: Authorizing `identity:create_grant(project_id=19077b3445614a81b498307943c19e99, user_id=378b8f4d639648b98b6a33e4dcefc7a7, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:24.281912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7a3aa-42fd-43a3-814a-02754e2c548b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:24.307908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1231/2454] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:24 2022] PUT /identity/v3/projects/19077b3445614a81b498307943c19e99/users/378b8f4d639648b98b6a33e4dcefc7a7/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:24.322258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7785a0-0ecc-4397-b4e8-37c55b20d19e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:24.322539 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7785a0-0ecc-4397-b4e8-37c55b20d19e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:24.322819 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7785a0-0ecc-4397-b4e8-37c55b20d19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:24.355143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ba7785a0-0ecc-4397-b4e8-37c55b20d19e None None] MFA Rules not processed for user `378b8f4d639648b98b6a33e4dcefc7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:24.357036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ba7785a0-0ecc-4397-b4e8-37c55b20d19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:24.459584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1224/2455] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:24.474949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7a3aa-42fd-43a3-814a-02754e2c548b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:24.477964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-70a7a3aa-42fd-43a3-814a-02754e2c548b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:24.562803 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7a3aa-42fd-43a3-814a-02754e2c548b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:24.568894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a18f-f9ac-4d3d-9312-5977a01b6a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:24.569525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a18f-f9ac-4d3d-9312-5977a01b6a7c service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:24.569815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a18f-f9ac-4d3d-9312-5977a01b6a7c service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:24.570093 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a18f-f9ac-4d3d-9312-5977a01b6a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:24.579150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6a18f-f9ac-4d3d-9312-5977a01b6a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:24.580847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6a18f-f9ac-4d3d-9312-5977a01b6a7c service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:24.591573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1232/2456] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:24.971891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7785a0-0ecc-4397-b4e8-37c55b20d19e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:25.042241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7785a0-0ecc-4397-b4e8-37c55b20d19e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:25.047225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:25.048094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:25.048408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:25.048707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] PATH_INFO: `/v3/users/378b8f4d639648b98b6a33e4dcefc7a7` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:25.050074 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] RBAC: Authorizing `identity:delete_user(user_id=378b8f4d639648b98b6a33e4dcefc7a7)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:25.052071 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:25.102847 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378b8f4d639648b98b6a33e4dcefc7a7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.110053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378b8f4d639648b98b6a33e4dcefc7a7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.122993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:25.125401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378b8f4d639648b98b6a33e4dcefc7a7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.126187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378b8f4d639648b98b6a33e4dcefc7a7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.127110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378b8f4d639648b98b6a33e4dcefc7a7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.141723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1225/2457] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:24 2022] DELETE /identity/v3/users/378b8f4d639648b98b6a33e4dcefc7a7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:25.146434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17735e4b-d77c-4bbd-ae31-c882446d02f7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:25.146719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17735e4b-d77c-4bbd-ae31-c882446d02f7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:25.147009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17735e4b-d77c-4bbd-ae31-c882446d02f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:25.165778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-17735e4b-d77c-4bbd-ae31-c882446d02f7 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:25.166982 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-17735e4b-d77c-4bbd-ae31-c882446d02f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:25.230201 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1233/2458] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:25.241254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:25.243139 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:25.316019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43314438-a699-41da-b8f4-21c8b900385d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:25.320909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e585b-b477-4530-9e68-32ecc788408f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:25.321572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e585b-b477-4530-9e68-32ecc788408f service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:25.321849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e585b-b477-4530-9e68-32ecc788408f service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:25.322165 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e585b-b477-4530-9e68-32ecc788408f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:25.332947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e585b-b477-4530-9e68-32ecc788408f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:25.334413 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e585b-b477-4530-9e68-32ecc788408f service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:25.344893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1226/2459] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:25.635531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17735e4b-d77c-4bbd-ae31-c882446d02f7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:25.638232 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-17735e4b-d77c-4bbd-ae31-c882446d02f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:25.651238 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17735e4b-d77c-4bbd-ae31-c882446d02f7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:25.656525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c601ee2-defd-4a95-ba29-a06630d78f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:25.657423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601ee2-defd-4a95-ba29-a06630d78f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:25.657705 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601ee2-defd-4a95-ba29-a06630d78f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:25.657979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601ee2-defd-4a95-ba29-a06630d78f67 admin admin] PATH_INFO: `/v3/projects/19077b3445614a81b498307943c19e99` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:25.659266 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c601ee2-defd-4a95-ba29-a06630d78f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19077b3445614a81b498307943c19e99)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:25.661249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c601ee2-defd-4a95-ba29-a06630d78f67 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:25.705887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:25.712642 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9c601ee2-defd-4a95-ba29-a06630d78f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19077b3445614a81b498307943c19e99', 'request_id': 'req-9c601ee2-defd-4a95-ba29-a06630d78f67'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.719653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9c601ee2-defd-4a95-ba29-a06630d78f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19077b3445614a81b498307943c19e99', 'request_id': 'req-9c601ee2-defd-4a95-ba29-a06630d78f67'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.725230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9c601ee2-defd-4a95-ba29-a06630d78f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19077b3445614a81b498307943c19e99', 'request_id': 'req-9c601ee2-defd-4a95-ba29-a06630d78f67'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.738248 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9c601ee2-defd-4a95-ba29-a06630d78f67 admin admin] The token cache is being invalidate because project 19077b3445614a81b498307943c19e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:25.738463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9c601ee2-defd-4a95-ba29-a06630d78f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.739121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9c601ee2-defd-4a95-ba29-a06630d78f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:25.740742 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1234/2460] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:25 2022] DELETE /identity/v3/projects/19077b3445614a81b498307943c19e99 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:25.745834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702d31b-0061-414c-86b7-b9800f312c20 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:25.746150 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702d31b-0061-414c-86b7-b9800f312c20 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:25.746428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702d31b-0061-414c-86b7-b9800f312c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:25.765247 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c702d31b-0061-414c-86b7-b9800f312c20 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:25.766491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c702d31b-0061-414c-86b7-b9800f312c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:25.830850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1227/2461] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:25.839075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1d4ec-02d4-4af4-8bdf-ed9967f491bd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:25.839593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1d4ec-02d4-4af4-8bdf-ed9967f491bd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:25.839910 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1d4ec-02d4-4af4-8bdf-ed9967f491bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:25.860189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-21c1d4ec-02d4-4af4-8bdf-ed9967f491bd None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:25.861461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-21c1d4ec-02d4-4af4-8bdf-ed9967f491bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:25.870860 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1235/2462] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:25.875427 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702d31b-0061-414c-86b7-b9800f312c20 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:25.886526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702d31b-0061-414c-86b7-b9800f312c20 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:25.892471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ad9aa-cc43-4eab-b7c2-caad96a4fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:25.893677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ad9aa-cc43-4eab-b7c2-caad96a4fdda admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:25.893677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ad9aa-cc43-4eab-b7c2-caad96a4fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:25.893887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ad9aa-cc43-4eab-b7c2-caad96a4fdda admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:25.894443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ad9aa-cc43-4eab-b7c2-caad96a4fdda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:25.894753 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ad9aa-cc43-4eab-b7c2-caad96a4fdda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:25.896415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ad9aa-cc43-4eab-b7c2-caad96a4fdda admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:25.910213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1228/2463] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:32:25.914859 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1d4ec-02d4-4af4-8bdf-ed9967f491bd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:25.925330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1d4ec-02d4-4af4-8bdf-ed9967f491bd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:25.931109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af932c78-a960-4d63-a726-323e3827166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:25.931784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af932c78-a960-4d63-a726-323e3827166d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:25.932064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af932c78-a960-4d63-a726-323e3827166d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:25.932331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af932c78-a960-4d63-a726-323e3827166d admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:25.933175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af932c78-a960-4d63-a726-323e3827166d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:25.935114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af932c78-a960-4d63-a726-323e3827166d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:25.966485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1236/2464] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:25 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:25.970863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ad9aa-cc43-4eab-b7c2-caad96a4fdda admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:25.981782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ad9aa-cc43-4eab-b7c2-caad96a4fdda admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.042488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca73bcc-5f68-4053-aa0d-f440ede49dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.043107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca73bcc-5f68-4053-aa0d-f440ede49dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.043390 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca73bcc-5f68-4053-aa0d-f440ede49dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.043665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca73bcc-5f68-4053-aa0d-f440ede49dfd admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.044349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca73bcc-5f68-4053-aa0d-f440ede49dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.046347 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca73bcc-5f68-4053-aa0d-f440ede49dfd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:26.067276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1229/2465] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:25 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:32:26.071582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af932c78-a960-4d63-a726-323e3827166d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.082534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af932c78-a960-4d63-a726-323e3827166d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.088249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f13ee-e34d-4af9-9e84-c08f1b5c9dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.088970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f13ee-e34d-4af9-9e84-c08f1b5c9dec admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.089247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f13ee-e34d-4af9-9e84-c08f1b5c9dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.089520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f13ee-e34d-4af9-9e84-c08f1b5c9dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.090257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f13ee-e34d-4af9-9e84-c08f1b5c9dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.091888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f13ee-e34d-4af9-9e84-c08f1b5c9dec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:26.103129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1237/2466] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:26.107386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca73bcc-5f68-4053-aa0d-f440ede49dfd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.118169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca73bcc-5f68-4053-aa0d-f440ede49dfd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.123897 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb558742-2bde-4fe8-aaa5-449e77a372d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.124581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb558742-2bde-4fe8-aaa5-449e77a372d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.124870 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb558742-2bde-4fe8-aaa5-449e77a372d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.125152 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb558742-2bde-4fe8-aaa5-449e77a372d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.125874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb558742-2bde-4fe8-aaa5-449e77a372d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.127619 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb558742-2bde-4fe8-aaa5-449e77a372d3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:26.129103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:26.144348 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1230/2467] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:26.145636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f13ee-e34d-4af9-9e84-c08f1b5c9dec admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.156112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f13ee-e34d-4af9-9e84-c08f1b5c9dec admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.161488 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f68c3a-a89f-46b6-bf67-a31c0923f05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.162376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68c3a-a89f-46b6-bf67-a31c0923f05e admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.162651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68c3a-a89f-46b6-bf67-a31c0923f05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.162919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68c3a-a89f-46b6-bf67-a31c0923f05e admin admin] PATH_INFO: `/v3/projects/d02c5fc1560a4186aafcedcef632718a/users/78d8ed6a3603402283584feedb9dc498/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.180109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f68c3a-a89f-46b6-bf67-a31c0923f05e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02c5fc1560a4186aafcedcef632718a, user_id=78d8ed6a3603402283584feedb9dc498, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.182944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f68c3a-a89f-46b6-bf67-a31c0923f05e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:26.198856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1238/2468] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:26 2022] PUT /identity/v3/projects/d02c5fc1560a4186aafcedcef632718a/users/78d8ed6a3603402283584feedb9dc498/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:26.209534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543fa86-1179-436a-8ed8-fc67a4040fec None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.209821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543fa86-1179-436a-8ed8-fc67a4040fec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.210098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543fa86-1179-436a-8ed8-fc67a4040fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.240187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c543fa86-1179-436a-8ed8-fc67a4040fec None None] MFA Rules not processed for user `78d8ed6a3603402283584feedb9dc498`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:26.241445 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c543fa86-1179-436a-8ed8-fc67a4040fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:26.319150 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1231/2469] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:26.325336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f68c3a-a89f-46b6-bf67-a31c0923f05e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.391077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f68c3a-a89f-46b6-bf67-a31c0923f05e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.396203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac0677-be37-4933-b6e8-2116ff1ff5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.396905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac0677-be37-4933-b6e8-2116ff1ff5da admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.397191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac0677-be37-4933-b6e8-2116ff1ff5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.397483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac0677-be37-4933-b6e8-2116ff1ff5da admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.398191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac0677-be37-4933-b6e8-2116ff1ff5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.400157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac0677-be37-4933-b6e8-2116ff1ff5da admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:26.429735 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1239/2470] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:26 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:26.436192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543fa86-1179-436a-8ed8-fc67a4040fec None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.448472 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543fa86-1179-436a-8ed8-fc67a4040fec None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.506106 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0af95-38b5-46ed-ba04-3baeb2adae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.506791 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0af95-38b5-46ed-ba04-3baeb2adae00 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.507076 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0af95-38b5-46ed-ba04-3baeb2adae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.507354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0af95-38b5-46ed-ba04-3baeb2adae00 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.508095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0af95-38b5-46ed-ba04-3baeb2adae00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.510156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0af95-38b5-46ed-ba04-3baeb2adae00 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:26.535510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1232/2471] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:26 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:26.538019 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac0677-be37-4933-b6e8-2116ff1ff5da admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.552157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac0677-be37-4933-b6e8-2116ff1ff5da admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.559915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e288-3520-41aa-b15a-ebec6c46fb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.560486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e288-3520-41aa-b15a-ebec6c46fb5e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.560795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e288-3520-41aa-b15a-ebec6c46fb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.561061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e288-3520-41aa-b15a-ebec6c46fb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.561788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7e288-3520-41aa-b15a-ebec6c46fb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.563397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7e288-3520-41aa-b15a-ebec6c46fb5e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:26.574824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1240/2472] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:26.579424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0af95-38b5-46ed-ba04-3baeb2adae00 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.590515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0af95-38b5-46ed-ba04-3baeb2adae00 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.595715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9027a-5505-4f77-909b-8941a4ab9caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.596644 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9027a-5505-4f77-909b-8941a4ab9caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.596941 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9027a-5505-4f77-909b-8941a4ab9caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.597218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9027a-5505-4f77-909b-8941a4ab9caa admin admin] PATH_INFO: `/v3/projects/31c901a4fb2b46a18daf1aa3346afb7f/users/ed75e4f3a16146c58fd5c85596f04feb/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.614202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9027a-5505-4f77-909b-8941a4ab9caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c901a4fb2b46a18daf1aa3346afb7f, user_id=ed75e4f3a16146c58fd5c85596f04feb, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.617055 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9027a-5505-4f77-909b-8941a4ab9caa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:26.632902 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1233/2473] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:26 2022] PUT /identity/v3/projects/31c901a4fb2b46a18daf1aa3346afb7f/users/ed75e4f3a16146c58fd5c85596f04feb/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:26.639485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e288-3520-41aa-b15a-ebec6c46fb5e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.654644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e288-3520-41aa-b15a-ebec6c46fb5e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.698972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:26.723379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d5de3-52db-43bb-90a0-372ccf872d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.724059 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5de3-52db-43bb-90a0-372ccf872d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.724519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5de3-52db-43bb-90a0-372ccf872d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.724882 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5de3-52db-43bb-90a0-372ccf872d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.725620 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d5de3-52db-43bb-90a0-372ccf872d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.727241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d5de3-52db-43bb-90a0-372ccf872d4d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:26.737580 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1241/2474] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:26.741971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9027a-5505-4f77-909b-8941a4ab9caa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.753056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9027a-5505-4f77-909b-8941a4ab9caa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.758587 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c4a02-5e3a-445f-b5c6-527c24edd865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.759526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4a02-5e3a-445f-b5c6-527c24edd865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.759809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4a02-5e3a-445f-b5c6-527c24edd865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.760058 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4a02-5e3a-445f-b5c6-527c24edd865 admin admin] PATH_INFO: `/v3/projects/31c901a4fb2b46a18daf1aa3346afb7f/users/ed75e4f3a16146c58fd5c85596f04feb/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.762535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c4a02-5e3a-445f-b5c6-527c24edd865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c901a4fb2b46a18daf1aa3346afb7f, user_id=ed75e4f3a16146c58fd5c85596f04feb, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.765238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c4a02-5e3a-445f-b5c6-527c24edd865 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:26.778616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1234/2475] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:26 2022] PUT /identity/v3/projects/31c901a4fb2b46a18daf1aa3346afb7f/users/ed75e4f3a16146c58fd5c85596f04feb/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:26.790812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a4eda-1f5e-405e-a1d9-e3b6f44465cc None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.791211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a4eda-1f5e-405e-a1d9-e3b6f44465cc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.791369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a4eda-1f5e-405e-a1d9-e3b6f44465cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.819633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2b5a4eda-1f5e-405e-a1d9-e3b6f44465cc None None] MFA Rules not processed for user `ed75e4f3a16146c58fd5c85596f04feb`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:26.820956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2b5a4eda-1f5e-405e-a1d9-e3b6f44465cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:26.895162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1242/2476] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:26.906689 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c4a02-5e3a-445f-b5c6-527c24edd865 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:26.908479 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-916c4a02-5e3a-445f-b5c6-527c24edd865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:26.956766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:26.974535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c4a02-5e3a-445f-b5c6-527c24edd865 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:26.979056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5aaee7-9e0b-492e-a4e2-64d474ebbb9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:26.979790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aaee7-9e0b-492e-a4e2-64d474ebbb9c service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:26.980154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aaee7-9e0b-492e-a4e2-64d474ebbb9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:26.980429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aaee7-9e0b-492e-a4e2-64d474ebbb9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:26.992072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5aaee7-9e0b-492e-a4e2-64d474ebbb9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:26.993664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5aaee7-9e0b-492e-a4e2-64d474ebbb9c service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:27.005229 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1235/2477] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:27.055481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a4eda-1f5e-405e-a1d9-e3b6f44465cc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:27.056990 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2b5a4eda-1f5e-405e-a1d9-e3b6f44465cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:27.071103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a4eda-1f5e-405e-a1d9-e3b6f44465cc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:27.075660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24edf1-6408-44f3-85dc-a13254f7dc11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:27.076350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24edf1-6408-44f3-85dc-a13254f7dc11 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:27.076663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24edf1-6408-44f3-85dc-a13254f7dc11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:27.076934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24edf1-6408-44f3-85dc-a13254f7dc11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:27.146340 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24edf1-6408-44f3-85dc-a13254f7dc11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:27.147827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24edf1-6408-44f3-85dc-a13254f7dc11 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:27.158579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1243/2478] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:30.545559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5aaee7-9e0b-492e-a4e2-64d474ebbb9c service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:30.548859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6c5aaee7-9e0b-492e-a4e2-64d474ebbb9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:30.549497 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24edf1-6408-44f3-85dc-a13254f7dc11 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:30.615561 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5aaee7-9e0b-492e-a4e2-64d474ebbb9c service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:30.619280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd686cb-f089-40c8-9f4e-0824432e5f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:30.619997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd686cb-f089-40c8-9f4e-0824432e5f29 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:30.620339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd686cb-f089-40c8-9f4e-0824432e5f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:30.620712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd686cb-f089-40c8-9f4e-0824432e5f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:30.623557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3cd686cb-f089-40c8-9f4e-0824432e5f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:30.628165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24edf1-6408-44f3-85dc-a13254f7dc11 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:30.632943 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:30.633842 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:30.634251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:30.634530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] PATH_INFO: `/v3/users/78d8ed6a3603402283584feedb9dc498` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:30.635728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d8ed6a3603402283584feedb9dc498)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:30.638344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:30.640256 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:30.644414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd686cb-f089-40c8-9f4e-0824432e5f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:30.645979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd686cb-f089-40c8-9f4e-0824432e5f29 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:30.654692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1236/2479] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:32:30.690844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d8ed6a3603402283584feedb9dc498'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:30.699454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d8ed6a3603402283584feedb9dc498'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:30.707961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d8ed6a3603402283584feedb9dc498'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:30.721481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d8ed6a3603402283584feedb9dc498'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:30.722122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d8ed6a3603402283584feedb9dc498'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:30.728194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1244/2480] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:30 2022] DELETE /identity/v3/users/78d8ed6a3603402283584feedb9dc498 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:30.734160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace203d-bc70-4410-8841-da6deee2cfcb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:30.734703 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace203d-bc70-4410-8841-da6deee2cfcb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:30.735477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace203d-bc70-4410-8841-da6deee2cfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:30.757212 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5ace203d-bc70-4410-8841-da6deee2cfcb None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:30.758449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5ace203d-bc70-4410-8841-da6deee2cfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:30.824045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1237/2481] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:30.834338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:30.839273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:30.903028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e716-9e1e-4d93-9350-0eaf3516915d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:30.907077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c7429-4991-4fdf-8ee4-214f141c00ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:30.907748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c7429-4991-4fdf-8ee4-214f141c00ba service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:30.908025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c7429-4991-4fdf-8ee4-214f141c00ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:30.908301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c7429-4991-4fdf-8ee4-214f141c00ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:30.918992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c7429-4991-4fdf-8ee4-214f141c00ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:30.920450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c7429-4991-4fdf-8ee4-214f141c00ba service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:30.933503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1245/2482] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:31.225244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace203d-bc70-4410-8841-da6deee2cfcb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:31.227133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5ace203d-bc70-4410-8841-da6deee2cfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:31.241778 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace203d-bc70-4410-8841-da6deee2cfcb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:31.248339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:31.249931 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:31.250408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:31.250929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] PATH_INFO: `/v3/projects/d02c5fc1560a4186aafcedcef632718a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:31.253254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d02c5fc1560a4186aafcedcef632718a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:31.256682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:31.319583 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02c5fc1560a4186aafcedcef632718a', 'request_id': 'req-9ad720df-727d-4e9d-935e-c85cce887755'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:31.330388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02c5fc1560a4186aafcedcef632718a', 'request_id': 'req-9ad720df-727d-4e9d-935e-c85cce887755'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:31.337531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02c5fc1560a4186aafcedcef632718a', 'request_id': 'req-9ad720df-727d-4e9d-935e-c85cce887755'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:31.351355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] The token cache is being invalidate because project d02c5fc1560a4186aafcedcef632718a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:31.351612 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:31.352338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:31.354119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1238/2483] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:31 2022] DELETE /identity/v3/projects/d02c5fc1560a4186aafcedcef632718a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:31.358711 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c7429-4991-4fdf-8ee4-214f141c00ba service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:31.370520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c7429-4991-4fdf-8ee4-214f141c00ba service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:31.452714 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aebfb-9b61-4b1e-b629-1ee22aee1ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:31.453672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aebfb-9b61-4b1e-b629-1ee22aee1ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:31.454547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aebfb-9b61-4b1e-b629-1ee22aee1ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:31.454547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aebfb-9b61-4b1e-b629-1ee22aee1ae7 admin admin] PATH_INFO: `/v3/users/ed75e4f3a16146c58fd5c85596f04feb` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:31.455581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aebfb-9b61-4b1e-b629-1ee22aee1ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed75e4f3a16146c58fd5c85596f04feb)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:31.457665 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aebfb-9b61-4b1e-b629-1ee22aee1ae7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:31.488607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:31.515594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-988aebfb-9b61-4b1e-b629-1ee22aee1ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed75e4f3a16146c58fd5c85596f04feb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:31.525398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-988aebfb-9b61-4b1e-b629-1ee22aee1ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed75e4f3a16146c58fd5c85596f04feb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:31.533589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-988aebfb-9b61-4b1e-b629-1ee22aee1ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed75e4f3a16146c58fd5c85596f04feb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:31.547750 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-988aebfb-9b61-4b1e-b629-1ee22aee1ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed75e4f3a16146c58fd5c85596f04feb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:31.548679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-988aebfb-9b61-4b1e-b629-1ee22aee1ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed75e4f3a16146c58fd5c85596f04feb'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:31.556257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1246/2484] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:31 2022] DELETE /identity/v3/users/ed75e4f3a16146c58fd5c85596f04feb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:31.872019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:31.873890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:31.890075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad720df-727d-4e9d-935e-c85cce887755 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:31.894257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:31.978692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a45f7-6b13-4626-8012-d7643033f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:31.980198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a45f7-6b13-4626-8012-d7643033f376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:31.980730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a45f7-6b13-4626-8012-d7643033f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:31.981287 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a45f7-6b13-4626-8012-d7643033f376 admin admin] PATH_INFO: `/v3/projects/31c901a4fb2b46a18daf1aa3346afb7f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:31.983426 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a45f7-6b13-4626-8012-d7643033f376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c901a4fb2b46a18daf1aa3346afb7f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:31.987208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a45f7-6b13-4626-8012-d7643033f376 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.042915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-350a45f7-6b13-4626-8012-d7643033f376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c901a4fb2b46a18daf1aa3346afb7f', 'request_id': 'req-350a45f7-6b13-4626-8012-d7643033f376'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:32.052017 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-350a45f7-6b13-4626-8012-d7643033f376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c901a4fb2b46a18daf1aa3346afb7f', 'request_id': 'req-350a45f7-6b13-4626-8012-d7643033f376'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:32.058038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-350a45f7-6b13-4626-8012-d7643033f376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c901a4fb2b46a18daf1aa3346afb7f', 'request_id': 'req-350a45f7-6b13-4626-8012-d7643033f376'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:32.069637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-350a45f7-6b13-4626-8012-d7643033f376 admin admin] The token cache is being invalidate because project 31c901a4fb2b46a18daf1aa3346afb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:32.069933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-350a45f7-6b13-4626-8012-d7643033f376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:32.070692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-350a45f7-6b13-4626-8012-d7643033f376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:32.072250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1239/2485] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:31 2022] DELETE /identity/v3/projects/31c901a4fb2b46a18daf1aa3346afb7f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:32.077540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71354558-3da4-4b3d-9fed-6ebe6511c637 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.077851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71354558-3da4-4b3d-9fed-6ebe6511c637 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.078125 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71354558-3da4-4b3d-9fed-6ebe6511c637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.098108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-71354558-3da4-4b3d-9fed-6ebe6511c637 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:32.099384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-71354558-3da4-4b3d-9fed-6ebe6511c637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:32.169167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1247/2486] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:32.178338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fe0f7-bee9-4529-af4f-b0fec4e223fd None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.178707 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fe0f7-bee9-4529-af4f-b0fec4e223fd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.179097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fe0f7-bee9-4529-af4f-b0fec4e223fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.204365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-727fe0f7-bee9-4529-af4f-b0fec4e223fd None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:32.205644 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-727fe0f7-bee9-4529-af4f-b0fec4e223fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:32.214291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1240/2487] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:32.218759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71354558-3da4-4b3d-9fed-6ebe6511c637 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:32.228895 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71354558-3da4-4b3d-9fed-6ebe6511c637 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:32.234191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b52036-2d20-45ac-9041-29c6174b238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:32.234871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b52036-2d20-45ac-9041-29c6174b238c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.235151 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b52036-2d20-45ac-9041-29c6174b238c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.235430 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b52036-2d20-45ac-9041-29c6174b238c admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.236168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b52036-2d20-45ac-9041-29c6174b238c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:32.236462 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b52036-2d20-45ac-9041-29c6174b238c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:32.238173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b52036-2d20-45ac-9041-29c6174b238c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.250663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1248/2488] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:32:32.255363 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fe0f7-bee9-4529-af4f-b0fec4e223fd None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:32.265776 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fe0f7-bee9-4529-af4f-b0fec4e223fd None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:32.271563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceb7f9-e454-4c66-8481-a6443e855040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:32.272226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceb7f9-e454-4c66-8481-a6443e855040 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.272653 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceb7f9-e454-4c66-8481-a6443e855040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.272934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceb7f9-e454-4c66-8481-a6443e855040 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.273621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceb7f9-e454-4c66-8481-a6443e855040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:32.275590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceb7f9-e454-4c66-8481-a6443e855040 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.304331 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1241/2489] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:32 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:32.308874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b52036-2d20-45ac-9041-29c6174b238c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:32.319830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b52036-2d20-45ac-9041-29c6174b238c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:32.382064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc2e89-cf03-42b2-8a10-15219adb7619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:32.382758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc2e89-cf03-42b2-8a10-15219adb7619 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.383039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc2e89-cf03-42b2-8a10-15219adb7619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.383315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc2e89-cf03-42b2-8a10-15219adb7619 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.384026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc2e89-cf03-42b2-8a10-15219adb7619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:32.386349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc2e89-cf03-42b2-8a10-15219adb7619 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.409514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1249/2490] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:32 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:32.413706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceb7f9-e454-4c66-8481-a6443e855040 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:32.424693 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceb7f9-e454-4c66-8481-a6443e855040 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:32.429616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9102270-562f-4b4d-bd3b-ff81a243ea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:32.430287 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9102270-562f-4b4d-bd3b-ff81a243ea0f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.430570 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9102270-562f-4b4d-bd3b-ff81a243ea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.430872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9102270-562f-4b4d-bd3b-ff81a243ea0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.431607 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9102270-562f-4b4d-bd3b-ff81a243ea0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:32.433277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9102270-562f-4b4d-bd3b-ff81a243ea0f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.445128 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1242/2491] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:32.449384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc2e89-cf03-42b2-8a10-15219adb7619 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:32.460005 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc2e89-cf03-42b2-8a10-15219adb7619 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:32.465262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f7c8f-3f53-4ff5-ad8a-f4ae946c1554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:32.466042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f7c8f-3f53-4ff5-ad8a-f4ae946c1554 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.466323 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f7c8f-3f53-4ff5-ad8a-f4ae946c1554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.466581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f7c8f-3f53-4ff5-ad8a-f4ae946c1554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.467313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f7c8f-3f53-4ff5-ad8a-f4ae946c1554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:32.469032 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f7c8f-3f53-4ff5-ad8a-f4ae946c1554 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.480746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1250/2492] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:32.486953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9102270-562f-4b4d-bd3b-ff81a243ea0f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:32.500659 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9102270-562f-4b4d-bd3b-ff81a243ea0f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:32.507055 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63563c-5b04-4d0f-abce-eb9344b2714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:32.507974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63563c-5b04-4d0f-abce-eb9344b2714e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.508242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63563c-5b04-4d0f-abce-eb9344b2714e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.508528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63563c-5b04-4d0f-abce-eb9344b2714e admin admin] PATH_INFO: `/v3/projects/84f6e6da94fd4de1a0261febf5cfdae3/users/26932ff3630041a38eb12136d1845bc7/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.529607 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63563c-5b04-4d0f-abce-eb9344b2714e admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f6e6da94fd4de1a0261febf5cfdae3, user_id=26932ff3630041a38eb12136d1845bc7, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:32.532398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63563c-5b04-4d0f-abce-eb9344b2714e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.549252 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1243/2493] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:32 2022] PUT /identity/v3/projects/84f6e6da94fd4de1a0261febf5cfdae3/users/26932ff3630041a38eb12136d1845bc7/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:32.561192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d5723-a9a4-4a06-9ff7-f2dd7d7bd02a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.561777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d5723-a9a4-4a06-9ff7-f2dd7d7bd02a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.561777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d5723-a9a4-4a06-9ff7-f2dd7d7bd02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.575545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:32.592887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-780d5723-a9a4-4a06-9ff7-f2dd7d7bd02a None None] MFA Rules not processed for user `26932ff3630041a38eb12136d1845bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:32.594301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-780d5723-a9a4-4a06-9ff7-f2dd7d7bd02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:32.667103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1251/2494] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:32:32.672243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63563c-5b04-4d0f-abce-eb9344b2714e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:32.711002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:32.742326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63563c-5b04-4d0f-abce-eb9344b2714e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:32.747429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88fbc6-9db4-4a9a-b281-3e2d4b247507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:32.748110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88fbc6-9db4-4a9a-b281-3e2d4b247507 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.748384 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88fbc6-9db4-4a9a-b281-3e2d4b247507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.748688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88fbc6-9db4-4a9a-b281-3e2d4b247507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.749405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88fbc6-9db4-4a9a-b281-3e2d4b247507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:32.751331 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88fbc6-9db4-4a9a-b281-3e2d4b247507 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.783732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1244/2495] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:32 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:32.784982 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d5723-a9a4-4a06-9ff7-f2dd7d7bd02a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:32.797390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d5723-a9a4-4a06-9ff7-f2dd7d7bd02a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:32.858410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9a262-468c-4004-937a-859e9de94e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:32.859188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9a262-468c-4004-937a-859e9de94e15 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.859488 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9a262-468c-4004-937a-859e9de94e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.859755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9a262-468c-4004-937a-859e9de94e15 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.860487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9a262-468c-4004-937a-859e9de94e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:32.862483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9a262-468c-4004-937a-859e9de94e15 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.884337 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1252/2496] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:32 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:32.889337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88fbc6-9db4-4a9a-b281-3e2d4b247507 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:32.900532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88fbc6-9db4-4a9a-b281-3e2d4b247507 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:32.905604 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15346e0a-df89-4f93-835a-8b2c65b6aa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:32.906328 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15346e0a-df89-4f93-835a-8b2c65b6aa72 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.906613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15346e0a-df89-4f93-835a-8b2c65b6aa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.906886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15346e0a-df89-4f93-835a-8b2c65b6aa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.907618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15346e0a-df89-4f93-835a-8b2c65b6aa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:32.909289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15346e0a-df89-4f93-835a-8b2c65b6aa72 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.921158 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1245/2497] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:32.925282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9a262-468c-4004-937a-859e9de94e15 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:32.936337 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9a262-468c-4004-937a-859e9de94e15 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:32.942269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e27103-f3b9-44c3-8882-c0ced0fb8ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:32.943565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e27103-f3b9-44c3-8882-c0ced0fb8ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:32.943565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e27103-f3b9-44c3-8882-c0ced0fb8ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:32.943739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e27103-f3b9-44c3-8882-c0ced0fb8ac7 admin admin] PATH_INFO: `/v3/projects/8dd650a0e8604e1b9d1ec8a25741ce81/users/b0385380ac8b4885bd580213ea9fd965/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:32.961850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e27103-f3b9-44c3-8882-c0ced0fb8ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd650a0e8604e1b9d1ec8a25741ce81, user_id=b0385380ac8b4885bd580213ea9fd965, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:32.964678 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e27103-f3b9-44c3-8882-c0ced0fb8ac7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:32.979410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1253/2498] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:32 2022] PUT /identity/v3/projects/8dd650a0e8604e1b9d1ec8a25741ce81/users/b0385380ac8b4885bd580213ea9fd965/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:32.983751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15346e0a-df89-4f93-835a-8b2c65b6aa72 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:32.994055 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15346e0a-df89-4f93-835a-8b2c65b6aa72 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:33.056033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb531963-50ce-470b-a883-b41d4ff28447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:33.056748 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb531963-50ce-470b-a883-b41d4ff28447 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:33.057060 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb531963-50ce-470b-a883-b41d4ff28447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:33.057339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb531963-50ce-470b-a883-b41d4ff28447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:33.058078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb531963-50ce-470b-a883-b41d4ff28447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:33.059742 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb531963-50ce-470b-a883-b41d4ff28447 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:33.070920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1246/2499] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:33.075406 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e27103-f3b9-44c3-8882-c0ced0fb8ac7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:33.086935 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e27103-f3b9-44c3-8882-c0ced0fb8ac7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:33.094442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9de8e1-40f4-4d71-a5af-3f87f12516ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:33.095875 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9de8e1-40f4-4d71-a5af-3f87f12516ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:33.096334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9de8e1-40f4-4d71-a5af-3f87f12516ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:33.096847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9de8e1-40f4-4d71-a5af-3f87f12516ff admin admin] PATH_INFO: `/v3/projects/8dd650a0e8604e1b9d1ec8a25741ce81/users/b0385380ac8b4885bd580213ea9fd965/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:33.100800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9de8e1-40f4-4d71-a5af-3f87f12516ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd650a0e8604e1b9d1ec8a25741ce81, user_id=b0385380ac8b4885bd580213ea9fd965, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:33.106439 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9de8e1-40f4-4d71-a5af-3f87f12516ff admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:33.122305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1254/2500] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:33 2022] PUT /identity/v3/projects/8dd650a0e8604e1b9d1ec8a25741ce81/users/b0385380ac8b4885bd580213ea9fd965/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:33.134041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02a02f-d924-464f-87ae-a47ce9408707 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:33.134337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02a02f-d924-464f-87ae-a47ce9408707 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:33.134577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02a02f-d924-464f-87ae-a47ce9408707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:33.167202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0a02a02f-d924-464f-87ae-a47ce9408707 None None] MFA Rules not processed for user `b0385380ac8b4885bd580213ea9fd965`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:33.168454 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0a02a02f-d924-464f-87ae-a47ce9408707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:33.249683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1247/2501] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:32:33.262199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9de8e1-40f4-4d71-a5af-3f87f12516ff admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:33.264197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3b9de8e1-40f4-4d71-a5af-3f87f12516ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:33.331199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:33.337507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9de8e1-40f4-4d71-a5af-3f87f12516ff admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:33.343887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588629ef-1502-4832-be12-e76ed79767cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:33.345002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588629ef-1502-4832-be12-e76ed79767cf service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:33.345463 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588629ef-1502-4832-be12-e76ed79767cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:33.345736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588629ef-1502-4832-be12-e76ed79767cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:33.431328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588629ef-1502-4832-be12-e76ed79767cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:33.433041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588629ef-1502-4832-be12-e76ed79767cf service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:33.445384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1255/2502] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:34.854422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02a02f-d924-464f-87ae-a47ce9408707 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:34.857033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0a02a02f-d924-464f-87ae-a47ce9408707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:34.870996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02a02f-d924-464f-87ae-a47ce9408707 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:34.875440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9db94-6421-4785-80e9-4925d4da0bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:34.876118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9db94-6421-4785-80e9-4925d4da0bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:34.876403 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9db94-6421-4785-80e9-4925d4da0bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:34.876718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9db94-6421-4785-80e9-4925d4da0bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:34.892221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9db94-6421-4785-80e9-4925d4da0bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:34.893701 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9db94-6421-4785-80e9-4925d4da0bb6 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:34.905144 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1248/2503] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:35.190200 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588629ef-1502-4832-be12-e76ed79767cf service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:35.191926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-588629ef-1502-4832-be12-e76ed79767cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:35.283558 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588629ef-1502-4832-be12-e76ed79767cf service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:35.290615 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04df249-b9b2-4693-85cd-b7d9fbda37f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:35.291327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df249-b9b2-4693-85cd-b7d9fbda37f1 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:35.291608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df249-b9b2-4693-85cd-b7d9fbda37f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:35.291879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df249-b9b2-4693-85cd-b7d9fbda37f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:35.294221 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e04df249-b9b2-4693-85cd-b7d9fbda37f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:35.381509 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04df249-b9b2-4693-85cd-b7d9fbda37f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:35.384970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04df249-b9b2-4693-85cd-b7d9fbda37f1 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:35.398693 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1256/2504] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:36.715318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9db94-6421-4785-80e9-4925d4da0bb6 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:36.716891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fed9db94-6421-4785-80e9-4925d4da0bb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:36.737317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:36.796879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9db94-6421-4785-80e9-4925d4da0bb6 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:36.802217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addedc9d-6009-4f87-9a9c-b83fe0ee720b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd9ea435d7b48cb8b1b2a27d79cfa91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:36.802887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addedc9d-6009-4f87-9a9c-b83fe0ee720b service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:36.803195 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addedc9d-6009-4f87-9a9c-b83fe0ee720b service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:36.803524 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addedc9d-6009-4f87-9a9c-b83fe0ee720b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:36.805356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-addedc9d-6009-4f87-9a9c-b83fe0ee720b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:36.818193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addedc9d-6009-4f87-9a9c-b83fe0ee720b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:36.820046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addedc9d-6009-4f87-9a9c-b83fe0ee720b service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:36.830743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1249/2505] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:38.105992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04df249-b9b2-4693-85cd-b7d9fbda37f1 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:38.121028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04df249-b9b2-4693-85cd-b7d9fbda37f1 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:38.127076 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b3cb7-5260-4575-8bb5-f001d1cf2554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:38.127742 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3cb7-5260-4575-8bb5-f001d1cf2554 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:38.128002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3cb7-5260-4575-8bb5-f001d1cf2554 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:38.128282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3cb7-5260-4575-8bb5-f001d1cf2554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:38.130207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f68b3cb7-5260-4575-8bb5-f001d1cf2554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:38.175045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:38.195915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b3cb7-5260-4575-8bb5-f001d1cf2554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:38.197561 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b3cb7-5260-4575-8bb5-f001d1cf2554 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:38.207594 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1257/2506] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:38.904127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addedc9d-6009-4f87-9a9c-b83fe0ee720b service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:39.011179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addedc9d-6009-4f87-9a9c-b83fe0ee720b service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:39.018267 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:39.019193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.019478 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.019751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] PATH_INFO: `/v3/users/26932ff3630041a38eb12136d1845bc7` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.021006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26932ff3630041a38eb12136d1845bc7)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:39.023006 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:39.083090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26932ff3630041a38eb12136d1845bc7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.090248 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26932ff3630041a38eb12136d1845bc7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.105956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26932ff3630041a38eb12136d1845bc7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.106685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26932ff3630041a38eb12136d1845bc7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.107349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26932ff3630041a38eb12136d1845bc7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.121997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1250/2507] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:38 2022] DELETE /identity/v3/users/26932ff3630041a38eb12136d1845bc7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:39.126435 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ec774-bc32-4b7d-a0f6-ab26ca7e366d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.126931 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ec774-bc32-4b7d-a0f6-ab26ca7e366d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.127118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ec774-bc32-4b7d-a0f6-ab26ca7e366d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.146227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d62ec774-bc32-4b7d-a0f6-ab26ca7e366d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:39.147593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d62ec774-bc32-4b7d-a0f6-ab26ca7e366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:39.217992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1258/2508] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:32:39.227923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:39.229332 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:39.262680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:39.302565 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723b079-c8d2-45e0-837e-9a09d29e92e4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:39.307144 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210907f-1714-4c7c-b7af-69c6de0c98ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:39.307817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210907f-1714-4c7c-b7af-69c6de0c98ce service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.308107 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210907f-1714-4c7c-b7af-69c6de0c98ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.308575 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210907f-1714-4c7c-b7af-69c6de0c98ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.319320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210907f-1714-4c7c-b7af-69c6de0c98ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:39.320755 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210907f-1714-4c7c-b7af-69c6de0c98ce service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:39.331616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1251/2509] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:39.479291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ec774-bc32-4b7d-a0f6-ab26ca7e366d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:39.481723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d62ec774-bc32-4b7d-a0f6-ab26ca7e366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:39.648983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ec774-bc32-4b7d-a0f6-ab26ca7e366d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:39.656844 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8324-7353-481a-826c-b41d823c52be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:39.657533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8324-7353-481a-826c-b41d823c52be service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.657820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8324-7353-481a-826c-b41d823c52be service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.658161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8324-7353-481a-826c-b41d823c52be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.661322 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c80f8324-7353-481a-826c-b41d823c52be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:39.684414 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f8324-7353-481a-826c-b41d823c52be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:39.686841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f8324-7353-481a-826c-b41d823c52be service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:39.700541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1259/2510] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:39.740985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210907f-1714-4c7c-b7af-69c6de0c98ce service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:39.742453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e210907f-1714-4c7c-b7af-69c6de0c98ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:39.779044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210907f-1714-4c7c-b7af-69c6de0c98ce service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:39.789277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:39.790535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.792830 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.793240 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] PATH_INFO: `/v3/projects/84f6e6da94fd4de1a0261febf5cfdae3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.794568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f6e6da94fd4de1a0261febf5cfdae3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:39.796772 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:39.852430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f6e6da94fd4de1a0261febf5cfdae3', 'request_id': 'req-27cfdaa5-16aa-4552-8809-f79c9c396f94'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.861547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f6e6da94fd4de1a0261febf5cfdae3', 'request_id': 'req-27cfdaa5-16aa-4552-8809-f79c9c396f94'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.867453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f6e6da94fd4de1a0261febf5cfdae3', 'request_id': 'req-27cfdaa5-16aa-4552-8809-f79c9c396f94'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.879190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] The token cache is being invalidate because project 84f6e6da94fd4de1a0261febf5cfdae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:39.879481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.880141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:39.884598 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1252/2511] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:39 2022] DELETE /identity/v3/projects/84f6e6da94fd4de1a0261febf5cfdae3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:39.891647 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8324-7353-481a-826c-b41d823c52be service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:39.910432 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8324-7353-481a-826c-b41d823c52be service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:39.972506 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44a812-76cc-4157-907d-8ead4896aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:39.973411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44a812-76cc-4157-907d-8ead4896aa3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:39.973697 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44a812-76cc-4157-907d-8ead4896aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:39.973972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44a812-76cc-4157-907d-8ead4896aa3e admin admin] PATH_INFO: `/v3/users/b0385380ac8b4885bd580213ea9fd965` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:39.975260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44a812-76cc-4157-907d-8ead4896aa3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0385380ac8b4885bd580213ea9fd965)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:39.977275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44a812-76cc-4157-907d-8ead4896aa3e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:39.982256 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:40.029179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6f44a812-76cc-4157-907d-8ead4896aa3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0385380ac8b4885bd580213ea9fd965'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:40.038899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6f44a812-76cc-4157-907d-8ead4896aa3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0385380ac8b4885bd580213ea9fd965'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:40.046030 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6f44a812-76cc-4157-907d-8ead4896aa3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0385380ac8b4885bd580213ea9fd965'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:40.059706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6f44a812-76cc-4157-907d-8ead4896aa3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0385380ac8b4885bd580213ea9fd965'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:40.060445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6f44a812-76cc-4157-907d-8ead4896aa3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0385380ac8b4885bd580213ea9fd965'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:40.066686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1260/2512] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:39 2022] DELETE /identity/v3/users/b0385380ac8b4885bd580213ea9fd965 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:40.825305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:40.827763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:40.840848 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfdaa5-16aa-4552-8809-f79c9c396f94 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:40.906429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:40.907310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:40.907705 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:40.908145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f admin admin] PATH_INFO: `/v3/projects/8dd650a0e8604e1b9d1ec8a25741ce81` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:40.909184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd650a0e8604e1b9d1ec8a25741ce81)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:40.911518 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:40.962528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd650a0e8604e1b9d1ec8a25741ce81', 'request_id': 'req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:40.965647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:40.973939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd650a0e8604e1b9d1ec8a25741ce81', 'request_id': 'req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:40.981543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd650a0e8604e1b9d1ec8a25741ce81', 'request_id': 'req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:40.993337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f admin admin] The token cache is being invalidate because project 8dd650a0e8604e1b9d1ec8a25741ce81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:40.993605 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:40.994243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d644cc10-efe8-4a3a-a7dd-c9a34b577d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:40.995803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1253/2513] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:40 2022] DELETE /identity/v3/projects/8dd650a0e8604e1b9d1ec8a25741ce81 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:32:41.001081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cf757-569a-4859-a04a-a079f2921067 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.001603 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cf757-569a-4859-a04a-a079f2921067 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.001695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cf757-569a-4859-a04a-a079f2921067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.021865 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-884cf757-569a-4859-a04a-a079f2921067 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:41.023089 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-884cf757-569a-4859-a04a-a079f2921067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:41.087373 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1261/2514] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:41.095343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b600-9d96-4231-a340-112898d61aa1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.095628 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b600-9d96-4231-a340-112898d61aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.095903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b600-9d96-4231-a340-112898d61aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.115099 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fe69b600-9d96-4231-a340-112898d61aa1 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:41.116307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fe69b600-9d96-4231-a340-112898d61aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:41.125114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1254/2515] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:41.129596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cf757-569a-4859-a04a-a079f2921067 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:41.140478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cf757-569a-4859-a04a-a079f2921067 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:41.145067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714393-8ae1-42f5-bd53-7dada302d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:41.145725 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714393-8ae1-42f5-bd53-7dada302d17e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.146003 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714393-8ae1-42f5-bd53-7dada302d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.146286 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714393-8ae1-42f5-bd53-7dada302d17e admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.147017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714393-8ae1-42f5-bd53-7dada302d17e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:41.147316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714393-8ae1-42f5-bd53-7dada302d17e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:41.148972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714393-8ae1-42f5-bd53-7dada302d17e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:41.161681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1262/2516] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:32:41.166576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69b600-9d96-4231-a340-112898d61aa1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:41.177754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69b600-9d96-4231-a340-112898d61aa1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:41.183054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9b11b-8b60-4f61-8af8-0713425056b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:41.183713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9b11b-8b60-4f61-8af8-0713425056b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.183999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9b11b-8b60-4f61-8af8-0713425056b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.184240 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9b11b-8b60-4f61-8af8-0713425056b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.184990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9b11b-8b60-4f61-8af8-0713425056b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:41.186944 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9b11b-8b60-4f61-8af8-0713425056b0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:41.220636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1255/2517] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:41 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:41.225457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714393-8ae1-42f5-bd53-7dada302d17e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:41.238157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714393-8ae1-42f5-bd53-7dada302d17e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:41.312186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2273df6-eae6-4be6-8526-0fae86f9b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:41.313075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2273df6-eae6-4be6-8526-0fae86f9b6cc admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.313450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2273df6-eae6-4be6-8526-0fae86f9b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.313830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2273df6-eae6-4be6-8526-0fae86f9b6cc admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.314874 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2273df6-eae6-4be6-8526-0fae86f9b6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:41.316996 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2273df6-eae6-4be6-8526-0fae86f9b6cc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:41.336309 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:41.344164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1263/2518] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:41 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:41.347771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9b11b-8b60-4f61-8af8-0713425056b0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:41.361200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9b11b-8b60-4f61-8af8-0713425056b0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:41.366447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77f7f8-e759-45fc-a130-f4782123ff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:41.367130 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77f7f8-e759-45fc-a130-f4782123ff4b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.367408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77f7f8-e759-45fc-a130-f4782123ff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.367985 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77f7f8-e759-45fc-a130-f4782123ff4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.368418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77f7f8-e759-45fc-a130-f4782123ff4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:41.370071 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77f7f8-e759-45fc-a130-f4782123ff4b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:41.383447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1256/2519] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:32:41.388375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2273df6-eae6-4be6-8526-0fae86f9b6cc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:41.399827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2273df6-eae6-4be6-8526-0fae86f9b6cc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:41.406919 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71591a-bcd7-4b41-a2ee-a77db0d099ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:41.407306 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71591a-bcd7-4b41-a2ee-a77db0d099ad admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.407527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71591a-bcd7-4b41-a2ee-a77db0d099ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.407813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71591a-bcd7-4b41-a2ee-a77db0d099ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.408560 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71591a-bcd7-4b41-a2ee-a77db0d099ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:41.410188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71591a-bcd7-4b41-a2ee-a77db0d099ad admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:41.426150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1264/2520] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:41.430312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77f7f8-e759-45fc-a130-f4782123ff4b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:41.444366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77f7f8-e759-45fc-a130-f4782123ff4b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:41.450123 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c2c45-a664-4213-abbd-08becd3222fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:41.451567 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c2c45-a664-4213-abbd-08becd3222fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.451793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c2c45-a664-4213-abbd-08becd3222fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.452478 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c2c45-a664-4213-abbd-08becd3222fb admin admin] PATH_INFO: `/v3/projects/8f86c01e9e1e4397808df3ed77000737/users/127f94375a8b45759d8b451785e718c2/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.477422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c2c45-a664-4213-abbd-08becd3222fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f86c01e9e1e4397808df3ed77000737, user_id=127f94375a8b45759d8b451785e718c2, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:41.480033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c2c45-a664-4213-abbd-08becd3222fb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:41.495732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1257/2521] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:41 2022] PUT /identity/v3/projects/8f86c01e9e1e4397808df3ed77000737/users/127f94375a8b45759d8b451785e718c2/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:41.507527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190762c9-2245-48b2-8e68-531ab0e3b21f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.507913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190762c9-2245-48b2-8e68-531ab0e3b21f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.508186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190762c9-2245-48b2-8e68-531ab0e3b21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.538215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-190762c9-2245-48b2-8e68-531ab0e3b21f None None] MFA Rules not processed for user `127f94375a8b45759d8b451785e718c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:41.539503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-190762c9-2245-48b2-8e68-531ab0e3b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:41.625292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1265/2522] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:41.630133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c2c45-a664-4213-abbd-08becd3222fb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:41.713999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c2c45-a664-4213-abbd-08becd3222fb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:41.722730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3c51a-b0f7-4af6-91e1-0fea9f011b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:41.723533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3c51a-b0f7-4af6-91e1-0fea9f011b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.723887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3c51a-b0f7-4af6-91e1-0fea9f011b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.724297 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3c51a-b0f7-4af6-91e1-0fea9f011b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.725093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3c51a-b0f7-4af6-91e1-0fea9f011b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:41.727132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3c51a-b0f7-4af6-91e1-0fea9f011b14 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:41.761150 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1258/2523] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:41 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:41.766276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190762c9-2245-48b2-8e68-531ab0e3b21f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:41.781127 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190762c9-2245-48b2-8e68-531ab0e3b21f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:41.861418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fb140-1bf1-4937-9eec-1fde9a9c7069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:41.862112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fb140-1bf1-4937-9eec-1fde9a9c7069 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.862392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fb140-1bf1-4937-9eec-1fde9a9c7069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.862663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fb140-1bf1-4937-9eec-1fde9a9c7069 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.863486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fb140-1bf1-4937-9eec-1fde9a9c7069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:41.865484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fb140-1bf1-4937-9eec-1fde9a9c7069 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:41.888886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1266/2524] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:41 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:41.892449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3c51a-b0f7-4af6-91e1-0fea9f011b14 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:41.904818 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3c51a-b0f7-4af6-91e1-0fea9f011b14 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:41.914393 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798a1fa-923c-475f-b7ef-44c48d5279be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:41.915170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798a1fa-923c-475f-b7ef-44c48d5279be admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.915522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798a1fa-923c-475f-b7ef-44c48d5279be admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.915871 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798a1fa-923c-475f-b7ef-44c48d5279be admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.916723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798a1fa-923c-475f-b7ef-44c48d5279be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:41.918999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798a1fa-923c-475f-b7ef-44c48d5279be admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:41.931232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1259/2525] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:41.935559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fb140-1bf1-4937-9eec-1fde9a9c7069 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:41.946382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fb140-1bf1-4937-9eec-1fde9a9c7069 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:41.959877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec978dd-d2de-4083-8dfa-759b07e3eb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:41.960695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec978dd-d2de-4083-8dfa-759b07e3eb55 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:41.961026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec978dd-d2de-4083-8dfa-759b07e3eb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:41.961390 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec978dd-d2de-4083-8dfa-759b07e3eb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:41.962189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec978dd-d2de-4083-8dfa-759b07e3eb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:41.964151 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec978dd-d2de-4083-8dfa-759b07e3eb55 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:41.980514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1267/2526] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:41.984959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798a1fa-923c-475f-b7ef-44c48d5279be admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:41.995495 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798a1fa-923c-475f-b7ef-44c48d5279be admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:42.012214 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1485cb-7828-436d-85f5-b4f65422de55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:42.013263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1485cb-7828-436d-85f5-b4f65422de55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:42.013746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1485cb-7828-436d-85f5-b4f65422de55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:42.014120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1485cb-7828-436d-85f5-b4f65422de55 admin admin] PATH_INFO: `/v3/projects/389f60b538b54b49bff4889338468b9c/users/1b565410ac024d319eae164437c68859/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:42.030910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1485cb-7828-436d-85f5-b4f65422de55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389f60b538b54b49bff4889338468b9c, user_id=1b565410ac024d319eae164437c68859, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:42.033670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1485cb-7828-436d-85f5-b4f65422de55 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:42.049344 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1260/2527] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:41 2022] PUT /identity/v3/projects/389f60b538b54b49bff4889338468b9c/users/1b565410ac024d319eae164437c68859/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:42.060426 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f989f8-c251-41a8-a8d9-34e042763d20 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:42.061029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f989f8-c251-41a8-a8d9-34e042763d20 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:42.061156 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f989f8-c251-41a8-a8d9-34e042763d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:42.090801 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-96f989f8-c251-41a8-a8d9-34e042763d20 None None] MFA Rules not processed for user `1b565410ac024d319eae164437c68859`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:42.092108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-96f989f8-c251-41a8-a8d9-34e042763d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:42.149823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:42.172212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1268/2528] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:42.176980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1485cb-7828-436d-85f5-b4f65422de55 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:42.208714 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:42.248235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1485cb-7828-436d-85f5-b4f65422de55 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:42.253904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4d481-651a-4c70-a871-a04a189fd6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:42.255366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4d481-651a-4c70-a871-a04a189fd6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:42.255774 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4d481-651a-4c70-a871-a04a189fd6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:42.255993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4d481-651a-4c70-a871-a04a189fd6e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:42.256822 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4d481-651a-4c70-a871-a04a189fd6e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:42.258995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4d481-651a-4c70-a871-a04a189fd6e3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:42.287592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1261/2529] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:42 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:42.291700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f989f8-c251-41a8-a8d9-34e042763d20 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:42.309139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f989f8-c251-41a8-a8d9-34e042763d20 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:42.377622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b9769-df3e-4ff7-a014-ce1965d6fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:42.378319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b9769-df3e-4ff7-a014-ce1965d6fa93 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:42.378597 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b9769-df3e-4ff7-a014-ce1965d6fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:42.378869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b9769-df3e-4ff7-a014-ce1965d6fa93 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:42.379559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b9769-df3e-4ff7-a014-ce1965d6fa93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:42.381675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b9769-df3e-4ff7-a014-ce1965d6fa93 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:42.404982 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1269/2530] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:42 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:42.409887 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4d481-651a-4c70-a871-a04a189fd6e3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:42.424196 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4d481-651a-4c70-a871-a04a189fd6e3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:42.430617 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbf912-84ab-41a7-b926-fff6a25abb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:42.431294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbf912-84ab-41a7-b926-fff6a25abb6e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:42.431578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbf912-84ab-41a7-b926-fff6a25abb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:42.431867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbf912-84ab-41a7-b926-fff6a25abb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:42.432636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbf912-84ab-41a7-b926-fff6a25abb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:42.434296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbf912-84ab-41a7-b926-fff6a25abb6e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:42.445857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1262/2531] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:42.450508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b9769-df3e-4ff7-a014-ce1965d6fa93 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:42.461647 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b9769-df3e-4ff7-a014-ce1965d6fa93 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:42.466871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8176d3-a75f-4152-b7ad-1cdd79bf8e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:42.467843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8176d3-a75f-4152-b7ad-1cdd79bf8e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:42.468114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8176d3-a75f-4152-b7ad-1cdd79bf8e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:42.468396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8176d3-a75f-4152-b7ad-1cdd79bf8e28 admin admin] PATH_INFO: `/v3/projects/a1f9702161e7418393073132deb095b0/users/c6c13e3843b347e99e2c180659363548/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:42.486241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8176d3-a75f-4152-b7ad-1cdd79bf8e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f9702161e7418393073132deb095b0, user_id=c6c13e3843b347e99e2c180659363548, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:42.488969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8176d3-a75f-4152-b7ad-1cdd79bf8e28 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:42.504450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1270/2532] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:42 2022] PUT /identity/v3/projects/a1f9702161e7418393073132deb095b0/users/c6c13e3843b347e99e2c180659363548/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:42.509327 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbf912-84ab-41a7-b926-fff6a25abb6e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:42.520998 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbf912-84ab-41a7-b926-fff6a25abb6e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:42.591625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77c834-524e-44c9-87a5-00de97fdcb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:42.592205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77c834-524e-44c9-87a5-00de97fdcb8c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:42.592514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77c834-524e-44c9-87a5-00de97fdcb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:42.592797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77c834-524e-44c9-87a5-00de97fdcb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:42.593510 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77c834-524e-44c9-87a5-00de97fdcb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:42.595134 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77c834-524e-44c9-87a5-00de97fdcb8c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:42.609022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1263/2533] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:42.613593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8176d3-a75f-4152-b7ad-1cdd79bf8e28 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:42.624766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8176d3-a75f-4152-b7ad-1cdd79bf8e28 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:42.630074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e3979-1404-430f-9d91-189e0900a4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:42.630966 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e3979-1404-430f-9d91-189e0900a4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:42.631260 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e3979-1404-430f-9d91-189e0900a4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:42.631552 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e3979-1404-430f-9d91-189e0900a4bc admin admin] PATH_INFO: `/v3/projects/a1f9702161e7418393073132deb095b0/users/c6c13e3843b347e99e2c180659363548/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:42.633681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e3979-1404-430f-9d91-189e0900a4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f9702161e7418393073132deb095b0, user_id=c6c13e3843b347e99e2c180659363548, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:42.636753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e3979-1404-430f-9d91-189e0900a4bc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:42.648527 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1271/2534] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:42 2022] PUT /identity/v3/projects/a1f9702161e7418393073132deb095b0/users/c6c13e3843b347e99e2c180659363548/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:42.664929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5a37-6abb-4fed-80fc-8846191e2e94 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:42.665205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5a37-6abb-4fed-80fc-8846191e2e94 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:42.665592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5a37-6abb-4fed-80fc-8846191e2e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:42.695973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-601d5a37-6abb-4fed-80fc-8846191e2e94 None None] MFA Rules not processed for user `c6c13e3843b347e99e2c180659363548`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:42.697280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-601d5a37-6abb-4fed-80fc-8846191e2e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:42.768754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1264/2535] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:42.785494 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e3979-1404-430f-9d91-189e0900a4bc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:42.787338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ee2e3979-1404-430f-9d91-189e0900a4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:42.853374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e3979-1404-430f-9d91-189e0900a4bc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:42.868707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b5d8e-2711-4478-a50c-babdf14e1375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:42.869740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b5d8e-2711-4478-a50c-babdf14e1375 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:42.870171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b5d8e-2711-4478-a50c-babdf14e1375 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:42.870765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b5d8e-2711-4478-a50c-babdf14e1375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:42.883423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b5d8e-2711-4478-a50c-babdf14e1375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:42.886669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b5d8e-2711-4478-a50c-babdf14e1375 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:42.902429 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1272/2536] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:43.522529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d5a37-6abb-4fed-80fc-8846191e2e94 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:43.524724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-601d5a37-6abb-4fed-80fc-8846191e2e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:43.539210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d5a37-6abb-4fed-80fc-8846191e2e94 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:43.544531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c4421-ad88-4de1-8f49-1fbb500ba905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:43.545571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c4421-ad88-4de1-8f49-1fbb500ba905 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:43.547404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c4421-ad88-4de1-8f49-1fbb500ba905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:43.547789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c4421-ad88-4de1-8f49-1fbb500ba905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:43.578407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:43.635045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c4421-ad88-4de1-8f49-1fbb500ba905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:43.637834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c4421-ad88-4de1-8f49-1fbb500ba905 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:43.650632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1265/2537] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:47.795413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b5d8e-2711-4478-a50c-babdf14e1375 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:47.805011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b5d8e-2711-4478-a50c-babdf14e1375 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:47.810413 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882076db-e9ed-4763-ae6e-a45d7dc707e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:47.811083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882076db-e9ed-4763-ae6e-a45d7dc707e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:47.811357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882076db-e9ed-4763-ae6e-a45d7dc707e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:47.811627 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882076db-e9ed-4763-ae6e-a45d7dc707e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:47.864782 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:47.894085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882076db-e9ed-4763-ae6e-a45d7dc707e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:47.895738 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882076db-e9ed-4763-ae6e-a45d7dc707e1 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:47.907358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1273/2538] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:50.084450 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c4421-ad88-4de1-8f49-1fbb500ba905 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:50.155652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c4421-ad88-4de1-8f49-1fbb500ba905 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:50.160467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:50.161393 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:50.161681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:50.161957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] PATH_INFO: `/v3/users/127f94375a8b45759d8b451785e718c2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:50.163186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=127f94375a8b45759d8b451785e718c2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:50.165191 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:50.229305 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127f94375a8b45759d8b451785e718c2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:50.237132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127f94375a8b45759d8b451785e718c2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:50.250990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127f94375a8b45759d8b451785e718c2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:50.251863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127f94375a8b45759d8b451785e718c2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:50.252526 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127f94375a8b45759d8b451785e718c2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:50.267901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1266/2539] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:50 2022] DELETE /identity/v3/users/127f94375a8b45759d8b451785e718c2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:50.277911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b16b-10f6-4cad-b411-009e69780a8d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:50.278492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b16b-10f6-4cad-b411-009e69780a8d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:50.278492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b16b-10f6-4cad-b411-009e69780a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:50.300588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b154b16b-10f6-4cad-b411-009e69780a8d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:50.301913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b154b16b-10f6-4cad-b411-009e69780a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:50.370833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1274/2540] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:50.381572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:50.383218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:50.431353 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:50.451077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d11e94-385a-4bfa-a40c-2bfdf9a9f3bd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:50.454987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d263e-79c7-4c11-ab0e-2c1e4277d2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:50.455792 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d263e-79c7-4c11-ab0e-2c1e4277d2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:50.456080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d263e-79c7-4c11-ab0e-2c1e4277d2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:50.456359 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d263e-79c7-4c11-ab0e-2c1e4277d2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:50.466367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d263e-79c7-4c11-ab0e-2c1e4277d2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:50.467933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d263e-79c7-4c11-ab0e-2c1e4277d2f2 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:50.478228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1267/2541] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:50.779824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b16b-10f6-4cad-b411-009e69780a8d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:50.781519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b154b16b-10f6-4cad-b411-009e69780a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:50.795645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b16b-10f6-4cad-b411-009e69780a8d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:50.801069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:50.802043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:50.802392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:50.802737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] PATH_INFO: `/v3/projects/8f86c01e9e1e4397808df3ed77000737` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:50.804082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f86c01e9e1e4397808df3ed77000737)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:50.806199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:50.858069 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f86c01e9e1e4397808df3ed77000737', 'request_id': 'req-3397628b-4fde-4520-9216-a2436bd3b5ba'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:50.864689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f86c01e9e1e4397808df3ed77000737', 'request_id': 'req-3397628b-4fde-4520-9216-a2436bd3b5ba'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:50.871434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f86c01e9e1e4397808df3ed77000737', 'request_id': 'req-3397628b-4fde-4520-9216-a2436bd3b5ba'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:50.886436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] The token cache is being invalidate because project 8f86c01e9e1e4397808df3ed77000737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:50.886823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:50.887437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:50.889174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1275/2542] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:50 2022] DELETE /identity/v3/projects/8f86c01e9e1e4397808df3ed77000737 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:50.895320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d263e-79c7-4c11-ab0e-2c1e4277d2f2 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:50.906216 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d263e-79c7-4c11-ab0e-2c1e4277d2f2 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:50.972122 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:50.973120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:50.973487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:50.973971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] PATH_INFO: `/v3/users/1b565410ac024d319eae164437c68859` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:50.975389 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b565410ac024d319eae164437c68859)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:50.977422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:51.031669 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b565410ac024d319eae164437c68859'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.042102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b565410ac024d319eae164437c68859'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.055413 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b565410ac024d319eae164437c68859'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.056161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b565410ac024d319eae164437c68859'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.056835 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b565410ac024d319eae164437c68859'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.071627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1268/2543] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:50 2022] DELETE /identity/v3/users/1b565410ac024d319eae164437c68859 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:51.532019 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:51.533863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:51.561406 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397628b-4fde-4520-9216-a2436bd3b5ba admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:51.637898 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:51.638790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:51.639068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:51.639346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] PATH_INFO: `/v3/projects/389f60b538b54b49bff4889338468b9c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:51.640595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=389f60b538b54b49bff4889338468b9c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:51.642553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:51.649452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:51.707828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389f60b538b54b49bff4889338468b9c', 'request_id': 'req-ed398fe1-2572-4fda-96d9-aed7474716ab'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.714244 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389f60b538b54b49bff4889338468b9c', 'request_id': 'req-ed398fe1-2572-4fda-96d9-aed7474716ab'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.720470 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389f60b538b54b49bff4889338468b9c', 'request_id': 'req-ed398fe1-2572-4fda-96d9-aed7474716ab'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.742843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] The token cache is being invalidate because project 389f60b538b54b49bff4889338468b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:51.743137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.743931 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.746579 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1276/2544] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:51 2022] DELETE /identity/v3/projects/389f60b538b54b49bff4889338468b9c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:51.750569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:51.752817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:51.772219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af27517-f720-4770-a2d8-f1fd7f072354 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:51.835672 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ff386-8ada-4398-bd05-7e01f57c396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:51.837069 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ff386-8ada-4398-bd05-7e01f57c396e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:51.837523 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ff386-8ada-4398-bd05-7e01f57c396e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:51.837968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ff386-8ada-4398-bd05-7e01f57c396e admin admin] PATH_INFO: `/v3/users/c6c13e3843b347e99e2c180659363548` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:51.839531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ff386-8ada-4398-bd05-7e01f57c396e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c13e3843b347e99e2c180659363548)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:51.841958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ff386-8ada-4398-bd05-7e01f57c396e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:51.844963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:51.902597 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e5ff386-8ada-4398-bd05-7e01f57c396e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c13e3843b347e99e2c180659363548'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.915292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e5ff386-8ada-4398-bd05-7e01f57c396e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c13e3843b347e99e2c180659363548'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.932085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e5ff386-8ada-4398-bd05-7e01f57c396e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c13e3843b347e99e2c180659363548'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.932888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e5ff386-8ada-4398-bd05-7e01f57c396e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c13e3843b347e99e2c180659363548'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.933484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e5ff386-8ada-4398-bd05-7e01f57c396e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c13e3843b347e99e2c180659363548'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:51.959017 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1269/2545] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:51 2022] DELETE /identity/v3/users/c6c13e3843b347e99e2c180659363548 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:32:52.276829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:52.278674 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:52.295814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed398fe1-2572-4fda-96d9-aed7474716ab admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:52.382943 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fff6e-bde7-45c2-80bf-47796a513dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:52.383976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fff6e-bde7-45c2-80bf-47796a513dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:52.384292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fff6e-bde7-45c2-80bf-47796a513dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:52.384609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fff6e-bde7-45c2-80bf-47796a513dd8 admin admin] PATH_INFO: `/v3/projects/a1f9702161e7418393073132deb095b0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:52.386226 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fff6e-bde7-45c2-80bf-47796a513dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f9702161e7418393073132deb095b0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:52.388152 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fff6e-bde7-45c2-80bf-47796a513dd8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:52.438654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-685fff6e-bde7-45c2-80bf-47796a513dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f9702161e7418393073132deb095b0', 'request_id': 'req-685fff6e-bde7-45c2-80bf-47796a513dd8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:52.445826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-685fff6e-bde7-45c2-80bf-47796a513dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f9702161e7418393073132deb095b0', 'request_id': 'req-685fff6e-bde7-45c2-80bf-47796a513dd8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:52.453588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-685fff6e-bde7-45c2-80bf-47796a513dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f9702161e7418393073132deb095b0', 'request_id': 'req-685fff6e-bde7-45c2-80bf-47796a513dd8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:52.469030 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-685fff6e-bde7-45c2-80bf-47796a513dd8 admin admin] The token cache is being invalidate because project a1f9702161e7418393073132deb095b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:52.469330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-685fff6e-bde7-45c2-80bf-47796a513dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:52.470085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-685fff6e-bde7-45c2-80bf-47796a513dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:52.471928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1277/2546] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:52 2022] DELETE /identity/v3/projects/a1f9702161e7418393073132deb095b0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:52.477892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f01b6-ff3e-450b-ae43-d79208843126 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:52.478926 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f01b6-ff3e-450b-ae43-d79208843126 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:52.478926 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f01b6-ff3e-450b-ae43-d79208843126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:52.506312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ad1f01b6-ff3e-450b-ae43-d79208843126 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:52.507734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ad1f01b6-ff3e-450b-ae43-d79208843126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:52.589926 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1270/2547] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:52.599813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a27a55-004d-49ed-b7e8-32907bc5fc59 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:52.600339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a27a55-004d-49ed-b7e8-32907bc5fc59 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:52.600953 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a27a55-004d-49ed-b7e8-32907bc5fc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:52.623327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-43a27a55-004d-49ed-b7e8-32907bc5fc59 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:52.626487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-43a27a55-004d-49ed-b7e8-32907bc5fc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:52.644426 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f01b6-ff3e-450b-ae43-d79208843126 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:52.651805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1278/2548] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:52.656070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f01b6-ff3e-450b-ae43-d79208843126 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:52.664309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f35b31-2eef-4d44-82d2-b64a7e4c9915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:52.665764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f35b31-2eef-4d44-82d2-b64a7e4c9915 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:52.666827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f35b31-2eef-4d44-82d2-b64a7e4c9915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:52.667038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f35b31-2eef-4d44-82d2-b64a7e4c9915 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:52.667879 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f35b31-2eef-4d44-82d2-b64a7e4c9915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:52.668169 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f35b31-2eef-4d44-82d2-b64a7e4c9915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:52.670841 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f35b31-2eef-4d44-82d2-b64a7e4c9915 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:52.697048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a27a55-004d-49ed-b7e8-32907bc5fc59 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:52.699121 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-43a27a55-004d-49ed-b7e8-32907bc5fc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:52.721246 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1271/2549] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:32:52.725318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f35b31-2eef-4d44-82d2-b64a7e4c9915 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:52.730968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:52.747038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f35b31-2eef-4d44-82d2-b64a7e4c9915 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:52.763830 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ae330-9b2d-495f-9f9d-f09bfe2a047c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:52.765312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ae330-9b2d-495f-9f9d-f09bfe2a047c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:52.765743 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ae330-9b2d-495f-9f9d-f09bfe2a047c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:52.766167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ae330-9b2d-495f-9f9d-f09bfe2a047c admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:52.767139 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ae330-9b2d-495f-9f9d-f09bfe2a047c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:52.769408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ae330-9b2d-495f-9f9d-f09bfe2a047c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:52.826038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1272/2550] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:52 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:52.829793 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ae330-9b2d-495f-9f9d-f09bfe2a047c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:52.842855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a27a55-004d-49ed-b7e8-32907bc5fc59 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:52.933408 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:52.959112 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ae330-9b2d-495f-9f9d-f09bfe2a047c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:52.960291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d50a06-ce6c-4cf1-88f7-8feebe4e7549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:52.961029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d50a06-ce6c-4cf1-88f7-8feebe4e7549 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:52.961829 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d50a06-ce6c-4cf1-88f7-8feebe4e7549 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:52.961974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d50a06-ce6c-4cf1-88f7-8feebe4e7549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:52.966081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a4d50a06-ce6c-4cf1-88f7-8feebe4e7549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:52.970035 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f6f4-38e0-452c-b4a3-3f3ebdf63195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:52.970737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f6f4-38e0-452c-b4a3-3f3ebdf63195 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:52.971688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f6f4-38e0-452c-b4a3-3f3ebdf63195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:52.973373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f6f4-38e0-452c-b4a3-3f3ebdf63195 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:52.974433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5f6f4-38e0-452c-b4a3-3f3ebdf63195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:52.978201 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5f6f4-38e0-452c-b4a3-3f3ebdf63195 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:52.992794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d50a06-ce6c-4cf1-88f7-8feebe4e7549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:52.994443 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d50a06-ce6c-4cf1-88f7-8feebe4e7549 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:53.007926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1279/2551] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:32:53.022277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1273/2552] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:52 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:32:53.027006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d50a06-ce6c-4cf1-88f7-8feebe4e7549 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:53.041551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d50a06-ce6c-4cf1-88f7-8feebe4e7549 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:53.046977 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1eae7-aa5e-4019-9693-3539a647c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:53.047757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1eae7-aa5e-4019-9693-3539a647c301 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.047930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1eae7-aa5e-4019-9693-3539a647c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.048242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1eae7-aa5e-4019-9693-3539a647c301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.049084 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1eae7-aa5e-4019-9693-3539a647c301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:53.051115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1eae7-aa5e-4019-9693-3539a647c301 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:53.064538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1280/2553] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:32:53.067132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f6f4-38e0-452c-b4a3-3f3ebdf63195 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:53.078642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f6f4-38e0-452c-b4a3-3f3ebdf63195 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:53.084833 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2044ebe-2cbd-479d-b971-0c066585b0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:53.086588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2044ebe-2cbd-479d-b971-0c066585b0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.086588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2044ebe-2cbd-479d-b971-0c066585b0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.086588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2044ebe-2cbd-479d-b971-0c066585b0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.088830 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2044ebe-2cbd-479d-b971-0c066585b0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:53.090571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2044ebe-2cbd-479d-b971-0c066585b0e8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:53.101622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1274/2554] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:53.106027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1eae7-aa5e-4019-9693-3539a647c301 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:53.116998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1eae7-aa5e-4019-9693-3539a647c301 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:53.121744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bfd41-f777-459b-96c5-5f4ab5437449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:53.122688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bfd41-f777-459b-96c5-5f4ab5437449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.123004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bfd41-f777-459b-96c5-5f4ab5437449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.123274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bfd41-f777-459b-96c5-5f4ab5437449 admin admin] PATH_INFO: `/v3/projects/0c9d559a49a64033aa35e67c0ed4ec72/users/f22f5dddea81481eb5f08f26c4b01ac1/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.138619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bfd41-f777-459b-96c5-5f4ab5437449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d559a49a64033aa35e67c0ed4ec72, user_id=f22f5dddea81481eb5f08f26c4b01ac1, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:53.141326 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bfd41-f777-459b-96c5-5f4ab5437449 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:53.157676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1281/2555] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:53 2022] PUT /identity/v3/projects/0c9d559a49a64033aa35e67c0ed4ec72/users/f22f5dddea81481eb5f08f26c4b01ac1/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:53.169061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5654b-9f65-4c3a-b324-fde140e041e0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.169351 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5654b-9f65-4c3a-b324-fde140e041e0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.169682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5654b-9f65-4c3a-b324-fde140e041e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.196678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1ea5654b-9f65-4c3a-b324-fde140e041e0 None None] MFA Rules not processed for user `f22f5dddea81481eb5f08f26c4b01ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:53.197932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1ea5654b-9f65-4c3a-b324-fde140e041e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:53.274248 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1275/2556] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:53.278807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bfd41-f777-459b-96c5-5f4ab5437449 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:53.374907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bfd41-f777-459b-96c5-5f4ab5437449 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:53.381301 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992be2b2-0b71-46ad-9787-5c9728421983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:53.382224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be2b2-0b71-46ad-9787-5c9728421983 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.382547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be2b2-0b71-46ad-9787-5c9728421983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.383091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be2b2-0b71-46ad-9787-5c9728421983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.383806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992be2b2-0b71-46ad-9787-5c9728421983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:53.386415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992be2b2-0b71-46ad-9787-5c9728421983 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:53.401981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:53.428271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1282/2557] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:53 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:53.429590 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5654b-9f65-4c3a-b324-fde140e041e0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:53.443458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5654b-9f65-4c3a-b324-fde140e041e0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:53.505723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c5f5f-936c-4c44-a27c-08de255eb435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:53.506500 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c5f5f-936c-4c44-a27c-08de255eb435 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.506781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c5f5f-936c-4c44-a27c-08de255eb435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.507127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c5f5f-936c-4c44-a27c-08de255eb435 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.507865 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c5f5f-936c-4c44-a27c-08de255eb435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:53.509909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c5f5f-936c-4c44-a27c-08de255eb435 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:53.533244 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1276/2558] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:53 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:53.537489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992be2b2-0b71-46ad-9787-5c9728421983 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:53.548994 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992be2b2-0b71-46ad-9787-5c9728421983 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:53.553719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74d0a1-5c37-41ec-a004-96527f280fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:53.554441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d0a1-5c37-41ec-a004-96527f280fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.554720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d0a1-5c37-41ec-a004-96527f280fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.554993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d0a1-5c37-41ec-a004-96527f280fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.556275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74d0a1-5c37-41ec-a004-96527f280fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:53.557338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74d0a1-5c37-41ec-a004-96527f280fa8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:53.569515 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1283/2559] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:32:53.574041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c5f5f-936c-4c44-a27c-08de255eb435 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:53.584988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c5f5f-936c-4c44-a27c-08de255eb435 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:53.589922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e2c7d-b8e6-467a-8581-f76c013e45aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:53.590809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e2c7d-b8e6-467a-8581-f76c013e45aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.591084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e2c7d-b8e6-467a-8581-f76c013e45aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.591493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e2c7d-b8e6-467a-8581-f76c013e45aa admin admin] PATH_INFO: `/v3/projects/f606f3a02b2e45538b411948916612e9/users/e8583966b31d4443930a3ba125a2d1b8/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.619670 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e2c7d-b8e6-467a-8581-f76c013e45aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f606f3a02b2e45538b411948916612e9, user_id=e8583966b31d4443930a3ba125a2d1b8, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:53.623274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e2c7d-b8e6-467a-8581-f76c013e45aa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:53.639710 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1277/2560] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:53 2022] PUT /identity/v3/projects/f606f3a02b2e45538b411948916612e9/users/e8583966b31d4443930a3ba125a2d1b8/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:53.644142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74d0a1-5c37-41ec-a004-96527f280fa8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:53.655595 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74d0a1-5c37-41ec-a004-96527f280fa8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:53.725809 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c1129-59d2-43ce-a229-cea49bb2f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:53.727288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c1129-59d2-43ce-a229-cea49bb2f9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.727598 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c1129-59d2-43ce-a229-cea49bb2f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.728055 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c1129-59d2-43ce-a229-cea49bb2f9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.728871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c1129-59d2-43ce-a229-cea49bb2f9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:53.730530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c1129-59d2-43ce-a229-cea49bb2f9a1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:53.741680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1284/2561] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:32:53.746078 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e2c7d-b8e6-467a-8581-f76c013e45aa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:53.757046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e2c7d-b8e6-467a-8581-f76c013e45aa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:53.762962 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289fa53-45a1-4720-97c6-eec6a457eba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:53.764041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289fa53-45a1-4720-97c6-eec6a457eba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.764726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289fa53-45a1-4720-97c6-eec6a457eba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.764726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289fa53-45a1-4720-97c6-eec6a457eba7 admin admin] PATH_INFO: `/v3/projects/f606f3a02b2e45538b411948916612e9/users/e8583966b31d4443930a3ba125a2d1b8/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.767226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289fa53-45a1-4720-97c6-eec6a457eba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f606f3a02b2e45538b411948916612e9, user_id=e8583966b31d4443930a3ba125a2d1b8, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:53.770102 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289fa53-45a1-4720-97c6-eec6a457eba7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:53.781535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1278/2562] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:53 2022] PUT /identity/v3/projects/f606f3a02b2e45538b411948916612e9/users/e8583966b31d4443930a3ba125a2d1b8/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:53.851425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc38b1-3141-4ae8-8cb5-93836c915ebf None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:53.851835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc38b1-3141-4ae8-8cb5-93836c915ebf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:53.852411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc38b1-3141-4ae8-8cb5-93836c915ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:53.883319 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-39cc38b1-3141-4ae8-8cb5-93836c915ebf None None] MFA Rules not processed for user `e8583966b31d4443930a3ba125a2d1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:53.884802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-39cc38b1-3141-4ae8-8cb5-93836c915ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:53.957343 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1285/2563] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:53.968772 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289fa53-45a1-4720-97c6-eec6a457eba7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:53.970744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2289fa53-45a1-4720-97c6-eec6a457eba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:53.981585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:54.036757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289fa53-45a1-4720-97c6-eec6a457eba7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:54.040404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2db00-9905-442a-a10b-82078b0a5a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:54.041164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2db00-9905-442a-a10b-82078b0a5a85 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:54.041447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2db00-9905-442a-a10b-82078b0a5a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:54.041722 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2db00-9905-442a-a10b-82078b0a5a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:54.051984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2db00-9905-442a-a10b-82078b0a5a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:54.053635 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2db00-9905-442a-a10b-82078b0a5a85 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:54.064182 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1279/2564] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:54.681602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc38b1-3141-4ae8-8cb5-93836c915ebf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:54.765692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc38b1-3141-4ae8-8cb5-93836c915ebf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:54.771274 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:54.772205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:54.772486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:54.772818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] PATH_INFO: `/v3/users/f22f5dddea81481eb5f08f26c4b01ac1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:54.774044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f22f5dddea81481eb5f08f26c4b01ac1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:54.775993 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:54.778925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:54.833480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f22f5dddea81481eb5f08f26c4b01ac1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:54.841833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f22f5dddea81481eb5f08f26c4b01ac1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:54.849675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f22f5dddea81481eb5f08f26c4b01ac1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:54.864415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f22f5dddea81481eb5f08f26c4b01ac1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:54.865264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f22f5dddea81481eb5f08f26c4b01ac1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:54.876052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1286/2565] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:54 2022] DELETE /identity/v3/users/f22f5dddea81481eb5f08f26c4b01ac1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:32:54.880857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971db0c-5e83-4785-aee8-994bfef11379 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:54.881300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971db0c-5e83-4785-aee8-994bfef11379 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:54.881491 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971db0c-5e83-4785-aee8-994bfef11379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:54.901907 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5971db0c-5e83-4785-aee8-994bfef11379 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:54.904241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5971db0c-5e83-4785-aee8-994bfef11379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:54.974350 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1280/2566] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:54.988451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:54.990699 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:55.057192 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73130872-f6cb-4e88-8847-0f4f6a567131 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:55.061820 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faf54b-37e9-47fa-a936-334e117ace9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:55.062491 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faf54b-37e9-47fa-a936-334e117ace9f service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:55.062779 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faf54b-37e9-47fa-a936-334e117ace9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:55.063053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faf54b-37e9-47fa-a936-334e117ace9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:55.072831 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faf54b-37e9-47fa-a936-334e117ace9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:55.074289 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faf54b-37e9-47fa-a936-334e117ace9f service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:55.084285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1287/2567] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:55.389613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971db0c-5e83-4785-aee8-994bfef11379 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:55.391192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5971db0c-5e83-4785-aee8-994bfef11379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:55.404147 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971db0c-5e83-4785-aee8-994bfef11379 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:55.409593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:55.410477 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:55.410760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:55.411038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] PATH_INFO: `/v3/projects/0c9d559a49a64033aa35e67c0ed4ec72` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:55.412339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9d559a49a64033aa35e67c0ed4ec72)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:55.414629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:55.466397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9d559a49a64033aa35e67c0ed4ec72', 'request_id': 'req-a0c22c77-e281-412f-9cb4-b76eb75af698'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:55.474885 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9d559a49a64033aa35e67c0ed4ec72', 'request_id': 'req-a0c22c77-e281-412f-9cb4-b76eb75af698'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:55.483252 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9d559a49a64033aa35e67c0ed4ec72', 'request_id': 'req-a0c22c77-e281-412f-9cb4-b76eb75af698'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:55.495436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] The token cache is being invalidate because project 0c9d559a49a64033aa35e67c0ed4ec72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:55.495869 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:55.496527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:55.498342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1281/2568] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:55 2022] DELETE /identity/v3/projects/0c9d559a49a64033aa35e67c0ed4ec72 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:55.504214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faf54b-37e9-47fa-a936-334e117ace9f service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:55.519350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faf54b-37e9-47fa-a936-334e117ace9f service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:55.587264 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71e967-245c-4087-b84b-b40dd76a74cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:55.588078 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71e967-245c-4087-b84b-b40dd76a74cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:55.588357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71e967-245c-4087-b84b-b40dd76a74cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:55.588674 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71e967-245c-4087-b84b-b40dd76a74cf admin admin] PATH_INFO: `/v3/users/e8583966b31d4443930a3ba125a2d1b8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:55.590047 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71e967-245c-4087-b84b-b40dd76a74cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8583966b31d4443930a3ba125a2d1b8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:55.592486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71e967-245c-4087-b84b-b40dd76a74cf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:55.622878 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:55.647018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cd71e967-245c-4087-b84b-b40dd76a74cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8583966b31d4443930a3ba125a2d1b8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:55.655467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cd71e967-245c-4087-b84b-b40dd76a74cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8583966b31d4443930a3ba125a2d1b8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:55.662591 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cd71e967-245c-4087-b84b-b40dd76a74cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8583966b31d4443930a3ba125a2d1b8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:55.675955 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cd71e967-245c-4087-b84b-b40dd76a74cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8583966b31d4443930a3ba125a2d1b8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:55.676900 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cd71e967-245c-4087-b84b-b40dd76a74cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8583966b31d4443930a3ba125a2d1b8'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:55.685285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1288/2569] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:32:55 2022] DELETE /identity/v3/users/e8583966b31d4443930a3ba125a2d1b8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:55.969687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:55.971533 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:55.987131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c22c77-e281-412f-9cb4-b76eb75af698 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:56.034776 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:56.064376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fa867-b467-4fa9-a245-1b40db9a98ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:56.065292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fa867-b467-4fa9-a245-1b40db9a98ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:56.065573 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fa867-b467-4fa9-a245-1b40db9a98ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:56.065846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fa867-b467-4fa9-a245-1b40db9a98ff admin admin] PATH_INFO: `/v3/projects/f606f3a02b2e45538b411948916612e9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:56.067086 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fa867-b467-4fa9-a245-1b40db9a98ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f606f3a02b2e45538b411948916612e9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:56.069110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fa867-b467-4fa9-a245-1b40db9a98ff admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:56.119801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-868fa867-b467-4fa9-a245-1b40db9a98ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f606f3a02b2e45538b411948916612e9', 'request_id': 'req-868fa867-b467-4fa9-a245-1b40db9a98ff'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:56.129505 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-868fa867-b467-4fa9-a245-1b40db9a98ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f606f3a02b2e45538b411948916612e9', 'request_id': 'req-868fa867-b467-4fa9-a245-1b40db9a98ff'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:56.136073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-868fa867-b467-4fa9-a245-1b40db9a98ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f606f3a02b2e45538b411948916612e9', 'request_id': 'req-868fa867-b467-4fa9-a245-1b40db9a98ff'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:56.149525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-868fa867-b467-4fa9-a245-1b40db9a98ff admin admin] The token cache is being invalidate because project f606f3a02b2e45538b411948916612e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:32:56.149817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-868fa867-b467-4fa9-a245-1b40db9a98ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:56.150534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-868fa867-b467-4fa9-a245-1b40db9a98ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:32:56.152191 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1282/2570] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:32:55 2022] DELETE /identity/v3/projects/f606f3a02b2e45538b411948916612e9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:56.157492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0d1cf-c371-4764-a1d5-976b9560907f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:56.157781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0d1cf-c371-4764-a1d5-976b9560907f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:56.158057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0d1cf-c371-4764-a1d5-976b9560907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:56.177928 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2da0d1cf-c371-4764-a1d5-976b9560907f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:56.179187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2da0d1cf-c371-4764-a1d5-976b9560907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:56.245989 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1289/2571] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:56.253877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805e375-8591-4942-81eb-40c4811d69a0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:56.254160 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805e375-8591-4942-81eb-40c4811d69a0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:56.254432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805e375-8591-4942-81eb-40c4811d69a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:56.274063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6805e375-8591-4942-81eb-40c4811d69a0 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:56.275336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6805e375-8591-4942-81eb-40c4811d69a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:56.285517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1283/2572] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:56.290584 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0d1cf-c371-4764-a1d5-976b9560907f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:56.302763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0d1cf-c371-4764-a1d5-976b9560907f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:56.307748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deff7e-fb92-4dfc-9932-59c99870ae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:56.308416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deff7e-fb92-4dfc-9932-59c99870ae50 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:56.308733 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deff7e-fb92-4dfc-9932-59c99870ae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:56.309005 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deff7e-fb92-4dfc-9932-59c99870ae50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:56.309739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deff7e-fb92-4dfc-9932-59c99870ae50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:32:56.310045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deff7e-fb92-4dfc-9932-59c99870ae50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:56.312781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deff7e-fb92-4dfc-9932-59c99870ae50 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:56.326497 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1290/2573] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:32:56.331820 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805e375-8591-4942-81eb-40c4811d69a0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:56.342332 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805e375-8591-4942-81eb-40c4811d69a0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:56.347342 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457fb4b-c965-489b-a966-26cda90b3734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:56.348738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457fb4b-c965-489b-a966-26cda90b3734 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:56.348738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457fb4b-c965-489b-a966-26cda90b3734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:56.348978 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457fb4b-c965-489b-a966-26cda90b3734 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:56.349712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457fb4b-c965-489b-a966-26cda90b3734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:56.351649 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457fb4b-c965-489b-a966-26cda90b3734 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:56.379757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1284/2574] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:56 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:56.384113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deff7e-fb92-4dfc-9932-59c99870ae50 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:56.394542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deff7e-fb92-4dfc-9932-59c99870ae50 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:56.469624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97331935-cd7f-4cb2-bd5a-998558ddd75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:56.470635 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97331935-cd7f-4cb2-bd5a-998558ddd75c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:56.471041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97331935-cd7f-4cb2-bd5a-998558ddd75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:56.471423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97331935-cd7f-4cb2-bd5a-998558ddd75c admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:56.472217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97331935-cd7f-4cb2-bd5a-998558ddd75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:56.474416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97331935-cd7f-4cb2-bd5a-998558ddd75c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:56.495307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1291/2575] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:56 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:32:56.499551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457fb4b-c965-489b-a966-26cda90b3734 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:56.510234 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457fb4b-c965-489b-a966-26cda90b3734 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:56.515291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c492842-97d4-430f-b519-051873b9b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:56.515959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c492842-97d4-430f-b519-051873b9b9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:56.516241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c492842-97d4-430f-b519-051873b9b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:56.516543 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c492842-97d4-430f-b519-051873b9b9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:56.517307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c492842-97d4-430f-b519-051873b9b9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:56.518934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c492842-97d4-430f-b519-051873b9b9a1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:56.532334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1285/2576] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:56.536643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97331935-cd7f-4cb2-bd5a-998558ddd75c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:56.546945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97331935-cd7f-4cb2-bd5a-998558ddd75c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:56.551869 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc09164-65d6-432b-8dd5-b85ccda0103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:56.552536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc09164-65d6-432b-8dd5-b85ccda0103c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:56.552866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc09164-65d6-432b-8dd5-b85ccda0103c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:56.553115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc09164-65d6-432b-8dd5-b85ccda0103c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:56.553843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc09164-65d6-432b-8dd5-b85ccda0103c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:56.555458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc09164-65d6-432b-8dd5-b85ccda0103c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:56.565804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1292/2577] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:56.570440 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c492842-97d4-430f-b519-051873b9b9a1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:56.581216 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c492842-97d4-430f-b519-051873b9b9a1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:56.590441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf0592-0300-44d6-bf63-cf45283a0b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:56.591667 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf0592-0300-44d6-bf63-cf45283a0b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:56.591952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf0592-0300-44d6-bf63-cf45283a0b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:56.592232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf0592-0300-44d6-bf63-cf45283a0b9b admin admin] PATH_INFO: `/v3/projects/35f2e3d4d4074071910e3a0795e802c0/users/37df7f4460ec4cd4abf5b05d40c987fb/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:56.610843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf0592-0300-44d6-bf63-cf45283a0b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f2e3d4d4074071910e3a0795e802c0, user_id=37df7f4460ec4cd4abf5b05d40c987fb, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:56.613569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf0592-0300-44d6-bf63-cf45283a0b9b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:56.630157 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1286/2578] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:56 2022] PUT /identity/v3/projects/35f2e3d4d4074071910e3a0795e802c0/users/37df7f4460ec4cd4abf5b05d40c987fb/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:56.641971 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d2126-a42c-4ed4-9597-92b2da5d4a76 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:56.642361 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d2126-a42c-4ed4-9597-92b2da5d4a76 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:56.642760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d2126-a42c-4ed4-9597-92b2da5d4a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:56.666330 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:56.679414 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b63d2126-a42c-4ed4-9597-92b2da5d4a76 None None] MFA Rules not processed for user `37df7f4460ec4cd4abf5b05d40c987fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:56.681941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b63d2126-a42c-4ed4-9597-92b2da5d4a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:56.752075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1293/2579] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:56.758364 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf0592-0300-44d6-bf63-cf45283a0b9b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:56.826148 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf0592-0300-44d6-bf63-cf45283a0b9b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:56.832133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b6545-bf3e-4ab7-b25d-19e45e647ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:56.832837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b6545-bf3e-4ab7-b25d-19e45e647ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:56.833115 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b6545-bf3e-4ab7-b25d-19e45e647ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:56.833410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b6545-bf3e-4ab7-b25d-19e45e647ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:56.834100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b6545-bf3e-4ab7-b25d-19e45e647ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:56.836022 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b6545-bf3e-4ab7-b25d-19e45e647ce0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:56.839560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:56.865091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1287/2580] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:32:56 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:56.870220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d2126-a42c-4ed4-9597-92b2da5d4a76 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:56.888782 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d2126-a42c-4ed4-9597-92b2da5d4a76 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:56.962825 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d565a54-571d-4622-bad2-a953b094414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:56.963516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565a54-571d-4622-bad2-a953b094414f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:56.963802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565a54-571d-4622-bad2-a953b094414f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:56.964080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565a54-571d-4622-bad2-a953b094414f admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:56.964823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d565a54-571d-4622-bad2-a953b094414f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:56.966886 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d565a54-571d-4622-bad2-a953b094414f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:56.995723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1294/2581] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:32:56 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:32:57.000110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b6545-bf3e-4ab7-b25d-19e45e647ce0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:57.012936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b6545-bf3e-4ab7-b25d-19e45e647ce0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:57.018897 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e13ad-0872-4932-b4de-05ceb1e809ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:57.019579 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e13ad-0872-4932-b4de-05ceb1e809ee admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:57.019862 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e13ad-0872-4932-b4de-05ceb1e809ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:57.020131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e13ad-0872-4932-b4de-05ceb1e809ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:57.021053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e13ad-0872-4932-b4de-05ceb1e809ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:57.022678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e13ad-0872-4932-b4de-05ceb1e809ee admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:57.040083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1288/2582] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:57.045017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d565a54-571d-4622-bad2-a953b094414f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:57.056418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d565a54-571d-4622-bad2-a953b094414f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:57.062883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2c740-88aa-4a2e-9f36-6bfe89b244ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:57.063802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2c740-88aa-4a2e-9f36-6bfe89b244ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:57.064074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2c740-88aa-4a2e-9f36-6bfe89b244ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:57.064369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2c740-88aa-4a2e-9f36-6bfe89b244ad admin admin] PATH_INFO: `/v3/projects/3dac1dc910b54cbabe7ec585a76da363/users/17134310cf1244a2aa8c91960dbe7235/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:57.083748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2c740-88aa-4a2e-9f36-6bfe89b244ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dac1dc910b54cbabe7ec585a76da363, user_id=17134310cf1244a2aa8c91960dbe7235, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:57.086508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2c740-88aa-4a2e-9f36-6bfe89b244ad admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:57.101061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1295/2583] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:57 2022] PUT /identity/v3/projects/3dac1dc910b54cbabe7ec585a76da363/users/17134310cf1244a2aa8c91960dbe7235/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:57.105034 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e13ad-0872-4932-b4de-05ceb1e809ee admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:57.120816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e13ad-0872-4932-b4de-05ceb1e809ee admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:57.187939 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04442e-97fb-460b-8af5-97a303c66153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:57.188938 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04442e-97fb-460b-8af5-97a303c66153 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:57.189292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04442e-97fb-460b-8af5-97a303c66153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:57.189627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04442e-97fb-460b-8af5-97a303c66153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:57.190636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04442e-97fb-460b-8af5-97a303c66153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:57.192471 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04442e-97fb-460b-8af5-97a303c66153 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:57.203577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1289/2584] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:32:57.207857 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2c740-88aa-4a2e-9f36-6bfe89b244ad admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:57.219034 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2c740-88aa-4a2e-9f36-6bfe89b244ad admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:57.223909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed0485-20f6-4b5c-a17a-abba83adc470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:57.224839 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed0485-20f6-4b5c-a17a-abba83adc470 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:57.225214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed0485-20f6-4b5c-a17a-abba83adc470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:57.225483 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed0485-20f6-4b5c-a17a-abba83adc470 admin admin] PATH_INFO: `/v3/projects/3dac1dc910b54cbabe7ec585a76da363/users/17134310cf1244a2aa8c91960dbe7235/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:57.227451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed0485-20f6-4b5c-a17a-abba83adc470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dac1dc910b54cbabe7ec585a76da363, user_id=17134310cf1244a2aa8c91960dbe7235, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:57.230118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed0485-20f6-4b5c-a17a-abba83adc470 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:57.241077 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1296/2585] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:32:57 2022] PUT /identity/v3/projects/3dac1dc910b54cbabe7ec585a76da363/users/17134310cf1244a2aa8c91960dbe7235/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:32:57.263449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83dca5-fd39-4b6f-be5d-60cee3b45ea2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:57.263740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83dca5-fd39-4b6f-be5d-60cee3b45ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:57.264024 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83dca5-fd39-4b6f-be5d-60cee3b45ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:57.294960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-aa83dca5-fd39-4b6f-be5d-60cee3b45ea2 None None] MFA Rules not processed for user `17134310cf1244a2aa8c91960dbe7235`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:57.294960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-aa83dca5-fd39-4b6f-be5d-60cee3b45ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:57.380407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1290/2586] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:32:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:57.393088 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed0485-20f6-4b5c-a17a-abba83adc470 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:57.395029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dbed0485-20f6-4b5c-a17a-abba83adc470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:57.458687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed0485-20f6-4b5c-a17a-abba83adc470 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:57.462543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21198-be45-421d-80e0-eb337d19edbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:57.463223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21198-be45-421d-80e0-eb337d19edbb service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:57.463496 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21198-be45-421d-80e0-eb337d19edbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:57.463772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21198-be45-421d-80e0-eb337d19edbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:57.468645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:57.536530 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21198-be45-421d-80e0-eb337d19edbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:57.538025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21198-be45-421d-80e0-eb337d19edbb service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:57.554167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1297/2587] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:58.369948 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83dca5-fd39-4b6f-be5d-60cee3b45ea2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:58.371956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-aa83dca5-fd39-4b6f-be5d-60cee3b45ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:58.433163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83dca5-fd39-4b6f-be5d-60cee3b45ea2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:58.437362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db4352-9000-40aa-b183-e8df25ef8a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:58.438021 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db4352-9000-40aa-b183-e8df25ef8a06 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:58.438302 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db4352-9000-40aa-b183-e8df25ef8a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:58.438578 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db4352-9000-40aa-b183-e8df25ef8a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:58.440506 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e6db4352-9000-40aa-b183-e8df25ef8a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:58.451668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:58.517170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db4352-9000-40aa-b183-e8df25ef8a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:58.518487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db4352-9000-40aa-b183-e8df25ef8a06 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:58.531207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1291/2588] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:58.672150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aa0c4-4a7d-493f-90df-3acb798fdd62 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:58.672952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aa0c4-4a7d-493f-90df-3acb798fdd62 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:58.672952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aa0c4-4a7d-493f-90df-3acb798fdd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:58.693380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5d1aa0c4-4a7d-493f-90df-3acb798fdd62 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:58.694107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5d1aa0c4-4a7d-493f-90df-3acb798fdd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:58.760876 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1298/2589] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:32:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:58.817493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db4352-9000-40aa-b183-e8df25ef8a06 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:58.819638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e6db4352-9000-40aa-b183-e8df25ef8a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:58.895821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db4352-9000-40aa-b183-e8df25ef8a06 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:58.900933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9248f8a-4f59-45f3-a2fb-c4407d42d00e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:58.901623 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248f8a-4f59-45f3-a2fb-c4407d42d00e service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:58.901934 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248f8a-4f59-45f3-a2fb-c4407d42d00e service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:58.902202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248f8a-4f59-45f3-a2fb-c4407d42d00e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:58.911051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9248f8a-4f59-45f3-a2fb-c4407d42d00e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:58.912685 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9248f8a-4f59-45f3-a2fb-c4407d42d00e service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:58.922661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1292/2590] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:32:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:33:02.678403 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aa0c4-4a7d-493f-90df-3acb798fdd62 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:02.694701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aa0c4-4a7d-493f-90df-3acb798fdd62 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:02.716185 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c13f0-3ef0-4cbc-8120-27f072833b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:02.717218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c13f0-3ef0-4cbc-8120-27f072833b15 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:02.717815 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c13f0-3ef0-4cbc-8120-27f072833b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:02.718273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c13f0-3ef0-4cbc-8120-27f072833b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:02.738708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c13f0-3ef0-4cbc-8120-27f072833b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:02.741256 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c13f0-3ef0-4cbc-8120-27f072833b15 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:02.760038 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1299/2591] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:02.948090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9248f8a-4f59-45f3-a2fb-c4407d42d00e service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:02.949816 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e9248f8a-4f59-45f3-a2fb-c4407d42d00e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:02.970346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9248f8a-4f59-45f3-a2fb-c4407d42d00e service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:02.976552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e859a-2b3f-430d-8c9e-ad7f2632b78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:02.977889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e859a-2b3f-430d-8c9e-ad7f2632b78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:02.978382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e859a-2b3f-430d-8c9e-ad7f2632b78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:02.978876 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e859a-2b3f-430d-8c9e-ad7f2632b78a admin admin] PATH_INFO: `/v3/users/402c84b80e4b4996af901e79bf82c4b1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:02.980644 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e859a-2b3f-430d-8c9e-ad7f2632b78a admin admin] RBAC: Authorizing `identity:delete_user(user_id=402c84b80e4b4996af901e79bf82c4b1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:02.983049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e859a-2b3f-430d-8c9e-ad7f2632b78a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:03.048260 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fa6e859a-2b3f-430d-8c9e-ad7f2632b78a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '402c84b80e4b4996af901e79bf82c4b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.057804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fa6e859a-2b3f-430d-8c9e-ad7f2632b78a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '402c84b80e4b4996af901e79bf82c4b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.078352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fa6e859a-2b3f-430d-8c9e-ad7f2632b78a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '402c84b80e4b4996af901e79bf82c4b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.079325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fa6e859a-2b3f-430d-8c9e-ad7f2632b78a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '402c84b80e4b4996af901e79bf82c4b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.080329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fa6e859a-2b3f-430d-8c9e-ad7f2632b78a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '402c84b80e4b4996af901e79bf82c4b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.104522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1293/2592] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:02 2022] DELETE /identity/v3/users/402c84b80e4b4996af901e79bf82c4b1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:03.466940 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c13f0-3ef0-4cbc-8120-27f072833b15 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:03.485247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c13f0-3ef0-4cbc-8120-27f072833b15 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:03.575261 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22992654-67ef-4b1d-8343-250151e5dec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:03.576334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22992654-67ef-4b1d-8343-250151e5dec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:03.576670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22992654-67ef-4b1d-8343-250151e5dec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:03.576948 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22992654-67ef-4b1d-8343-250151e5dec3 admin admin] PATH_INFO: `/v3/projects/43adc7d982d04ccc897b8aad1c5c9793` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:03.578621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22992654-67ef-4b1d-8343-250151e5dec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43adc7d982d04ccc897b8aad1c5c9793)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:03.581081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22992654-67ef-4b1d-8343-250151e5dec3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:03.638205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:03.649252 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-22992654-67ef-4b1d-8343-250151e5dec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43adc7d982d04ccc897b8aad1c5c9793', 'request_id': 'req-22992654-67ef-4b1d-8343-250151e5dec3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.657904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-22992654-67ef-4b1d-8343-250151e5dec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43adc7d982d04ccc897b8aad1c5c9793', 'request_id': 'req-22992654-67ef-4b1d-8343-250151e5dec3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.667732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-22992654-67ef-4b1d-8343-250151e5dec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43adc7d982d04ccc897b8aad1c5c9793', 'request_id': 'req-22992654-67ef-4b1d-8343-250151e5dec3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.686017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-22992654-67ef-4b1d-8343-250151e5dec3 admin admin] The token cache is being invalidate because project 43adc7d982d04ccc897b8aad1c5c9793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:03.686757 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-22992654-67ef-4b1d-8343-250151e5dec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.687353 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-22992654-67ef-4b1d-8343-250151e5dec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:03.689486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1300/2593] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:03 2022] DELETE /identity/v3/projects/43adc7d982d04ccc897b8aad1c5c9793 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:03.694648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d464d-d167-41c2-b4da-8d004882a1f3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:03.695067 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d464d-d167-41c2-b4da-8d004882a1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:03.695600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d464d-d167-41c2-b4da-8d004882a1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:03.723679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:03.730952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-725d464d-d167-41c2-b4da-8d004882a1f3 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:03.734191 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-725d464d-d167-41c2-b4da-8d004882a1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:03.812719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1294/2594] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:03.821542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62f902-b887-46e4-a884-e019ba59f3d5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:03.821929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62f902-b887-46e4-a884-e019ba59f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:03.822224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62f902-b887-46e4-a884-e019ba59f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:03.843350 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ae62f902-b887-46e4-a884-e019ba59f3d5 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:03.844754 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ae62f902-b887-46e4-a884-e019ba59f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:03.856220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1301/2595] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:03.857804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d464d-d167-41c2-b4da-8d004882a1f3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:03.869511 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d464d-d167-41c2-b4da-8d004882a1f3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:03.874606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08785ad-2925-498d-9578-ae35b1e26409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:03.875290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08785ad-2925-498d-9578-ae35b1e26409 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:03.875771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08785ad-2925-498d-9578-ae35b1e26409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:03.876054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08785ad-2925-498d-9578-ae35b1e26409 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:03.881065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08785ad-2925-498d-9578-ae35b1e26409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:33:03.881460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08785ad-2925-498d-9578-ae35b1e26409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:03.883161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08785ad-2925-498d-9578-ae35b1e26409 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:03.908624 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62f902-b887-46e4-a884-e019ba59f3d5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:03.917188 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1295/2596] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:33:03.928336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62f902-b887-46e4-a884-e019ba59f3d5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:03.938472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ddca2-5a1e-4361-bff0-2420246ae835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:03.939481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ddca2-5a1e-4361-bff0-2420246ae835 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:03.939941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ddca2-5a1e-4361-bff0-2420246ae835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:03.940396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ddca2-5a1e-4361-bff0-2420246ae835 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:03.941316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ddca2-5a1e-4361-bff0-2420246ae835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:03.943451 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ddca2-5a1e-4361-bff0-2420246ae835 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:03.984682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1302/2597] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:03 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:33:03.989207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08785ad-2925-498d-9578-ae35b1e26409 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:04.002952 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08785ad-2925-498d-9578-ae35b1e26409 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:04.084993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d0bfb-6c36-4aa2-af6d-4b5d5c2293c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:04.086052 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d0bfb-6c36-4aa2-af6d-4b5d5c2293c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:04.086662 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d0bfb-6c36-4aa2-af6d-4b5d5c2293c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:04.087156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d0bfb-6c36-4aa2-af6d-4b5d5c2293c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:04.087969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d0bfb-6c36-4aa2-af6d-4b5d5c2293c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:04.090089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d0bfb-6c36-4aa2-af6d-4b5d5c2293c0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:04.122370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1296/2598] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:03 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:04.123313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ddca2-5a1e-4361-bff0-2420246ae835 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:04.136262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ddca2-5a1e-4361-bff0-2420246ae835 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:04.141680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b348b5-46f5-4762-b060-d5cdc46d6816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:04.142598 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b348b5-46f5-4762-b060-d5cdc46d6816 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:04.143037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b348b5-46f5-4762-b060-d5cdc46d6816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:04.143514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b348b5-46f5-4762-b060-d5cdc46d6816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:04.144438 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b348b5-46f5-4762-b060-d5cdc46d6816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:04.146179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b348b5-46f5-4762-b060-d5cdc46d6816 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:04.158461 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1303/2599] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:04.162236 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d0bfb-6c36-4aa2-af6d-4b5d5c2293c0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:04.174056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d0bfb-6c36-4aa2-af6d-4b5d5c2293c0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:04.180359 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc33b7-5030-48ee-96b0-e1d8ddeaec3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:04.181233 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc33b7-5030-48ee-96b0-e1d8ddeaec3f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:04.181809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc33b7-5030-48ee-96b0-e1d8ddeaec3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:04.182209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc33b7-5030-48ee-96b0-e1d8ddeaec3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:04.183070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc33b7-5030-48ee-96b0-e1d8ddeaec3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:04.184945 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc33b7-5030-48ee-96b0-e1d8ddeaec3f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:04.201098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1297/2600] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:04.205396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b348b5-46f5-4762-b060-d5cdc46d6816 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:04.216195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b348b5-46f5-4762-b060-d5cdc46d6816 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:04.221843 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6935647-7a92-465d-83a4-d1a9fca8a06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:04.223115 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6935647-7a92-465d-83a4-d1a9fca8a06a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:04.223619 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6935647-7a92-465d-83a4-d1a9fca8a06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:04.223967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6935647-7a92-465d-83a4-d1a9fca8a06a admin admin] PATH_INFO: `/v3/projects/5aa6887f68414b5297f3021cee3748be/users/11b61a5bbc4541399bcdc8898c69c07e/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:04.243537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6935647-7a92-465d-83a4-d1a9fca8a06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa6887f68414b5297f3021cee3748be, user_id=11b61a5bbc4541399bcdc8898c69c07e, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:04.246836 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6935647-7a92-465d-83a4-d1a9fca8a06a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:04.268958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1304/2601] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:04 2022] PUT /identity/v3/projects/5aa6887f68414b5297f3021cee3748be/users/11b61a5bbc4541399bcdc8898c69c07e/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:04.280681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43591192-f4e4-4bcd-9a3f-efd99e1fbc65 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:04.281056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43591192-f4e4-4bcd-9a3f-efd99e1fbc65 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:04.281687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43591192-f4e4-4bcd-9a3f-efd99e1fbc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:04.341416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-43591192-f4e4-4bcd-9a3f-efd99e1fbc65 None None] MFA Rules not processed for user `11b61a5bbc4541399bcdc8898c69c07e`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:04.342883 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-43591192-f4e4-4bcd-9a3f-efd99e1fbc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:04.439667 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1298/2602] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:04.444466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6935647-7a92-465d-83a4-d1a9fca8a06a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:04.540728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6935647-7a92-465d-83a4-d1a9fca8a06a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:04.548765 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4c4d2-952c-4b3c-b120-30d35259c9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:04.549805 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4c4d2-952c-4b3c-b120-30d35259c9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:04.550378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4c4d2-952c-4b3c-b120-30d35259c9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:04.551166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4c4d2-952c-4b3c-b120-30d35259c9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:04.552366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4c4d2-952c-4b3c-b120-30d35259c9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:04.555045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4c4d2-952c-4b3c-b120-30d35259c9f3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:04.618214 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1305/2603] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:04 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:04.622713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43591192-f4e4-4bcd-9a3f-efd99e1fbc65 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:04.634261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:04.641131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43591192-f4e4-4bcd-9a3f-efd99e1fbc65 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:04.738921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ecf10-10ef-468c-9d5d-431e11e857e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:04.739733 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ecf10-10ef-468c-9d5d-431e11e857e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:04.740084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ecf10-10ef-468c-9d5d-431e11e857e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:04.740432 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ecf10-10ef-468c-9d5d-431e11e857e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:04.741266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ecf10-10ef-468c-9d5d-431e11e857e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:04.744559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ecf10-10ef-468c-9d5d-431e11e857e2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:04.786413 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1299/2604] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:04 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:04.787925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4c4d2-952c-4b3c-b120-30d35259c9f3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:04.803275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4c4d2-952c-4b3c-b120-30d35259c9f3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:04.809303 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeea8c-5d10-44b1-aadf-9a22cd59a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:04.810062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeea8c-5d10-44b1-aadf-9a22cd59a25a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:04.810384 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeea8c-5d10-44b1-aadf-9a22cd59a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:04.810967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeea8c-5d10-44b1-aadf-9a22cd59a25a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:04.811905 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beeea8c-5d10-44b1-aadf-9a22cd59a25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:04.816457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beeea8c-5d10-44b1-aadf-9a22cd59a25a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:04.832763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1306/2605] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:04.834314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ecf10-10ef-468c-9d5d-431e11e857e2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:04.846980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ecf10-10ef-468c-9d5d-431e11e857e2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:04.853903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f0c32-63c4-44c9-988c-ade7ebaed52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:04.855140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f0c32-63c4-44c9-988c-ade7ebaed52d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:04.855636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f0c32-63c4-44c9-988c-ade7ebaed52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:04.856137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f0c32-63c4-44c9-988c-ade7ebaed52d admin admin] PATH_INFO: `/v3/projects/9cad135a18ba48268afe2fcb2c40506e/users/bab27d81604e4da995b33d66611f1ce8/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:04.878135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f0c32-63c4-44c9-988c-ade7ebaed52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cad135a18ba48268afe2fcb2c40506e, user_id=bab27d81604e4da995b33d66611f1ce8, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:04.880898 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f0c32-63c4-44c9-988c-ade7ebaed52d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:04.898243 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1300/2606] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:04 2022] PUT /identity/v3/projects/9cad135a18ba48268afe2fcb2c40506e/users/bab27d81604e4da995b33d66611f1ce8/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:04.904408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeea8c-5d10-44b1-aadf-9a22cd59a25a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:04.929007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeea8c-5d10-44b1-aadf-9a22cd59a25a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:04.998442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:05.039346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f32b7-4942-4e28-a17c-0a1acded85a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:05.039346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f32b7-4942-4e28-a17c-0a1acded85a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:05.039346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f32b7-4942-4e28-a17c-0a1acded85a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:05.039346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f32b7-4942-4e28-a17c-0a1acded85a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:05.039970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f32b7-4942-4e28-a17c-0a1acded85a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:05.042017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f32b7-4942-4e28-a17c-0a1acded85a2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:05.054141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1307/2607] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:05.060580 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f0c32-63c4-44c9-988c-ade7ebaed52d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:05.076435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f0c32-63c4-44c9-988c-ade7ebaed52d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:05.083923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645f0e7-0ad2-4e7b-8533-671e57b75c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:05.085166 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645f0e7-0ad2-4e7b-8533-671e57b75c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:05.085606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645f0e7-0ad2-4e7b-8533-671e57b75c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:05.086054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645f0e7-0ad2-4e7b-8533-671e57b75c15 admin admin] PATH_INFO: `/v3/projects/9cad135a18ba48268afe2fcb2c40506e/users/bab27d81604e4da995b33d66611f1ce8/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:05.088595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645f0e7-0ad2-4e7b-8533-671e57b75c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cad135a18ba48268afe2fcb2c40506e, user_id=bab27d81604e4da995b33d66611f1ce8, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:05.091663 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645f0e7-0ad2-4e7b-8533-671e57b75c15 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:05.103353 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1301/2608] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:05 2022] PUT /identity/v3/projects/9cad135a18ba48268afe2fcb2c40506e/users/bab27d81604e4da995b33d66611f1ce8/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:05.116881 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b26ed1-4712-4b32-8f02-c0108503dfce None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:05.117170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b26ed1-4712-4b32-8f02-c0108503dfce None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:05.117442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b26ed1-4712-4b32-8f02-c0108503dfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:05.167009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-99b26ed1-4712-4b32-8f02-c0108503dfce None None] MFA Rules not processed for user `bab27d81604e4da995b33d66611f1ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:05.168250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-99b26ed1-4712-4b32-8f02-c0108503dfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:05.251250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1308/2609] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:05.266909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645f0e7-0ad2-4e7b-8533-671e57b75c15 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:05.268718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4645f0e7-0ad2-4e7b-8533-671e57b75c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:05.367902 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645f0e7-0ad2-4e7b-8533-671e57b75c15 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:05.372142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad65bdb-80ee-4225-a18e-f0d55d69b3f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:05.373133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad65bdb-80ee-4225-a18e-f0d55d69b3f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:05.373464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad65bdb-80ee-4225-a18e-f0d55d69b3f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:05.373810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad65bdb-80ee-4225-a18e-f0d55d69b3f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:05.386878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad65bdb-80ee-4225-a18e-f0d55d69b3f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:05.388468 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad65bdb-80ee-4225-a18e-f0d55d69b3f4 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:05.404092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1302/2610] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:05.484165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b26ed1-4712-4b32-8f02-c0108503dfce None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:05.499607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b26ed1-4712-4b32-8f02-c0108503dfce None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:05.504170 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0e90d-b289-4741-935b-5d8b71318e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:05.504907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0e90d-b289-4741-935b-5d8b71318e5a service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:05.505193 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0e90d-b289-4741-935b-5d8b71318e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:05.505471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0e90d-b289-4741-935b-5d8b71318e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:05.580015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0e90d-b289-4741-935b-5d8b71318e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:05.581553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0e90d-b289-4741-935b-5d8b71318e5a service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:05.592127 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1309/2611] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:08.101606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad65bdb-80ee-4225-a18e-f0d55d69b3f4 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:08.105191 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bad65bdb-80ee-4225-a18e-f0d55d69b3f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:08.185352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:08.192874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad65bdb-80ee-4225-a18e-f0d55d69b3f4 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:08.201039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:08.202159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:08.202529 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:08.202808 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] PATH_INFO: `/v3/users/37df7f4460ec4cd4abf5b05d40c987fb` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:08.204183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] RBAC: Authorizing `identity:delete_user(user_id=37df7f4460ec4cd4abf5b05d40c987fb)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:08.206256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:08.285929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37df7f4460ec4cd4abf5b05d40c987fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:08.298409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37df7f4460ec4cd4abf5b05d40c987fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:08.320009 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37df7f4460ec4cd4abf5b05d40c987fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:08.320962 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37df7f4460ec4cd4abf5b05d40c987fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:08.321581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37df7f4460ec4cd4abf5b05d40c987fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:08.349093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1303/2612] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:08 2022] DELETE /identity/v3/users/37df7f4460ec4cd4abf5b05d40c987fb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:08.355988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ace3-1a75-44d7-9d06-a8b7f55f46ea None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:08.356653 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ace3-1a75-44d7-9d06-a8b7f55f46ea None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:08.356906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ace3-1a75-44d7-9d06-a8b7f55f46ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:08.399457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8846ace3-1a75-44d7-9d06-a8b7f55f46ea None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:08.401775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8846ace3-1a75-44d7-9d06-a8b7f55f46ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:08.479795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:08.504552 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1310/2613] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:08.513723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:08.516460 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:08.643204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975b4c8-967d-434e-9f78-b045b296acec admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:08.654678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d3546-30ae-4180-9ea2-893a1df22e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:08.655495 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d3546-30ae-4180-9ea2-893a1df22e77 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:08.655785 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d3546-30ae-4180-9ea2-893a1df22e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:08.656121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d3546-30ae-4180-9ea2-893a1df22e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:08.670019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d3546-30ae-4180-9ea2-893a1df22e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:08.671509 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d3546-30ae-4180-9ea2-893a1df22e77 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:08.685728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1304/2614] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:09.141174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ace3-1a75-44d7-9d06-a8b7f55f46ea None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:09.143339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8846ace3-1a75-44d7-9d06-a8b7f55f46ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:09.161655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ace3-1a75-44d7-9d06-a8b7f55f46ea None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:09.180666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:09.181607 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:09.181890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:09.182157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] PATH_INFO: `/v3/projects/35f2e3d4d4074071910e3a0795e802c0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:09.184272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f2e3d4d4074071910e3a0795e802c0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:09.186702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:09.260837 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f2e3d4d4074071910e3a0795e802c0', 'request_id': 'req-0cf12044-86b2-4485-8913-db9aad08f2e9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:09.267855 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f2e3d4d4074071910e3a0795e802c0', 'request_id': 'req-0cf12044-86b2-4485-8913-db9aad08f2e9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:09.274282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f2e3d4d4074071910e3a0795e802c0', 'request_id': 'req-0cf12044-86b2-4485-8913-db9aad08f2e9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:09.288988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] The token cache is being invalidate because project 35f2e3d4d4074071910e3a0795e802c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:09.289287 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:09.296112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:09.296112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1311/2615] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:09 2022] DELETE /identity/v3/projects/35f2e3d4d4074071910e3a0795e802c0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:09.297210 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d3546-30ae-4180-9ea2-893a1df22e77 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:09.310382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d3546-30ae-4180-9ea2-893a1df22e77 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:09.388216 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:09.389536 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:09.390054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:09.390538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] PATH_INFO: `/v3/users/17134310cf1244a2aa8c91960dbe7235` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:09.392988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] RBAC: Authorizing `identity:delete_user(user_id=17134310cf1244a2aa8c91960dbe7235)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:09.395910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:09.422665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:09.455162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17134310cf1244a2aa8c91960dbe7235'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:09.462203 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17134310cf1244a2aa8c91960dbe7235'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:09.479814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17134310cf1244a2aa8c91960dbe7235'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:09.480628 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17134310cf1244a2aa8c91960dbe7235'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:09.481263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17134310cf1244a2aa8c91960dbe7235'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:09.496754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1305/2616] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:09 2022] DELETE /identity/v3/users/17134310cf1244a2aa8c91960dbe7235 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:09.800031 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:09.801753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:09.823656 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf12044-86b2-4485-8913-db9aad08f2e9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:09.902776 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:09.909082 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:09.909638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:09.909927 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4 admin admin] PATH_INFO: `/v3/projects/3dac1dc910b54cbabe7ec585a76da363` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:09.911428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dac1dc910b54cbabe7ec585a76da363)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:09.913454 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:09.972055 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dac1dc910b54cbabe7ec585a76da363', 'request_id': 'req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:09.978571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dac1dc910b54cbabe7ec585a76da363', 'request_id': 'req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:09.986163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dac1dc910b54cbabe7ec585a76da363', 'request_id': 'req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:10.001802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4 admin admin] The token cache is being invalidate because project 3dac1dc910b54cbabe7ec585a76da363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:10.002094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:10.002743 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d9e0dea8-cbd8-4641-a174-c6a82721e0c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:10.004418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1312/2617] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:09 2022] DELETE /identity/v3/projects/3dac1dc910b54cbabe7ec585a76da363 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:14.042313 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:14.044581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:14.104711 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfd8b8-c550-4dee-8f00-1009aaed111e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:14.162812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19070b0d-02c5-418e-bc67-2f0e51c8d6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:14.163706 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070b0d-02c5-418e-bc67-2f0e51c8d6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:14.164065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070b0d-02c5-418e-bc67-2f0e51c8d6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:14.164442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070b0d-02c5-418e-bc67-2f0e51c8d6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:14.167114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-19070b0d-02c5-418e-bc67-2f0e51c8d6a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:14.180066 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19070b0d-02c5-418e-bc67-2f0e51c8d6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:14.181555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19070b0d-02c5-418e-bc67-2f0e51c8d6a9 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:14.190202 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1306/2618] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:14.320079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c158a-5b5f-4b97-a9a5-8aea372743e7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:14.320663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c158a-5b5f-4b97-a9a5-8aea372743e7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:14.320663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c158a-5b5f-4b97-a9a5-8aea372743e7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:14.322171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1313/2619] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:33:14.332372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253b069-9b07-4b8f-a4ac-e50fbcc22984 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:14.332751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253b069-9b07-4b8f-a4ac-e50fbcc22984 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:14.333061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253b069-9b07-4b8f-a4ac-e50fbcc22984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:14.354043 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d253b069-9b07-4b8f-a4ac-e50fbcc22984 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:14.355296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d253b069-9b07-4b8f-a4ac-e50fbcc22984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:14.415652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:14.443867 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1307/2620] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:33:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:14.456202 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c158a-5b5f-4b97-a9a5-8aea372743e7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:14.458026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7e9c158a-5b5f-4b97-a9a5-8aea372743e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:14.472712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:14.522255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c158a-5b5f-4b97-a9a5-8aea372743e7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:14.526068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de9531-9dcc-4bc4-8748-8b68d4eba392 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f9a6f6d6d840d6bc29fd0ab26ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:14.527378 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de9531-9dcc-4bc4-8748-8b68d4eba392 service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:14.527668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de9531-9dcc-4bc4-8748-8b68d4eba392 service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:14.528030 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de9531-9dcc-4bc4-8748-8b68d4eba392 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:14.538870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de9531-9dcc-4bc4-8748-8b68d4eba392 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:14.540335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de9531-9dcc-4bc4-8748-8b68d4eba392 service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:14.551498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1314/2621] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:14.625708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8bf6-f0c8-4433-8687-c7199327e4ff None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:14.625993 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8bf6-f0c8-4433-8687-c7199327e4ff None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:14.626273 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8bf6-f0c8-4433-8687-c7199327e4ff None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:14.627717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1308/2622] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:33:14.633788 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd335b-6183-4844-8a2b-bda7822857a4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:14.634126 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd335b-6183-4844-8a2b-bda7822857a4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:14.634448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd335b-6183-4844-8a2b-bda7822857a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:14.656442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-27dd335b-6183-4844-8a2b-bda7822857a4 None None] MFA Rules not processed for user `06a267cec6fb4dbea619f0a77b5674dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:14.657709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-27dd335b-6183-4844-8a2b-bda7822857a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:14.664655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1315/2623] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:33:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:14.680741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8bf6-f0c8-4433-8687-c7199327e4ff None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:14.682986 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-074b8bf6-f0c8-4433-8687-c7199327e4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:14.698268 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8bf6-f0c8-4433-8687-c7199327e4ff None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:14.702162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be530be4-e076-4e32-b6fc-831ef6e53b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:14.702823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be530be4-e076-4e32-b6fc-831ef6e53b8c service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:14.703104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be530be4-e076-4e32-b6fc-831ef6e53b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:14.703377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be530be4-e076-4e32-b6fc-831ef6e53b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:14.711729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be530be4-e076-4e32-b6fc-831ef6e53b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:14.713238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be530be4-e076-4e32-b6fc-831ef6e53b8c service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:14.721673 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1309/2624] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:14.816702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389cc07-8ef3-4b66-9072-09138fe84e2e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:14.816702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389cc07-8ef3-4b66-9072-09138fe84e2e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:14.816702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389cc07-8ef3-4b66-9072-09138fe84e2e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:14.818040 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1316/2625] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 21 08:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:33:14.827211 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2b656-42d4-4ef6-91fd-9d72a8e41424 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:14.827520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2b656-42d4-4ef6-91fd-9d72a8e41424 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:14.827817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2b656-42d4-4ef6-91fd-9d72a8e41424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:14.848768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fbd2b656-42d4-4ef6-91fd-9d72a8e41424 None None] MFA Rules not processed for user `421f05e3d10e4393b28f77b6179ade8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:14.849992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fbd2b656-42d4-4ef6-91fd-9d72a8e41424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:14.860634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1310/2626] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 21 08:33:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:14.871980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389cc07-8ef3-4b66-9072-09138fe84e2e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:14.886827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389cc07-8ef3-4b66-9072-09138fe84e2e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:14.891680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65604e-a0e1-463c-a2c3-956342b7d293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:14.892344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65604e-a0e1-463c-a2c3-956342b7d293 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:14.892676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65604e-a0e1-463c-a2c3-956342b7d293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:14.892945 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65604e-a0e1-463c-a2c3-956342b7d293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:14.904285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65604e-a0e1-463c-a2c3-956342b7d293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:14.905781 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65604e-a0e1-463c-a2c3-956342b7d293 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:14.917583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1317/2627] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:16.865403 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e7831-b122-4b0b-bf7c-b47d622243d5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:16.866073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e7831-b122-4b0b-bf7c-b47d622243d5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:16.866073 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e7831-b122-4b0b-bf7c-b47d622243d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:16.886290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-266e7831-b122-4b0b-bf7c-b47d622243d5 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:16.887570 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-266e7831-b122-4b0b-bf7c-b47d622243d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:16.954430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1311/2628] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 21 08:33:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:16.967541 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65604e-a0e1-463c-a2c3-956342b7d293 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:16.969271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-df65604e-a0e1-463c-a2c3-956342b7d293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:17.056440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65604e-a0e1-463c-a2c3-956342b7d293 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:17.063551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8d888-301b-421c-93a4-363575fb1d59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:17.064376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8d888-301b-421c-93a4-363575fb1d59 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:17.064703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8d888-301b-421c-93a4-363575fb1d59 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:17.064988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8d888-301b-421c-93a4-363575fb1d59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:17.083402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8d888-301b-421c-93a4-363575fb1d59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:17.085672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8d888-301b-421c-93a4-363575fb1d59 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:17.096229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1318/2629] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:33:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 08:33:26.946992 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=39 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:27.097298 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=62 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:32.812145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb32aac-9617-4a7d-a14a-23e3ad865c8d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:32.812684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb32aac-9617-4a7d-a14a-23e3ad865c8d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:32.812684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb32aac-9617-4a7d-a14a-23e3ad865c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:32.833825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0bb32aac-9617-4a7d-a14a-23e3ad865c8d None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:32.835377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0bb32aac-9617-4a7d-a14a-23e3ad865c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:32.844713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1312/2630] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jul 21 08:33:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:32.858032 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8d888-301b-421c-93a4-363575fb1d59 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:32.869238 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8d888-301b-421c-93a4-363575fb1d59 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:32.875453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a650b2-038d-464a-9136-06bf5390f661 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:32.876105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a650b2-038d-464a-9136-06bf5390f661 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:32.876386 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a650b2-038d-464a-9136-06bf5390f661 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:32.876681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a650b2-038d-464a-9136-06bf5390f661 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:32.886182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a650b2-038d-464a-9136-06bf5390f661 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:32.887777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a650b2-038d-464a-9136-06bf5390f661 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:32.897314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1319/2631] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:33:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:33:34.276586 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df33740-846c-46d5-9c73-6c54c3fdac31 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:34.277071 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df33740-846c-46d5-9c73-6c54c3fdac31 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:34.277170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df33740-846c-46d5-9c73-6c54c3fdac31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:34.295402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3df33740-846c-46d5-9c73-6c54c3fdac31 None None] MFA Rules not processed for user `06e0753ca5174046841396a304262d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:34.296710 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3df33740-846c-46d5-9c73-6c54c3fdac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:34.304654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1313/2632] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jul 21 08:33:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:34.326540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a650b2-038d-464a-9136-06bf5390f661 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:34.338725 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a650b2-038d-464a-9136-06bf5390f661 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:34.344431 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e9208-e038-436c-a58e-23dac713418a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '300b1990926c4968b75a84a1f5794df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:34.345119 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e9208-e038-436c-a58e-23dac713418a service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:34.345401 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e9208-e038-436c-a58e-23dac713418a service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:34.345676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e9208-e038-436c-a58e-23dac713418a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:34.355784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e9208-e038-436c-a58e-23dac713418a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:34.357507 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e9208-e038-436c-a58e-23dac713418a service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:34.366235 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1320/2633] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 21 08:33:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:33:36.634417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df33740-846c-46d5-9c73-6c54c3fdac31 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:36.637680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3df33740-846c-46d5-9c73-6c54c3fdac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:36.714382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df33740-846c-46d5-9c73-6c54c3fdac31 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:36.720051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:36.720771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:36.721120 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:36.721473 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] PATH_INFO: `/v3/users/11b61a5bbc4541399bcdc8898c69c07e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:36.722988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b61a5bbc4541399bcdc8898c69c07e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:36.725062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:36.783861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b61a5bbc4541399bcdc8898c69c07e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:36.793447 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b61a5bbc4541399bcdc8898c69c07e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:36.807337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b61a5bbc4541399bcdc8898c69c07e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:36.808181 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b61a5bbc4541399bcdc8898c69c07e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:36.808873 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b61a5bbc4541399bcdc8898c69c07e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:36.826794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1314/2634] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:36 2022] DELETE /identity/v3/users/11b61a5bbc4541399bcdc8898c69c07e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:36.831916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c032898-ff9b-4c64-a4ec-12904fda2609 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:36.832861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c032898-ff9b-4c64-a4ec-12904fda2609 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:36.833334 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c032898-ff9b-4c64-a4ec-12904fda2609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:36.856983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9c032898-ff9b-4c64-a4ec-12904fda2609 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:36.858596 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9c032898-ff9b-4c64-a4ec-12904fda2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:36.942392 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1321/2635] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:33:36.954398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:36.959943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:37.030433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1bd2e-2a54-4933-b8ba-3678925419f2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:37.034254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7e0be-c750-4975-8018-e657336d3186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:37.034919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e0be-c750-4975-8018-e657336d3186 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:37.035213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e0be-c750-4975-8018-e657336d3186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:37.035479 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e0be-c750-4975-8018-e657336d3186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:37.049719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7e0be-c750-4975-8018-e657336d3186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:37.051741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7e0be-c750-4975-8018-e657336d3186 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:37.063227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1315/2636] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:37.366767 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c032898-ff9b-4c64-a4ec-12904fda2609 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:37.368913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9c032898-ff9b-4c64-a4ec-12904fda2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:37.383313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c032898-ff9b-4c64-a4ec-12904fda2609 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:37.392641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:37.396407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:37.397295 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:37.397857 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] PATH_INFO: `/v3/projects/5aa6887f68414b5297f3021cee3748be` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:37.400019 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa6887f68414b5297f3021cee3748be)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:37.403795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:37.481871 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa6887f68414b5297f3021cee3748be', 'request_id': 'req-b99bea82-8542-4451-aca4-7f55b46d1a98'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:37.488997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa6887f68414b5297f3021cee3748be', 'request_id': 'req-b99bea82-8542-4451-aca4-7f55b46d1a98'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:37.495036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa6887f68414b5297f3021cee3748be', 'request_id': 'req-b99bea82-8542-4451-aca4-7f55b46d1a98'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:37.509764 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] The token cache is being invalidate because project 5aa6887f68414b5297f3021cee3748be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:37.510417 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:37.511050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:37.515739 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1322/2637] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:37 2022] DELETE /identity/v3/projects/5aa6887f68414b5297f3021cee3748be => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:37.517008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7e0be-c750-4975-8018-e657336d3186 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:37.528081 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7e0be-c750-4975-8018-e657336d3186 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:37.534238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:37.615462 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:37.616358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:37.616635 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:37.616911 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] PATH_INFO: `/v3/users/bab27d81604e4da995b33d66611f1ce8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:37.618208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab27d81604e4da995b33d66611f1ce8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:37.620149 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:37.696688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab27d81604e4da995b33d66611f1ce8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:37.705065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab27d81604e4da995b33d66611f1ce8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:37.719181 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab27d81604e4da995b33d66611f1ce8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:37.720009 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab27d81604e4da995b33d66611f1ce8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:37.720638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab27d81604e4da995b33d66611f1ce8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:37.735668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1316/2638] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:37 2022] DELETE /identity/v3/users/bab27d81604e4da995b33d66611f1ce8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:33:38.071358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:38.073749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:38.101015 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bea82-8542-4451-aca4-7f55b46d1a98 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:38.126673 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:38.128129 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:38.181913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:38.198571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d072a2-753b-4381-8c28-8188a2792772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:38.202512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d072a2-753b-4381-8c28-8188a2792772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.202792 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d072a2-753b-4381-8c28-8188a2792772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.203276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d072a2-753b-4381-8c28-8188a2792772 admin admin] PATH_INFO: `/v3/projects/9cad135a18ba48268afe2fcb2c40506e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.204736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d072a2-753b-4381-8c28-8188a2792772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cad135a18ba48268afe2fcb2c40506e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:38.207112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d072a2-753b-4381-8c28-8188a2792772 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:38.255541 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa864e93-d032-4e66-b1b1-90a7f2635634 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:38.275551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948575fb-d994-43bd-9df0-c2f609021f1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd9ea435d7b48cb8b1b2a27d79cfa91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:38.276017 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948575fb-d994-43bd-9df0-c2f609021f1e service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.277950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948575fb-d994-43bd-9df0-c2f609021f1e service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.278242 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948575fb-d994-43bd-9df0-c2f609021f1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.280314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-948575fb-d994-43bd-9df0-c2f609021f1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:38.290981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86d072a2-753b-4381-8c28-8188a2792772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cad135a18ba48268afe2fcb2c40506e', 'request_id': 'req-86d072a2-753b-4381-8c28-8188a2792772'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:38.293158 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948575fb-d994-43bd-9df0-c2f609021f1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:38.295576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948575fb-d994-43bd-9df0-c2f609021f1e service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:38.298832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86d072a2-753b-4381-8c28-8188a2792772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cad135a18ba48268afe2fcb2c40506e', 'request_id': 'req-86d072a2-753b-4381-8c28-8188a2792772'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:38.307142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1317/2639] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:38.307559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86d072a2-753b-4381-8c28-8188a2792772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cad135a18ba48268afe2fcb2c40506e', 'request_id': 'req-86d072a2-753b-4381-8c28-8188a2792772'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:38.324679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86d072a2-753b-4381-8c28-8188a2792772 admin admin] The token cache is being invalidate because project 9cad135a18ba48268afe2fcb2c40506e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:38.324958 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86d072a2-753b-4381-8c28-8188a2792772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:38.325627 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86d072a2-753b-4381-8c28-8188a2792772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:38.327582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1323/2640] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:38 2022] DELETE /identity/v3/projects/9cad135a18ba48268afe2fcb2c40506e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:38.337492 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743df3f-978b-42e7-a05c-15eaaa3b28de None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.337885 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743df3f-978b-42e7-a05c-15eaaa3b28de None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.338298 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743df3f-978b-42e7-a05c-15eaaa3b28de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.362175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e743df3f-978b-42e7-a05c-15eaaa3b28de None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:38.363423 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e743df3f-978b-42e7-a05c-15eaaa3b28de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:38.376453 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:38.433278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1318/2641] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:38.441751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4afa-f8d1-42bb-bb91-8339c322e614 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.442142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4afa-f8d1-42bb-bb91-8339c322e614 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.442422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4afa-f8d1-42bb-bb91-8339c322e614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.462355 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-931e4afa-f8d1-42bb-bb91-8339c322e614 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:38.463592 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-931e4afa-f8d1-42bb-bb91-8339c322e614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:38.473006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1324/2642] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:38.477576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743df3f-978b-42e7-a05c-15eaaa3b28de None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:38.487917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743df3f-978b-42e7-a05c-15eaaa3b28de None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:38.493594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275a6cd-b2ea-4bb3-a12d-41ec5d191638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:38.494490 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275a6cd-b2ea-4bb3-a12d-41ec5d191638 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.494967 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275a6cd-b2ea-4bb3-a12d-41ec5d191638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.495245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275a6cd-b2ea-4bb3-a12d-41ec5d191638 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.495973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275a6cd-b2ea-4bb3-a12d-41ec5d191638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:33:38.496301 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275a6cd-b2ea-4bb3-a12d-41ec5d191638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:38.498033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275a6cd-b2ea-4bb3-a12d-41ec5d191638 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:38.511569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1319/2643] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:33:38.516250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e4afa-f8d1-42bb-bb91-8339c322e614 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:38.526254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e4afa-f8d1-42bb-bb91-8339c322e614 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:38.532000 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa04891-087b-4583-b508-bc8cd6b37a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:38.532761 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa04891-087b-4583-b508-bc8cd6b37a8d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.533039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa04891-087b-4583-b508-bc8cd6b37a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.533276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa04891-087b-4583-b508-bc8cd6b37a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.534008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa04891-087b-4583-b508-bc8cd6b37a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:38.535915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa04891-087b-4583-b508-bc8cd6b37a8d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:38.565674 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1325/2644] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:38 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:38.569804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275a6cd-b2ea-4bb3-a12d-41ec5d191638 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:38.582018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275a6cd-b2ea-4bb3-a12d-41ec5d191638 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:38.642320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de980785-9960-450f-b138-e45484909881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:38.643015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de980785-9960-450f-b138-e45484909881 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.643299 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de980785-9960-450f-b138-e45484909881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.643570 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de980785-9960-450f-b138-e45484909881 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.644292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de980785-9960-450f-b138-e45484909881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:38.646345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de980785-9960-450f-b138-e45484909881 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:38.667497 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1320/2645] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:38 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:38.671832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa04891-087b-4583-b508-bc8cd6b37a8d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:38.683430 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa04891-087b-4583-b508-bc8cd6b37a8d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:38.688797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c5d30-c605-4241-a061-2187d7ac02ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:38.689512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c5d30-c605-4241-a061-2187d7ac02ec admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.689794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c5d30-c605-4241-a061-2187d7ac02ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.690066 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c5d30-c605-4241-a061-2187d7ac02ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.690806 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c5d30-c605-4241-a061-2187d7ac02ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:38.692431 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c5d30-c605-4241-a061-2187d7ac02ec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:38.703639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1326/2646] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:38.707888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de980785-9960-450f-b138-e45484909881 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:38.718796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de980785-9960-450f-b138-e45484909881 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:38.724622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64ccb-1991-43a9-a261-8dd7c405ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:38.725306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64ccb-1991-43a9-a261-8dd7c405ba88 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.725629 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64ccb-1991-43a9-a261-8dd7c405ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.725874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64ccb-1991-43a9-a261-8dd7c405ba88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.726638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe64ccb-1991-43a9-a261-8dd7c405ba88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:38.728258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe64ccb-1991-43a9-a261-8dd7c405ba88 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:38.742364 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1321/2647] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:38.743645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c5d30-c605-4241-a061-2187d7ac02ec admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:38.753899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c5d30-c605-4241-a061-2187d7ac02ec admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:38.758894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97767509-c51e-4b64-94f6-c36fa8445df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:38.760174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97767509-c51e-4b64-94f6-c36fa8445df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.760448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97767509-c51e-4b64-94f6-c36fa8445df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.760841 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97767509-c51e-4b64-94f6-c36fa8445df5 admin admin] PATH_INFO: `/v3/projects/39b0f705feb04c8ba7973c7a8d7b3c52/users/4a113b8722ec487cbbced5022e17ab92/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.776768 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97767509-c51e-4b64-94f6-c36fa8445df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b0f705feb04c8ba7973c7a8d7b3c52, user_id=4a113b8722ec487cbbced5022e17ab92, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:38.779493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97767509-c51e-4b64-94f6-c36fa8445df5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:38.803041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1327/2648] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:38 2022] PUT /identity/v3/projects/39b0f705feb04c8ba7973c7a8d7b3c52/users/4a113b8722ec487cbbced5022e17ab92/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:38.804995 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c11758-3d8f-46f8-ad58-f53d3adda610 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.805294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c11758-3d8f-46f8-ad58-f53d3adda610 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.805571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c11758-3d8f-46f8-ad58-f53d3adda610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.833376 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-15c11758-3d8f-46f8-ad58-f53d3adda610 None None] MFA Rules not processed for user `4a113b8722ec487cbbced5022e17ab92`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:38.834519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-15c11758-3d8f-46f8-ad58-f53d3adda610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:38.904953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1322/2649] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:38.909663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97767509-c51e-4b64-94f6-c36fa8445df5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:38.975074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97767509-c51e-4b64-94f6-c36fa8445df5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:38.981062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef42f3e-254d-429f-85ec-daec90b7948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:38.982208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42f3e-254d-429f-85ec-daec90b7948d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.982208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42f3e-254d-429f-85ec-daec90b7948d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.982686 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42f3e-254d-429f-85ec-daec90b7948d admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.983021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef42f3e-254d-429f-85ec-daec90b7948d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:38.985011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef42f3e-254d-429f-85ec-daec90b7948d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:39.019006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1328/2650] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:38 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:39.020352 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c11758-3d8f-46f8-ad58-f53d3adda610 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:39.032045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c11758-3d8f-46f8-ad58-f53d3adda610 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:39.042451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:39.095109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0b2df-8fbd-4488-bab8-c7dd96e1ea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:39.095803 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0b2df-8fbd-4488-bab8-c7dd96e1ea5f admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:39.096085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0b2df-8fbd-4488-bab8-c7dd96e1ea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:39.096360 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0b2df-8fbd-4488-bab8-c7dd96e1ea5f admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:39.097111 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0b2df-8fbd-4488-bab8-c7dd96e1ea5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:39.099068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0b2df-8fbd-4488-bab8-c7dd96e1ea5f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:39.125338 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1323/2651] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:39 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:39.126501 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef42f3e-254d-429f-85ec-daec90b7948d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:39.144126 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef42f3e-254d-429f-85ec-daec90b7948d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:39.153239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d889f-dd16-4c9d-ad49-e448a85eb8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:39.157876 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d889f-dd16-4c9d-ad49-e448a85eb8ff admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:39.158249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d889f-dd16-4c9d-ad49-e448a85eb8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:39.158602 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d889f-dd16-4c9d-ad49-e448a85eb8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:39.159434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d889f-dd16-4c9d-ad49-e448a85eb8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:39.161258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d889f-dd16-4c9d-ad49-e448a85eb8ff admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:39.166515 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:39.177457 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1329/2652] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:39.181506 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0b2df-8fbd-4488-bab8-c7dd96e1ea5f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:39.193199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0b2df-8fbd-4488-bab8-c7dd96e1ea5f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:39.198483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3b56e-9e0e-4382-ba0a-d56ad9edaf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:39.199704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3b56e-9e0e-4382-ba0a-d56ad9edaf1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:39.200177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3b56e-9e0e-4382-ba0a-d56ad9edaf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:39.200673 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3b56e-9e0e-4382-ba0a-d56ad9edaf1f admin admin] PATH_INFO: `/v3/projects/dc9c56c4dce64e9aa54b7b4efede8ff0/users/951127ba262a47d3a3224cc630113fff/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:39.220155 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3b56e-9e0e-4382-ba0a-d56ad9edaf1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9c56c4dce64e9aa54b7b4efede8ff0, user_id=951127ba262a47d3a3224cc630113fff, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:39.222923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3b56e-9e0e-4382-ba0a-d56ad9edaf1f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:39.239459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1324/2653] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:39 2022] PUT /identity/v3/projects/dc9c56c4dce64e9aa54b7b4efede8ff0/users/951127ba262a47d3a3224cc630113fff/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:39.243639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d889f-dd16-4c9d-ad49-e448a85eb8ff admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:39.255999 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d889f-dd16-4c9d-ad49-e448a85eb8ff admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:39.383251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c30014-5c1c-4f31-8275-4615b1df6e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:39.384315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c30014-5c1c-4f31-8275-4615b1df6e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:39.384784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c30014-5c1c-4f31-8275-4615b1df6e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:39.385568 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c30014-5c1c-4f31-8275-4615b1df6e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:39.386480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c30014-5c1c-4f31-8275-4615b1df6e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:39.388313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c30014-5c1c-4f31-8275-4615b1df6e2e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:39.399498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1330/2654] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:39.403800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3b56e-9e0e-4382-ba0a-d56ad9edaf1f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:39.416641 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3b56e-9e0e-4382-ba0a-d56ad9edaf1f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:39.428548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bba46-d026-48d3-bdf4-a746ab5a6f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:39.429324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bba46-d026-48d3-bdf4-a746ab5a6f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:39.429668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bba46-d026-48d3-bdf4-a746ab5a6f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:39.429953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bba46-d026-48d3-bdf4-a746ab5a6f8a admin admin] PATH_INFO: `/v3/projects/dc9c56c4dce64e9aa54b7b4efede8ff0/users/951127ba262a47d3a3224cc630113fff/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:39.434319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bba46-d026-48d3-bdf4-a746ab5a6f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9c56c4dce64e9aa54b7b4efede8ff0, user_id=951127ba262a47d3a3224cc630113fff, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:39.437277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bba46-d026-48d3-bdf4-a746ab5a6f8a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:39.450464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1325/2655] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:39 2022] PUT /identity/v3/projects/dc9c56c4dce64e9aa54b7b4efede8ff0/users/951127ba262a47d3a3224cc630113fff/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:39.462398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966f7e-4827-4bd0-b5a1-0738bdda36be None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:39.462682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966f7e-4827-4bd0-b5a1-0738bdda36be None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:39.462952 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966f7e-4827-4bd0-b5a1-0738bdda36be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:39.492437 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-20966f7e-4827-4bd0-b5a1-0738bdda36be None None] MFA Rules not processed for user `951127ba262a47d3a3224cc630113fff`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:39.493711 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-20966f7e-4827-4bd0-b5a1-0738bdda36be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:39.566046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1331/2656] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:39 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:39.577584 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bba46-d026-48d3-bdf4-a746ab5a6f8a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:39.579337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b41bba46-d026-48d3-bdf4-a746ab5a6f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:39.640735 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bba46-d026-48d3-bdf4-a746ab5a6f8a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:39.645473 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de819255-0005-41da-a290-0d20affefdc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:39.646140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de819255-0005-41da-a290-0d20affefdc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:39.646420 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de819255-0005-41da-a290-0d20affefdc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:39.646757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de819255-0005-41da-a290-0d20affefdc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:39.656717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de819255-0005-41da-a290-0d20affefdc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:39.658449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de819255-0005-41da-a290-0d20affefdc6 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:39.669963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1326/2657] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:39 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:40.140311 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20966f7e-4827-4bd0-b5a1-0738bdda36be None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:40.214053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20966f7e-4827-4bd0-b5a1-0738bdda36be None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:40.219157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:40.220126 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:40.220519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:40.220780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] PATH_INFO: `/v3/users/4a113b8722ec487cbbced5022e17ab92` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:40.222136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a113b8722ec487cbbced5022e17ab92)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:40.224128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:40.249190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:40.282408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a113b8722ec487cbbced5022e17ab92'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:40.291709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a113b8722ec487cbbced5022e17ab92'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:40.306471 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a113b8722ec487cbbced5022e17ab92'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:40.324575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a113b8722ec487cbbced5022e17ab92'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:40.325442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a113b8722ec487cbbced5022e17ab92'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:40.332833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1332/2658] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:40 2022] DELETE /identity/v3/users/4a113b8722ec487cbbced5022e17ab92 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:40.337895 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde40fd-ca51-4b0f-959d-2b6c65136690 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:40.338431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde40fd-ca51-4b0f-959d-2b6c65136690 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:40.338431 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde40fd-ca51-4b0f-959d-2b6c65136690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:40.361950 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5cde40fd-ca51-4b0f-959d-2b6c65136690 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:40.364097 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5cde40fd-ca51-4b0f-959d-2b6c65136690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:40.440729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1327/2659] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:33:40.452854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:40.455147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:40.524382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfac0eb-841f-47c0-beb7-b89712d58456 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:40.528758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5492b-fe12-44c0-a8ca-eead8e1e7a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:40.529466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5492b-fe12-44c0-a8ca-eead8e1e7a33 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:40.529747 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5492b-fe12-44c0-a8ca-eead8e1e7a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:40.530028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5492b-fe12-44c0-a8ca-eead8e1e7a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:40.541428 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5492b-fe12-44c0-a8ca-eead8e1e7a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:40.542932 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5492b-fe12-44c0-a8ca-eead8e1e7a33 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:40.554827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1333/2660] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:40.865025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde40fd-ca51-4b0f-959d-2b6c65136690 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:40.866665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5cde40fd-ca51-4b0f-959d-2b6c65136690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:40.879606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde40fd-ca51-4b0f-959d-2b6c65136690 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:40.886878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:40.887781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:40.888068 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:40.888875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] PATH_INFO: `/v3/projects/39b0f705feb04c8ba7973c7a8d7b3c52` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:40.890164 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b0f705feb04c8ba7973c7a8d7b3c52)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:40.892119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:40.895280 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:40.949141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b0f705feb04c8ba7973c7a8d7b3c52', 'request_id': 'req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:40.959221 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b0f705feb04c8ba7973c7a8d7b3c52', 'request_id': 'req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:40.966715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b0f705feb04c8ba7973c7a8d7b3c52', 'request_id': 'req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:40.981645 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] The token cache is being invalidate because project 39b0f705feb04c8ba7973c7a8d7b3c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:40.981974 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:40.982708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:40.987788 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1328/2661] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:40 2022] DELETE /identity/v3/projects/39b0f705feb04c8ba7973c7a8d7b3c52 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:40.988870 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5492b-fe12-44c0-a8ca-eead8e1e7a33 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:40.999758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5492b-fe12-44c0-a8ca-eead8e1e7a33 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:41.084689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:41.085756 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:41.086114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:41.086598 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] PATH_INFO: `/v3/users/951127ba262a47d3a3224cc630113fff` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:41.088199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] RBAC: Authorizing `identity:delete_user(user_id=951127ba262a47d3a3224cc630113fff)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:41.091112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:41.141460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:41.144308 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951127ba262a47d3a3224cc630113fff'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.156481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951127ba262a47d3a3224cc630113fff'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.165234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951127ba262a47d3a3224cc630113fff'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.181826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951127ba262a47d3a3224cc630113fff'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.182646 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951127ba262a47d3a3224cc630113fff'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.189651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1334/2662] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:40 2022] DELETE /identity/v3/users/951127ba262a47d3a3224cc630113fff => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:41.527494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:41.527494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:41.542311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad9684-f9a8-411c-87a1-43f5cbdc1d0b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:41.612238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:41.613484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:41.613979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:41.614252 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183 admin admin] PATH_INFO: `/v3/projects/dc9c56c4dce64e9aa54b7b4efede8ff0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:41.615642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc9c56c4dce64e9aa54b7b4efede8ff0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:41.617973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:41.676908 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:41.679001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:41.680767 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc9c56c4dce64e9aa54b7b4efede8ff0', 'request_id': 'req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.692933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc9c56c4dce64e9aa54b7b4efede8ff0', 'request_id': 'req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.697325 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b66ae-0de9-43c1-a795-3e93179216be admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:41.699861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc9c56c4dce64e9aa54b7b4efede8ff0', 'request_id': 'req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.721110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183 admin admin] The token cache is being invalidate because project dc9c56c4dce64e9aa54b7b4efede8ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:41.721621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.722678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7a207e1d-fa78-42f9-ac9e-ebb7a7ccf183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.725482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1329/2663] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:41 2022] DELETE /identity/v3/projects/dc9c56c4dce64e9aa54b7b4efede8ff0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:41.732786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241fb85-1cd1-491a-b4a8-bc1fb8ae1692 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:41.733294 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241fb85-1cd1-491a-b4a8-bc1fb8ae1692 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:41.733802 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241fb85-1cd1-491a-b4a8-bc1fb8ae1692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:41.756849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a241fb85-1cd1-491a-b4a8-bc1fb8ae1692 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:41.758463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a241fb85-1cd1-491a-b4a8-bc1fb8ae1692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:41.769042 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1330/2664] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:33:41.775011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:41.775970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:41.776249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:41.776548 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] PATH_INFO: `/v3/users/2c36c4822532468babda677277f345b3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:41.777088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ff288-f050-4bba-8fba-f075d3aabc44 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:41.777378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ff288-f050-4bba-8fba-f075d3aabc44 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:41.777652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ff288-f050-4bba-8fba-f075d3aabc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:41.778028 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c36c4822532468babda677277f345b3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:41.780075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:41.796631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2a1ff288-f050-4bba-8fba-f075d3aabc44 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:41.797861 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2a1ff288-f050-4bba-8fba-f075d3aabc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:41.806189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1331/2665] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:41.810567 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ff288-f050-4bba-8fba-f075d3aabc44 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:41.826609 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ff288-f050-4bba-8fba-f075d3aabc44 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:41.835525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6831bc-7df3-42e1-a7f2-59097c2201cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:41.836700 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6831bc-7df3-42e1-a7f2-59097c2201cd admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:41.837140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6831bc-7df3-42e1-a7f2-59097c2201cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:41.837433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6831bc-7df3-42e1-a7f2-59097c2201cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:41.838168 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6831bc-7df3-42e1-a7f2-59097c2201cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:33:41.838475 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6831bc-7df3-42e1-a7f2-59097c2201cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:41.840119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6831bc-7df3-42e1-a7f2-59097c2201cd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:41.843189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:41.851316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c36c4822532468babda677277f345b3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.854251 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1332/2666] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:33:41.858828 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6831bc-7df3-42e1-a7f2-59097c2201cd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:41.861206 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c36c4822532468babda677277f345b3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.868474 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c36c4822532468babda677277f345b3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.869222 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6831bc-7df3-42e1-a7f2-59097c2201cd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:41.874401 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e462-2648-4fe6-bc3a-c74f692f101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:41.875285 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e462-2648-4fe6-bc3a-c74f692f101d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:41.875573 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e462-2648-4fe6-bc3a-c74f692f101d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:41.875862 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e462-2648-4fe6-bc3a-c74f692f101d admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:41.876624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51e462-2648-4fe6-bc3a-c74f692f101d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:41.878616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51e462-2648-4fe6-bc3a-c74f692f101d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:41.881370 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c36c4822532468babda677277f345b3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.882049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c36c4822532468babda677277f345b3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:41.888758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1335/2667] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:41 2022] DELETE /identity/v3/users/2c36c4822532468babda677277f345b3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:41.908000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1333/2668] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:41 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:33:41.911972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:41.913373 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:41.959538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:41.982458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550202d-df77-4bde-b455-5c4f92c44b29 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.041748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c836b-1100-4b33-ba52-a1a3a2d3125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.042749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c836b-1100-4b33-ba52-a1a3a2d3125f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.043048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c836b-1100-4b33-ba52-a1a3a2d3125f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.043272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c836b-1100-4b33-ba52-a1a3a2d3125f admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.044075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c836b-1100-4b33-ba52-a1a3a2d3125f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.046329 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c836b-1100-4b33-ba52-a1a3a2d3125f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.069275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1336/2669] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:41 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:42.070536 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e462-2648-4fe6-bc3a-c74f692f101d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:42.071812 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c836b-1100-4b33-ba52-a1a3a2d3125f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:42.072418 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-da51e462-2648-4fe6-bc3a-c74f692f101d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:42.082416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c836b-1100-4b33-ba52-a1a3a2d3125f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.087276 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a5a83-6988-4775-b6ab-52ba8fcd6349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.087967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a5a83-6988-4775-b6ab-52ba8fcd6349 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.088247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a5a83-6988-4775-b6ab-52ba8fcd6349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.088609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a5a83-6988-4775-b6ab-52ba8fcd6349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.089492 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a5a83-6988-4775-b6ab-52ba8fcd6349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.091120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a5a83-6988-4775-b6ab-52ba8fcd6349 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.092807 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e462-2648-4fe6-bc3a-c74f692f101d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.099557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.100443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.100815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.101019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] PATH_INFO: `/v3/projects/13f1b3efddab4bc0b0593b06d5898559` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.102248 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f1b3efddab4bc0b0593b06d5898559)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.104357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.109639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1337/2670] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:42.113892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a5a83-6988-4775-b6ab-52ba8fcd6349 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:42.123498 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a5a83-6988-4775-b6ab-52ba8fcd6349 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.128236 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a433f5e-1eb8-47ce-95f4-7c358d4ab509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.128936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a433f5e-1eb8-47ce-95f4-7c358d4ab509 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.129218 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a433f5e-1eb8-47ce-95f4-7c358d4ab509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.129495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a433f5e-1eb8-47ce-95f4-7c358d4ab509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.130217 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a433f5e-1eb8-47ce-95f4-7c358d4ab509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.131853 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a433f5e-1eb8-47ce-95f4-7c358d4ab509 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.144189 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1338/2671] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:33:42.148452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a433f5e-1eb8-47ce-95f4-7c358d4ab509 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:42.158550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a433f5e-1eb8-47ce-95f4-7c358d4ab509 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.161367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f1b3efddab4bc0b0593b06d5898559', 'request_id': 'req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.170560 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f1b3efddab4bc0b0593b06d5898559', 'request_id': 'req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.176690 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f1b3efddab4bc0b0593b06d5898559', 'request_id': 'req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.187980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] The token cache is being invalidate because project 13f1b3efddab4bc0b0593b06d5898559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:42.188186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.188863 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.190661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1334/2672] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:42 2022] DELETE /identity/v3/projects/13f1b3efddab4bc0b0593b06d5898559 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:33:42.194283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:42.195704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:42.215741 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0733b-6415-410f-a542-72fa4f54dab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.216924 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0733b-6415-410f-a542-72fa4f54dab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.217184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0733b-6415-410f-a542-72fa4f54dab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.217459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0733b-6415-410f-a542-72fa4f54dab3 admin admin] PATH_INFO: `/v3/projects/eadbf8d6d9c74e08ad5631eee672a64e/users/754752f4b2fb4b08b688c876b8f36ee7/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.233736 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0733b-6415-410f-a542-72fa4f54dab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadbf8d6d9c74e08ad5631eee672a64e, user_id=754752f4b2fb4b08b688c876b8f36ee7, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.236959 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0733b-6415-410f-a542-72fa4f54dab3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.253262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1339/2673] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:42 2022] PUT /identity/v3/projects/eadbf8d6d9c74e08ad5631eee672a64e/users/754752f4b2fb4b08b688c876b8f36ee7/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:33:42.264027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480cceb-2fd9-4377-b89b-a0d66ce56ae2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.265294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32b3c3-ceb7-4e23-b388-c0328064d361 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.265618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32b3c3-ceb7-4e23-b388-c0328064d361 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.265878 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32b3c3-ceb7-4e23-b388-c0328064d361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.293302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ff32b3c3-ceb7-4e23-b388-c0328064d361 None None] MFA Rules not processed for user `754752f4b2fb4b08b688c876b8f36ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:42.294543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ff32b3c3-ceb7-4e23-b388-c0328064d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:42.326532 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:42.331507 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.332581 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.332905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.333016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] PATH_INFO: `/v3/users/fc9de27217ee4614b5996896735195d8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.334387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9de27217ee4614b5996896735195d8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.336531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.341334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:42.374271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1340/2674] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:42.379085 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32b3c3-ceb7-4e23-b388-c0328064d361 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:42.380452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ff32b3c3-ceb7-4e23-b388-c0328064d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:42.391534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9de27217ee4614b5996896735195d8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.394452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32b3c3-ceb7-4e23-b388-c0328064d361 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.398419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9de27217ee4614b5996896735195d8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.399288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75624e7-e62a-4ded-b82a-fbc301d560c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.399964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75624e7-e62a-4ded-b82a-fbc301d560c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.400249 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75624e7-e62a-4ded-b82a-fbc301d560c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.400548 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75624e7-e62a-4ded-b82a-fbc301d560c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.401242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75624e7-e62a-4ded-b82a-fbc301d560c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.403165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75624e7-e62a-4ded-b82a-fbc301d560c3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.410824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9de27217ee4614b5996896735195d8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.411648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9de27217ee4614b5996896735195d8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.412266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9de27217ee4614b5996896735195d8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.429262 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1335/2675] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:42 2022] DELETE /identity/v3/users/fc9de27217ee4614b5996896735195d8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:33:42.434426 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1341/2676] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:42 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:33:42.435555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:42.436953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:42.502653 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974cb93-a44f-4669-b1dd-648525d55a42 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.564017 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b4bdf-3169-4096-a868-6500bd05fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.564755 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b4bdf-3169-4096-a868-6500bd05fe6b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.565040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b4bdf-3169-4096-a868-6500bd05fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.565315 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b4bdf-3169-4096-a868-6500bd05fe6b admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.566020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b4bdf-3169-4096-a868-6500bd05fe6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.567978 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b4bdf-3169-4096-a868-6500bd05fe6b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.593849 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1336/2677] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:42 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:33:42.598250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75624e7-e62a-4ded-b82a-fbc301d560c3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:42.609676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b4bdf-3169-4096-a868-6500bd05fe6b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:42.611539 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2a4b4bdf-3169-4096-a868-6500bd05fe6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:42.613500 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75624e7-e62a-4ded-b82a-fbc301d560c3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.620169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530a528-9698-4e1d-8a67-1aa5d3928ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.620913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530a528-9698-4e1d-8a67-1aa5d3928ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.621203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530a528-9698-4e1d-8a67-1aa5d3928ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.621503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530a528-9698-4e1d-8a67-1aa5d3928ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.622379 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530a528-9698-4e1d-8a67-1aa5d3928ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.623887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530a528-9698-4e1d-8a67-1aa5d3928ce6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.630710 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b4bdf-3169-4096-a868-6500bd05fe6b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.636269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1342/2678] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:42.640333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530a528-9698-4e1d-8a67-1aa5d3928ce6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:42.643546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.644475 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.644940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.645228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] PATH_INFO: `/v3/projects/adbbc4b3d5474ee196cf82be12eeaeee` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.646495 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbbc4b3d5474ee196cf82be12eeaeee)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.648517 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.650997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530a528-9698-4e1d-8a67-1aa5d3928ce6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.656233 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7aa0f-d992-4bb0-9ce7-dbec5ab8ceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.657169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7aa0f-d992-4bb0-9ce7-dbec5ab8ceb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.657476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7aa0f-d992-4bb0-9ce7-dbec5ab8ceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.657759 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7aa0f-d992-4bb0-9ce7-dbec5ab8ceb5 admin admin] PATH_INFO: `/v3/projects/56c54b8c9cd9440797f6864b7dbc37e1/users/006189e445e1407baa290bc854ae1c05/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.666429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:42.678458 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7aa0f-d992-4bb0-9ce7-dbec5ab8ceb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c54b8c9cd9440797f6864b7dbc37e1, user_id=006189e445e1407baa290bc854ae1c05, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.682351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7aa0f-d992-4bb0-9ce7-dbec5ab8ceb5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.698683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1343/2679] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:42 2022] PUT /identity/v3/projects/56c54b8c9cd9440797f6864b7dbc37e1/users/006189e445e1407baa290bc854ae1c05/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:42.702795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7aa0f-d992-4bb0-9ce7-dbec5ab8ceb5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:42.703559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbbc4b3d5474ee196cf82be12eeaeee', 'request_id': 'req-c64bc9f0-bf6c-4c81-9177-acb58db09314'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.711987 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbbc4b3d5474ee196cf82be12eeaeee', 'request_id': 'req-c64bc9f0-bf6c-4c81-9177-acb58db09314'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.718467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbbc4b3d5474ee196cf82be12eeaeee', 'request_id': 'req-c64bc9f0-bf6c-4c81-9177-acb58db09314'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.730266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] The token cache is being invalidate because project adbbc4b3d5474ee196cf82be12eeaeee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:42.730545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.731190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:42.732893 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1337/2680] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:42 2022] DELETE /identity/v3/projects/adbbc4b3d5474ee196cf82be12eeaeee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:33:42.768671 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7aa0f-d992-4bb0-9ce7-dbec5ab8ceb5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.773726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586fa2e-a631-4e87-950c-11de509cb039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.774441 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586fa2e-a631-4e87-950c-11de509cb039 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.774726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586fa2e-a631-4e87-950c-11de509cb039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.775005 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586fa2e-a631-4e87-950c-11de509cb039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.775760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586fa2e-a631-4e87-950c-11de509cb039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.777482 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586fa2e-a631-4e87-950c-11de509cb039 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.789002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1344/2681] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:33:42.793289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:42.795224 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:42.869343 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc9f0-bf6c-4c81-9177-acb58db09314 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:42.874973 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e5661-1a2a-4503-8b63-e1e1a852949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:42.875888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e5661-1a2a-4503-8b63-e1e1a852949d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.876162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e5661-1a2a-4503-8b63-e1e1a852949d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.876438 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e5661-1a2a-4503-8b63-e1e1a852949d admin admin] PATH_INFO: `/v3/projects/56c54b8c9cd9440797f6864b7dbc37e1/users/006189e445e1407baa290bc854ae1c05/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.878746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e5661-1a2a-4503-8b63-e1e1a852949d admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c54b8c9cd9440797f6864b7dbc37e1, user_id=006189e445e1407baa290bc854ae1c05, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:42.881528 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e5661-1a2a-4503-8b63-e1e1a852949d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:42.903762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1338/2682] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:42 2022] PUT /identity/v3/projects/56c54b8c9cd9440797f6864b7dbc37e1/users/006189e445e1407baa290bc854ae1c05/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:42.906544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb42c2-e94f-498e-9cc1-d14120d4c9ff None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:42.906790 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb42c2-e94f-498e-9cc1-d14120d4c9ff None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:42.907112 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb42c2-e94f-498e-9cc1-d14120d4c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:42.938970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-aacb42c2-e94f-498e-9cc1-d14120d4c9ff None None] MFA Rules not processed for user `006189e445e1407baa290bc854ae1c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:42.940159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aacb42c2-e94f-498e-9cc1-d14120d4c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:43.002549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:43.028326 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1345/2683] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:43.040001 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e5661-1a2a-4503-8b63-e1e1a852949d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:43.042159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e43e5661-1a2a-4503-8b63-e1e1a852949d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:43.112877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e5661-1a2a-4503-8b63-e1e1a852949d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:43.116894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593d538-e7c7-4199-a8f8-ad7a976d74b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:43.117547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593d538-e7c7-4199-a8f8-ad7a976d74b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:43.117827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593d538-e7c7-4199-a8f8-ad7a976d74b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:43.118103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593d538-e7c7-4199-a8f8-ad7a976d74b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:43.127850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593d538-e7c7-4199-a8f8-ad7a976d74b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:43.129328 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593d538-e7c7-4199-a8f8-ad7a976d74b8 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:43.140175 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1339/2684] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:43.209345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb42c2-e94f-498e-9cc1-d14120d4c9ff None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:43.283548 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb42c2-e94f-498e-9cc1-d14120d4c9ff None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:43.288403 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:43.289353 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:43.289636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:43.289916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] PATH_INFO: `/v3/users/754752f4b2fb4b08b688c876b8f36ee7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:43.291169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=754752f4b2fb4b08b688c876b8f36ee7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:43.293176 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:43.345977 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754752f4b2fb4b08b688c876b8f36ee7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:43.355606 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754752f4b2fb4b08b688c876b8f36ee7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:43.368253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754752f4b2fb4b08b688c876b8f36ee7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:43.387313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754752f4b2fb4b08b688c876b8f36ee7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:43.388114 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754752f4b2fb4b08b688c876b8f36ee7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:43.394493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1346/2685] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:43 2022] DELETE /identity/v3/users/754752f4b2fb4b08b688c876b8f36ee7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:43.399240 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc674-bf2e-402c-aa73-96ae9035e80f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:43.399532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc674-bf2e-402c-aa73-96ae9035e80f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:43.399813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc674-bf2e-402c-aa73-96ae9035e80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:43.418600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-263dc674-bf2e-402c-aa73-96ae9035e80f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:43.419868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-263dc674-bf2e-402c-aa73-96ae9035e80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:43.455154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:43.491252 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1340/2686] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:43.501512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:43.503174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:43.563542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bb84f-5fc3-4161-9824-03a3f1654113 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:43.567416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b8f92-9f9a-4413-bd00-cbcdb1e61910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:43.568068 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b8f92-9f9a-4413-bd00-cbcdb1e61910 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:43.568347 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b8f92-9f9a-4413-bd00-cbcdb1e61910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:43.568650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b8f92-9f9a-4413-bd00-cbcdb1e61910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:43.578538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b8f92-9f9a-4413-bd00-cbcdb1e61910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:43.580061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b8f92-9f9a-4413-bd00-cbcdb1e61910 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:43.590036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1347/2687] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:33:43.902469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc674-bf2e-402c-aa73-96ae9035e80f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:43.904709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-263dc674-bf2e-402c-aa73-96ae9035e80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:43.919135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc674-bf2e-402c-aa73-96ae9035e80f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:43.924630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:43.926250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:43.926546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:43.926804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] PATH_INFO: `/v3/projects/eadbf8d6d9c74e08ad5631eee672a64e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:43.928144 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadbf8d6d9c74e08ad5631eee672a64e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:43.930080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:43.983628 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadbf8d6d9c74e08ad5631eee672a64e', 'request_id': 'req-c50d7a53-827c-425d-bc5b-6c20effb4767'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:43.994429 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadbf8d6d9c74e08ad5631eee672a64e', 'request_id': 'req-c50d7a53-827c-425d-bc5b-6c20effb4767'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.000359 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadbf8d6d9c74e08ad5631eee672a64e', 'request_id': 'req-c50d7a53-827c-425d-bc5b-6c20effb4767'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.012336 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] The token cache is being invalidate because project eadbf8d6d9c74e08ad5631eee672a64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:44.012647 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.013473 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.015059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1341/2688] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:43 2022] DELETE /identity/v3/projects/eadbf8d6d9c74e08ad5631eee672a64e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:44.019339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b8f92-9f9a-4413-bd00-cbcdb1e61910 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:44.029268 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b8f92-9f9a-4413-bd00-cbcdb1e61910 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:44.038628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:44.095912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0f26e-eeb8-4cc0-8009-0458c2cc402f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:44.096847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0f26e-eeb8-4cc0-8009-0458c2cc402f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:44.097123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0f26e-eeb8-4cc0-8009-0458c2cc402f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:44.097396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0f26e-eeb8-4cc0-8009-0458c2cc402f admin admin] PATH_INFO: `/v3/users/006189e445e1407baa290bc854ae1c05` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:44.098683 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0f26e-eeb8-4cc0-8009-0458c2cc402f admin admin] RBAC: Authorizing `identity:delete_user(user_id=006189e445e1407baa290bc854ae1c05)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:44.100661 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0f26e-eeb8-4cc0-8009-0458c2cc402f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:44.156827 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d8e0f26e-eeb8-4cc0-8009-0458c2cc402f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006189e445e1407baa290bc854ae1c05'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.165731 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d8e0f26e-eeb8-4cc0-8009-0458c2cc402f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006189e445e1407baa290bc854ae1c05'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.173136 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d8e0f26e-eeb8-4cc0-8009-0458c2cc402f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006189e445e1407baa290bc854ae1c05'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.191228 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d8e0f26e-eeb8-4cc0-8009-0458c2cc402f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006189e445e1407baa290bc854ae1c05'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.192550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d8e0f26e-eeb8-4cc0-8009-0458c2cc402f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006189e445e1407baa290bc854ae1c05'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.201783 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1348/2689] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:44 2022] DELETE /identity/v3/users/006189e445e1407baa290bc854ae1c05 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:44.492320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:44.493921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:44.507940 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d7a53-827c-425d-bc5b-6c20effb4767 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:44.570391 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a856d56-532f-45e6-b018-16dea0b39af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:44.571215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a856d56-532f-45e6-b018-16dea0b39af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:44.571499 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a856d56-532f-45e6-b018-16dea0b39af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:44.571780 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a856d56-532f-45e6-b018-16dea0b39af7 admin admin] PATH_INFO: `/v3/projects/56c54b8c9cd9440797f6864b7dbc37e1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:44.573162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a856d56-532f-45e6-b018-16dea0b39af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c54b8c9cd9440797f6864b7dbc37e1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:44.575606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a856d56-532f-45e6-b018-16dea0b39af7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:44.626646 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a856d56-532f-45e6-b018-16dea0b39af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c54b8c9cd9440797f6864b7dbc37e1', 'request_id': 'req-3a856d56-532f-45e6-b018-16dea0b39af7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.635680 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a856d56-532f-45e6-b018-16dea0b39af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c54b8c9cd9440797f6864b7dbc37e1', 'request_id': 'req-3a856d56-532f-45e6-b018-16dea0b39af7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.642814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a856d56-532f-45e6-b018-16dea0b39af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c54b8c9cd9440797f6864b7dbc37e1', 'request_id': 'req-3a856d56-532f-45e6-b018-16dea0b39af7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.643954 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:44.659652 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a856d56-532f-45e6-b018-16dea0b39af7 admin admin] The token cache is being invalidate because project 56c54b8c9cd9440797f6864b7dbc37e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:44.660104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a856d56-532f-45e6-b018-16dea0b39af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.661027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a856d56-532f-45e6-b018-16dea0b39af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:44.662602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1342/2690] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:44 2022] DELETE /identity/v3/projects/56c54b8c9cd9440797f6864b7dbc37e1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:44.667654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cac93-956f-4fa3-b492-bbe30856ad29 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:44.668181 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cac93-956f-4fa3-b492-bbe30856ad29 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:44.668181 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cac93-956f-4fa3-b492-bbe30856ad29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:44.687180 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b56cac93-956f-4fa3-b492-bbe30856ad29 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:44.688394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b56cac93-956f-4fa3-b492-bbe30856ad29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:44.751215 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1349/2691] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:44.759131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d242e-7c51-422f-b7c8-2863423523f2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:44.759421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d242e-7c51-422f-b7c8-2863423523f2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:44.759699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d242e-7c51-422f-b7c8-2863423523f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:44.779121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f66d242e-7c51-422f-b7c8-2863423523f2 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:44.780321 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f66d242e-7c51-422f-b7c8-2863423523f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:44.789077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1343/2692] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:44.794287 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cac93-956f-4fa3-b492-bbe30856ad29 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:44.810157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cac93-956f-4fa3-b492-bbe30856ad29 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:44.819026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830248cd-d992-4567-be49-adf358fd424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:44.819978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830248cd-d992-4567-be49-adf358fd424d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:44.820353 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830248cd-d992-4567-be49-adf358fd424d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:44.820911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830248cd-d992-4567-be49-adf358fd424d admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:44.821588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830248cd-d992-4567-be49-adf358fd424d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:33:44.822056 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830248cd-d992-4567-be49-adf358fd424d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:44.824236 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830248cd-d992-4567-be49-adf358fd424d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:44.837672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1350/2693] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:33:44.842450 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d242e-7c51-422f-b7c8-2863423523f2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:44.852319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d242e-7c51-422f-b7c8-2863423523f2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:44.858404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9e722-05ca-4706-8baa-ec3b91a60b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:44.859059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9e722-05ca-4706-8baa-ec3b91a60b4b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:44.859332 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9e722-05ca-4706-8baa-ec3b91a60b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:44.859574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9e722-05ca-4706-8baa-ec3b91a60b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:44.860289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9e722-05ca-4706-8baa-ec3b91a60b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:44.862238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9e722-05ca-4706-8baa-ec3b91a60b4b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:44.893167 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1344/2694] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:44 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:44.897565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830248cd-d992-4567-be49-adf358fd424d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:44.908275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830248cd-d992-4567-be49-adf358fd424d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:44.926469 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:44.973352 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb45b8-d012-41ba-afeb-2261b78ccbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:44.974043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb45b8-d012-41ba-afeb-2261b78ccbcd admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:44.974314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb45b8-d012-41ba-afeb-2261b78ccbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:44.974590 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb45b8-d012-41ba-afeb-2261b78ccbcd admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:44.975290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb45b8-d012-41ba-afeb-2261b78ccbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:44.977263 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb45b8-d012-41ba-afeb-2261b78ccbcd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:45.005408 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1351/2695] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:44 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:45.007366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9e722-05ca-4706-8baa-ec3b91a60b4b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:45.023153 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9e722-05ca-4706-8baa-ec3b91a60b4b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:45.028463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731dc56-2a49-41ca-9b83-397743cd18d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:45.029197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731dc56-2a49-41ca-9b83-397743cd18d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.029484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731dc56-2a49-41ca-9b83-397743cd18d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.029756 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731dc56-2a49-41ca-9b83-397743cd18d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.030532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731dc56-2a49-41ca-9b83-397743cd18d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:45.032171 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731dc56-2a49-41ca-9b83-397743cd18d1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:45.043666 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1345/2696] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:45.048194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb45b8-d012-41ba-afeb-2261b78ccbcd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:45.058851 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb45b8-d012-41ba-afeb-2261b78ccbcd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:45.069346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec5c3f-567c-495d-95eb-4b49d6cee5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:45.070042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec5c3f-567c-495d-95eb-4b49d6cee5ed admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.070317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec5c3f-567c-495d-95eb-4b49d6cee5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.070591 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec5c3f-567c-495d-95eb-4b49d6cee5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.071402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec5c3f-567c-495d-95eb-4b49d6cee5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:45.072982 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec5c3f-567c-495d-95eb-4b49d6cee5ed admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:45.084880 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1352/2697] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:45.090045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731dc56-2a49-41ca-9b83-397743cd18d1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:45.100661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731dc56-2a49-41ca-9b83-397743cd18d1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:45.105601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8ed76-f9d3-44e0-8c27-185a65e96132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:45.106538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8ed76-f9d3-44e0-8c27-185a65e96132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.106825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8ed76-f9d3-44e0-8c27-185a65e96132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.107178 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8ed76-f9d3-44e0-8c27-185a65e96132 admin admin] PATH_INFO: `/v3/projects/dbdfe2f6bbde4df887b72ba390aad190/users/9d02a56ce70544088d63a394e612b5fa/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.125414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8ed76-f9d3-44e0-8c27-185a65e96132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbdfe2f6bbde4df887b72ba390aad190, user_id=9d02a56ce70544088d63a394e612b5fa, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:45.128156 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8ed76-f9d3-44e0-8c27-185a65e96132 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:45.142919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1346/2698] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:45 2022] PUT /identity/v3/projects/dbdfe2f6bbde4df887b72ba390aad190/users/9d02a56ce70544088d63a394e612b5fa/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:45.154957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eab3bf-0899-418e-99a6-38d9e02d619d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.155245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eab3bf-0899-418e-99a6-38d9e02d619d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.155556 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eab3bf-0899-418e-99a6-38d9e02d619d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.183046 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-64eab3bf-0899-418e-99a6-38d9e02d619d None None] MFA Rules not processed for user `9d02a56ce70544088d63a394e612b5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:45.184280 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-64eab3bf-0899-418e-99a6-38d9e02d619d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:45.254420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1353/2699] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:45.259324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8ed76-f9d3-44e0-8c27-185a65e96132 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:45.348600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8ed76-f9d3-44e0-8c27-185a65e96132 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:45.354769 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab453d0-d751-4340-b925-b18bc62d4f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:45.356601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab453d0-d751-4340-b925-b18bc62d4f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.356914 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab453d0-d751-4340-b925-b18bc62d4f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.357218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab453d0-d751-4340-b925-b18bc62d4f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.358038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab453d0-d751-4340-b925-b18bc62d4f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:45.360008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab453d0-d751-4340-b925-b18bc62d4f88 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:45.390738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1347/2700] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:45 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:45.395144 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eab3bf-0899-418e-99a6-38d9e02d619d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:45.406976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eab3bf-0899-418e-99a6-38d9e02d619d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:45.470667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5228df-9abe-45e0-b167-dd97e911dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:45.471348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5228df-9abe-45e0-b167-dd97e911dc3b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.471639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5228df-9abe-45e0-b167-dd97e911dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.471976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5228df-9abe-45e0-b167-dd97e911dc3b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.472720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5228df-9abe-45e0-b167-dd97e911dc3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:45.474654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5228df-9abe-45e0-b167-dd97e911dc3b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:45.498004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1354/2701] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:45 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:45.502455 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab453d0-d751-4340-b925-b18bc62d4f88 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:45.514442 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab453d0-d751-4340-b925-b18bc62d4f88 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:45.519614 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464655-8c4d-4050-a925-59ec5fd2ca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:45.520291 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464655-8c4d-4050-a925-59ec5fd2ca01 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.520615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464655-8c4d-4050-a925-59ec5fd2ca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.520891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464655-8c4d-4050-a925-59ec5fd2ca01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.521622 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e464655-8c4d-4050-a925-59ec5fd2ca01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:45.523416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e464655-8c4d-4050-a925-59ec5fd2ca01 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:45.534723 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1348/2702] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:45.539278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5228df-9abe-45e0-b167-dd97e911dc3b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:45.550434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5228df-9abe-45e0-b167-dd97e911dc3b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:45.556391 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a95b-9e92-4205-9c9d-9dc05d0bd8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:45.557366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a95b-9e92-4205-9c9d-9dc05d0bd8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.557605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a95b-9e92-4205-9c9d-9dc05d0bd8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.557901 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a95b-9e92-4205-9c9d-9dc05d0bd8a5 admin admin] PATH_INFO: `/v3/projects/2da26977ca0c49818fab6584c17720d7/users/c91c9b1bafca4fd0a06a0246f67ef062/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.574481 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187a95b-9e92-4205-9c9d-9dc05d0bd8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da26977ca0c49818fab6584c17720d7, user_id=c91c9b1bafca4fd0a06a0246f67ef062, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:45.577338 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187a95b-9e92-4205-9c9d-9dc05d0bd8a5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:45.579720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:45.597124 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1355/2703] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:45 2022] PUT /identity/v3/projects/2da26977ca0c49818fab6584c17720d7/users/c91c9b1bafca4fd0a06a0246f67ef062/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:33:45.603252 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464655-8c4d-4050-a925-59ec5fd2ca01 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:45.615545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464655-8c4d-4050-a925-59ec5fd2ca01 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:45.684061 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b58e7-4f99-4c43-a1ef-12fd9e580d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:45.684812 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b58e7-4f99-4c43-a1ef-12fd9e580d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.685088 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b58e7-4f99-4c43-a1ef-12fd9e580d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.685357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b58e7-4f99-4c43-a1ef-12fd9e580d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.686136 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b58e7-4f99-4c43-a1ef-12fd9e580d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:45.687946 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b58e7-4f99-4c43-a1ef-12fd9e580d40 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:45.693942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:45.699872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1349/2704] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:45.704538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a95b-9e92-4205-9c9d-9dc05d0bd8a5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:45.715782 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a95b-9e92-4205-9c9d-9dc05d0bd8a5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:45.721582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68652f98-237f-4bd1-8573-658415665160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:45.722493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68652f98-237f-4bd1-8573-658415665160 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.722775 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68652f98-237f-4bd1-8573-658415665160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.723053 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68652f98-237f-4bd1-8573-658415665160 admin admin] PATH_INFO: `/v3/projects/2da26977ca0c49818fab6584c17720d7/users/c91c9b1bafca4fd0a06a0246f67ef062/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.725305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68652f98-237f-4bd1-8573-658415665160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da26977ca0c49818fab6584c17720d7, user_id=c91c9b1bafca4fd0a06a0246f67ef062, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:45.728042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68652f98-237f-4bd1-8573-658415665160 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:45.739605 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1356/2705] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:45 2022] PUT /identity/v3/projects/2da26977ca0c49818fab6584c17720d7/users/c91c9b1bafca4fd0a06a0246f67ef062/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:45.749999 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62877cbe-b4be-4086-b628-462df5a4e006 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.750281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62877cbe-b4be-4086-b628-462df5a4e006 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.750552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62877cbe-b4be-4086-b628-462df5a4e006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.779881 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-62877cbe-b4be-4086-b628-462df5a4e006 None None] MFA Rules not processed for user `c91c9b1bafca4fd0a06a0246f67ef062`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:45.781254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-62877cbe-b4be-4086-b628-462df5a4e006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:45.853436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1350/2706] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:45.864700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68652f98-237f-4bd1-8573-658415665160 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:45.867061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-68652f98-237f-4bd1-8573-658415665160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:45.941575 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68652f98-237f-4bd1-8573-658415665160 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:45.945539 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f3b40-098a-428f-b3dd-a9405789abc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:45.946207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f3b40-098a-428f-b3dd-a9405789abc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:45.946489 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f3b40-098a-428f-b3dd-a9405789abc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:45.946752 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f3b40-098a-428f-b3dd-a9405789abc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:45.956344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f3b40-098a-428f-b3dd-a9405789abc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:45.957957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f3b40-098a-428f-b3dd-a9405789abc3 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:45.969667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1357/2707] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:46.075081 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62877cbe-b4be-4086-b628-462df5a4e006 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:46.086218 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62877cbe-b4be-4086-b628-462df5a4e006 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:46.090131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e0974-b038-4d22-aea5-af57d75053dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:46.090781 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e0974-b038-4d22-aea5-af57d75053dd service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:46.091065 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e0974-b038-4d22-aea5-af57d75053dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:46.091425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e0974-b038-4d22-aea5-af57d75053dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:46.151695 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e0974-b038-4d22-aea5-af57d75053dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:46.153237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e0974-b038-4d22-aea5-af57d75053dd service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:46.162423 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1351/2708] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:48.771534 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f3b40-098a-428f-b3dd-a9405789abc3 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:48.838079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f3b40-098a-428f-b3dd-a9405789abc3 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:48.843976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:48.844909 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:48.845193 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:48.845466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] PATH_INFO: `/v3/users/9d02a56ce70544088d63a394e612b5fa` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:48.846846 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d02a56ce70544088d63a394e612b5fa)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:48.848821 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:48.899814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d02a56ce70544088d63a394e612b5fa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:48.908245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d02a56ce70544088d63a394e612b5fa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:48.915315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d02a56ce70544088d63a394e612b5fa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:48.927364 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d02a56ce70544088d63a394e612b5fa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:48.928058 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d02a56ce70544088d63a394e612b5fa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:48.934029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1358/2709] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:48 2022] DELETE /identity/v3/users/9d02a56ce70544088d63a394e612b5fa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:48.938782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8797601-9755-4165-b39c-1618b96a83ac None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:48.939264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8797601-9755-4165-b39c-1618b96a83ac None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:48.939362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8797601-9755-4165-b39c-1618b96a83ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:48.962324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f8797601-9755-4165-b39c-1618b96a83ac None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:48.963924 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f8797601-9755-4165-b39c-1618b96a83ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:49.036284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1352/2710] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:33:49.046182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:49.047689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:49.053521 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:49.115713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a2be6-a90d-4e94-a8de-e706487bd697 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:49.120202 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fb7a0-ce1a-4626-9911-bd98763a25bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:49.121138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fb7a0-ce1a-4626-9911-bd98763a25bc service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:49.121518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fb7a0-ce1a-4626-9911-bd98763a25bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:49.121809 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fb7a0-ce1a-4626-9911-bd98763a25bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:49.134231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fb7a0-ce1a-4626-9911-bd98763a25bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:49.136017 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fb7a0-ce1a-4626-9911-bd98763a25bc service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:49.149016 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1359/2711] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:49.452086 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8797601-9755-4165-b39c-1618b96a83ac None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:49.453681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f8797601-9755-4165-b39c-1618b96a83ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:49.468316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8797601-9755-4165-b39c-1618b96a83ac None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:49.473864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:49.474748 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:49.475029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:49.475301 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] PATH_INFO: `/v3/projects/dbdfe2f6bbde4df887b72ba390aad190` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:49.476644 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbdfe2f6bbde4df887b72ba390aad190)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:49.478599 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:49.502878 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:49.538873 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbdfe2f6bbde4df887b72ba390aad190', 'request_id': 'req-df1798c5-4376-4051-9fd5-9a51b3788a0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:49.550631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbdfe2f6bbde4df887b72ba390aad190', 'request_id': 'req-df1798c5-4376-4051-9fd5-9a51b3788a0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:49.556777 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbdfe2f6bbde4df887b72ba390aad190', 'request_id': 'req-df1798c5-4376-4051-9fd5-9a51b3788a0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:49.568132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] The token cache is being invalidate because project dbdfe2f6bbde4df887b72ba390aad190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:49.568419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:49.569092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:49.570679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1353/2712] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:49 2022] DELETE /identity/v3/projects/dbdfe2f6bbde4df887b72ba390aad190 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:49.574769 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fb7a0-ce1a-4626-9911-bd98763a25bc service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:49.585582 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fb7a0-ce1a-4626-9911-bd98763a25bc service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:49.645376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268246f5-53ca-4057-8859-e0334ce57032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:49.646247 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268246f5-53ca-4057-8859-e0334ce57032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:49.646525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268246f5-53ca-4057-8859-e0334ce57032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:49.646807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268246f5-53ca-4057-8859-e0334ce57032 admin admin] PATH_INFO: `/v3/users/c91c9b1bafca4fd0a06a0246f67ef062` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:49.648126 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268246f5-53ca-4057-8859-e0334ce57032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91c9b1bafca4fd0a06a0246f67ef062)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:49.650096 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268246f5-53ca-4057-8859-e0334ce57032 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:49.704916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-268246f5-53ca-4057-8859-e0334ce57032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91c9b1bafca4fd0a06a0246f67ef062'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:49.713954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-268246f5-53ca-4057-8859-e0334ce57032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91c9b1bafca4fd0a06a0246f67ef062'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:49.721588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-268246f5-53ca-4057-8859-e0334ce57032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91c9b1bafca4fd0a06a0246f67ef062'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:49.733622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-268246f5-53ca-4057-8859-e0334ce57032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91c9b1bafca4fd0a06a0246f67ef062'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:49.734285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-268246f5-53ca-4057-8859-e0334ce57032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91c9b1bafca4fd0a06a0246f67ef062'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:49.740367 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1360/2713] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:49 2022] DELETE /identity/v3/users/c91c9b1bafca4fd0a06a0246f67ef062 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:50.042632 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:50.044232 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:50.059826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1798c5-4376-4051-9fd5-9a51b3788a0d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:50.120204 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba024c9-0039-416d-97ea-70e02965e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:50.121121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba024c9-0039-416d-97ea-70e02965e882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:50.121404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba024c9-0039-416d-97ea-70e02965e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:50.121655 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba024c9-0039-416d-97ea-70e02965e882 admin admin] PATH_INFO: `/v3/projects/2da26977ca0c49818fab6584c17720d7` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:50.122971 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba024c9-0039-416d-97ea-70e02965e882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da26977ca0c49818fab6584c17720d7)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:50.125036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba024c9-0039-416d-97ea-70e02965e882 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:50.174756 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2ba024c9-0039-416d-97ea-70e02965e882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da26977ca0c49818fab6584c17720d7', 'request_id': 'req-2ba024c9-0039-416d-97ea-70e02965e882'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:50.183229 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2ba024c9-0039-416d-97ea-70e02965e882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da26977ca0c49818fab6584c17720d7', 'request_id': 'req-2ba024c9-0039-416d-97ea-70e02965e882'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:50.189059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2ba024c9-0039-416d-97ea-70e02965e882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da26977ca0c49818fab6584c17720d7', 'request_id': 'req-2ba024c9-0039-416d-97ea-70e02965e882'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:50.200038 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2ba024c9-0039-416d-97ea-70e02965e882 admin admin] The token cache is being invalidate because project 2da26977ca0c49818fab6584c17720d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:50.200326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2ba024c9-0039-416d-97ea-70e02965e882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:50.200996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2ba024c9-0039-416d-97ea-70e02965e882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:50.202631 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1354/2714] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:50 2022] DELETE /identity/v3/projects/2da26977ca0c49818fab6584c17720d7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:50.207752 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba58c91-4a97-4083-a79e-1b0efb7e607e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:50.208257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba58c91-4a97-4083-a79e-1b0efb7e607e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:50.208381 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba58c91-4a97-4083-a79e-1b0efb7e607e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:50.228791 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4ba58c91-4a97-4083-a79e-1b0efb7e607e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:50.230007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4ba58c91-4a97-4083-a79e-1b0efb7e607e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:50.250158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:50.294856 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1361/2715] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:33:50.303217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc731-49fe-4296-86d0-da2b74b0165d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:50.303966 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc731-49fe-4296-86d0-da2b74b0165d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:50.303966 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc731-49fe-4296-86d0-da2b74b0165d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:50.322970 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fd6bc731-49fe-4296-86d0-da2b74b0165d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:50.324113 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fd6bc731-49fe-4296-86d0-da2b74b0165d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:50.332296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1355/2716] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:50.337169 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba58c91-4a97-4083-a79e-1b0efb7e607e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:50.348551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba58c91-4a97-4083-a79e-1b0efb7e607e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:50.353954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57f57b-36d8-4884-ba38-d1123eebf3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:50.354632 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57f57b-36d8-4884-ba38-d1123eebf3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:50.354912 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57f57b-36d8-4884-ba38-d1123eebf3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:50.355186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57f57b-36d8-4884-ba38-d1123eebf3e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:50.355920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57f57b-36d8-4884-ba38-d1123eebf3e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:33:50.356226 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57f57b-36d8-4884-ba38-d1123eebf3e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:50.357917 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57f57b-36d8-4884-ba38-d1123eebf3e7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:50.370745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1362/2717] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:33:50.376000 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bc731-49fe-4296-86d0-da2b74b0165d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:50.388355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bc731-49fe-4296-86d0-da2b74b0165d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:50.393655 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26aac2-e917-4ce4-ac5c-a9c524d91200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:50.394349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26aac2-e917-4ce4-ac5c-a9c524d91200 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:50.394637 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26aac2-e917-4ce4-ac5c-a9c524d91200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:50.394915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26aac2-e917-4ce4-ac5c-a9c524d91200 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:50.395592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26aac2-e917-4ce4-ac5c-a9c524d91200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:50.397598 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26aac2-e917-4ce4-ac5c-a9c524d91200 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:50.426521 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1356/2718] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:50 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:50.430720 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57f57b-36d8-4884-ba38-d1123eebf3e7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:50.441987 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57f57b-36d8-4884-ba38-d1123eebf3e7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:50.508396 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814aab81-5684-4b42-97c1-0d6e3bd4dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:50.509108 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814aab81-5684-4b42-97c1-0d6e3bd4dc7b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:50.509377 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814aab81-5684-4b42-97c1-0d6e3bd4dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:50.510001 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814aab81-5684-4b42-97c1-0d6e3bd4dc7b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:50.510707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814aab81-5684-4b42-97c1-0d6e3bd4dc7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:50.512698 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814aab81-5684-4b42-97c1-0d6e3bd4dc7b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:50.535081 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1363/2719] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:50 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:50.539476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26aac2-e917-4ce4-ac5c-a9c524d91200 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:50.550755 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26aac2-e917-4ce4-ac5c-a9c524d91200 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:50.556306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7839c-01fc-4ff7-88f4-a95e4d27d2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:50.557023 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7839c-01fc-4ff7-88f4-a95e4d27d2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:50.557307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7839c-01fc-4ff7-88f4-a95e4d27d2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:50.557585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7839c-01fc-4ff7-88f4-a95e4d27d2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:50.558337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7839c-01fc-4ff7-88f4-a95e4d27d2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:50.559990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7839c-01fc-4ff7-88f4-a95e4d27d2f0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:50.562339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:50.574633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1357/2720] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:50.577242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814aab81-5684-4b42-97c1-0d6e3bd4dc7b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:50.588030 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814aab81-5684-4b42-97c1-0d6e3bd4dc7b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:50.593972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c5507-9728-4539-bda5-954add21357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:50.594650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c5507-9728-4539-bda5-954add21357d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:50.594927 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c5507-9728-4539-bda5-954add21357d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:50.595199 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c5507-9728-4539-bda5-954add21357d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:50.595931 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c5507-9728-4539-bda5-954add21357d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:50.597587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c5507-9728-4539-bda5-954add21357d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:50.608257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1364/2721] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:50.612801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7839c-01fc-4ff7-88f4-a95e4d27d2f0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:50.623601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7839c-01fc-4ff7-88f4-a95e4d27d2f0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:50.628797 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07934ff-4171-4161-9910-46bc440cf7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:50.629704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07934ff-4171-4161-9910-46bc440cf7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:50.629989 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07934ff-4171-4161-9910-46bc440cf7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:50.630266 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07934ff-4171-4161-9910-46bc440cf7d9 admin admin] PATH_INFO: `/v3/projects/05e8a95f81394dfe846c39aabbad5db3/users/6c62ec0beafe40689c55243f1a877c4e/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:50.647656 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07934ff-4171-4161-9910-46bc440cf7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e8a95f81394dfe846c39aabbad5db3, user_id=6c62ec0beafe40689c55243f1a877c4e, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:50.650424 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07934ff-4171-4161-9910-46bc440cf7d9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:50.665990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1358/2722] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:50 2022] PUT /identity/v3/projects/05e8a95f81394dfe846c39aabbad5db3/users/6c62ec0beafe40689c55243f1a877c4e/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:50.677723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607a80f-59c8-48d2-be78-6770cb040028 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:50.678009 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607a80f-59c8-48d2-be78-6770cb040028 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:50.678283 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607a80f-59c8-48d2-be78-6770cb040028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:50.706819 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0607a80f-59c8-48d2-be78-6770cb040028 None None] MFA Rules not processed for user `6c62ec0beafe40689c55243f1a877c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:50.708027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0607a80f-59c8-48d2-be78-6770cb040028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:50.777044 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1365/2723] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:50.789402 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07934ff-4171-4161-9910-46bc440cf7d9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:50.791603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d07934ff-4171-4161-9910-46bc440cf7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:50.857760 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07934ff-4171-4161-9910-46bc440cf7d9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:50.862225 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37496ece-7dfc-450b-af37-c0cc153ebc3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:50.862860 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37496ece-7dfc-450b-af37-c0cc153ebc3b service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:50.863134 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37496ece-7dfc-450b-af37-c0cc153ebc3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:50.863410 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37496ece-7dfc-450b-af37-c0cc153ebc3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:50.872708 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37496ece-7dfc-450b-af37-c0cc153ebc3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:50.874161 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37496ece-7dfc-450b-af37-c0cc153ebc3b service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:50.883719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1359/2724] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:56.336817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607a80f-59c8-48d2-be78-6770cb040028 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:56.360947 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:56.417122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607a80f-59c8-48d2-be78-6770cb040028 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:56.421687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:56.422591 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:56.422867 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:56.423142 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] PATH_INFO: `/v3/users/6c62ec0beafe40689c55243f1a877c4e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:56.424366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c62ec0beafe40689c55243f1a877c4e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:56.426351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:56.482186 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c62ec0beafe40689c55243f1a877c4e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:56.503126 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c62ec0beafe40689c55243f1a877c4e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:56.511547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c62ec0beafe40689c55243f1a877c4e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:56.524172 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c62ec0beafe40689c55243f1a877c4e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:56.524887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c62ec0beafe40689c55243f1a877c4e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:56.531400 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1366/2725] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:56 2022] DELETE /identity/v3/users/6c62ec0beafe40689c55243f1a877c4e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:56.536568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaff884-e447-46d6-b973-e24b6667702a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:56.537140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaff884-e447-46d6-b973-e24b6667702a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:56.537140 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaff884-e447-46d6-b973-e24b6667702a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:56.555966 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4eaff884-e447-46d6-b973-e24b6667702a None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:56.557226 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4eaff884-e447-46d6-b973-e24b6667702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:56.624134 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1360/2726] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:56.634251 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:56.636188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:56.696476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c57de2-4e12-4810-a529-5d1e8f57ebf1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:56.700526 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42694-ab7b-44ed-88e7-9f649e0a8bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:56.701231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42694-ab7b-44ed-88e7-9f649e0a8bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:56.701516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42694-ab7b-44ed-88e7-9f649e0a8bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:56.701798 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42694-ab7b-44ed-88e7-9f649e0a8bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:56.711938 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42694-ab7b-44ed-88e7-9f649e0a8bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:56.713480 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42694-ab7b-44ed-88e7-9f649e0a8bc8 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:56.723934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1367/2727] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:57.007733 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaff884-e447-46d6-b973-e24b6667702a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:57.009365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4eaff884-e447-46d6-b973-e24b6667702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:57.022566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaff884-e447-46d6-b973-e24b6667702a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:57.029002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2238fc-63a5-4d7b-acfa-120e237d09ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:57.029874 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2238fc-63a5-4d7b-acfa-120e237d09ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.030180 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2238fc-63a5-4d7b-acfa-120e237d09ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.030449 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2238fc-63a5-4d7b-acfa-120e237d09ca admin admin] PATH_INFO: `/v3/projects/05e8a95f81394dfe846c39aabbad5db3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.031823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2238fc-63a5-4d7b-acfa-120e237d09ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e8a95f81394dfe846c39aabbad5db3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:57.033895 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2238fc-63a5-4d7b-acfa-120e237d09ca admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:57.082979 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8d2238fc-63a5-4d7b-acfa-120e237d09ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e8a95f81394dfe846c39aabbad5db3', 'request_id': 'req-8d2238fc-63a5-4d7b-acfa-120e237d09ca'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:57.093019 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8d2238fc-63a5-4d7b-acfa-120e237d09ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e8a95f81394dfe846c39aabbad5db3', 'request_id': 'req-8d2238fc-63a5-4d7b-acfa-120e237d09ca'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:57.098624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8d2238fc-63a5-4d7b-acfa-120e237d09ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e8a95f81394dfe846c39aabbad5db3', 'request_id': 'req-8d2238fc-63a5-4d7b-acfa-120e237d09ca'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:57.106332 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:57.110502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8d2238fc-63a5-4d7b-acfa-120e237d09ca admin admin] The token cache is being invalidate because project 05e8a95f81394dfe846c39aabbad5db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:57.111187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8d2238fc-63a5-4d7b-acfa-120e237d09ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:57.112010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8d2238fc-63a5-4d7b-acfa-120e237d09ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:57.113790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1361/2728] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:57 2022] DELETE /identity/v3/projects/05e8a95f81394dfe846c39aabbad5db3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:57.119174 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b908c-0688-4d87-97ac-6cdc0951e7a8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.119545 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b908c-0688-4d87-97ac-6cdc0951e7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.119831 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b908c-0688-4d87-97ac-6cdc0951e7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.139004 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-420b908c-0688-4d87-97ac-6cdc0951e7a8 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:57.140237 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-420b908c-0688-4d87-97ac-6cdc0951e7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:57.181253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:57.213800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1368/2729] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:57.222997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89f0e5-d3d2-43c1-9f93-0d861661125f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.223261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89f0e5-d3d2-43c1-9f93-0d861661125f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.223627 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89f0e5-d3d2-43c1-9f93-0d861661125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.249474 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ea89f0e5-d3d2-43c1-9f93-0d861661125f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:57.250739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ea89f0e5-d3d2-43c1-9f93-0d861661125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:57.260960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1362/2730] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:57.267508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b908c-0688-4d87-97ac-6cdc0951e7a8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:57.281209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b908c-0688-4d87-97ac-6cdc0951e7a8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:57.286132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db659-d60b-498f-896e-14480301f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:57.286811 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db659-d60b-498f-896e-14480301f2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.287092 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db659-d60b-498f-896e-14480301f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.287366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db659-d60b-498f-896e-14480301f2fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.288103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171db659-d60b-498f-896e-14480301f2fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:33:57.288410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171db659-d60b-498f-896e-14480301f2fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:57.290067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171db659-d60b-498f-896e-14480301f2fa admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:57.303777 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1369/2731] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:33:57.308459 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89f0e5-d3d2-43c1-9f93-0d861661125f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:57.320549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89f0e5-d3d2-43c1-9f93-0d861661125f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:57.326610 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327632fe-377a-4171-ac58-df85ab8a4868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:57.327274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327632fe-377a-4171-ac58-df85ab8a4868 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.327552 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327632fe-377a-4171-ac58-df85ab8a4868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.327831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327632fe-377a-4171-ac58-df85ab8a4868 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.328549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327632fe-377a-4171-ac58-df85ab8a4868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:57.330484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327632fe-377a-4171-ac58-df85ab8a4868 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:57.359219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1363/2732] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:57 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:57.364207 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db659-d60b-498f-896e-14480301f2fa admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:57.379672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db659-d60b-498f-896e-14480301f2fa admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:57.440033 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22079d7d-b9a9-4f71-a0b5-7e58c37c543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:57.440744 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22079d7d-b9a9-4f71-a0b5-7e58c37c543f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.441025 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22079d7d-b9a9-4f71-a0b5-7e58c37c543f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.441298 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22079d7d-b9a9-4f71-a0b5-7e58c37c543f admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.441986 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22079d7d-b9a9-4f71-a0b5-7e58c37c543f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:57.443992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22079d7d-b9a9-4f71-a0b5-7e58c37c543f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:57.465868 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1370/2733] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:57 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:57.470307 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327632fe-377a-4171-ac58-df85ab8a4868 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:57.481018 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327632fe-377a-4171-ac58-df85ab8a4868 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:57.486720 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed6be-5312-43a2-81c9-f214e957d005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:57.487385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed6be-5312-43a2-81c9-f214e957d005 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.487665 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed6be-5312-43a2-81c9-f214e957d005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.487931 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed6be-5312-43a2-81c9-f214e957d005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.488702 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ed6be-5312-43a2-81c9-f214e957d005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:57.490316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ed6be-5312-43a2-81c9-f214e957d005 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:57.501132 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1364/2734] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:57.505583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22079d7d-b9a9-4f71-a0b5-7e58c37c543f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:57.516830 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22079d7d-b9a9-4f71-a0b5-7e58c37c543f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:57.522723 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45245ffa-05c7-44bf-a7a2-dffb6878920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:57.523425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45245ffa-05c7-44bf-a7a2-dffb6878920e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.523703 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45245ffa-05c7-44bf-a7a2-dffb6878920e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.523974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45245ffa-05c7-44bf-a7a2-dffb6878920e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.524770 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45245ffa-05c7-44bf-a7a2-dffb6878920e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:57.526376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45245ffa-05c7-44bf-a7a2-dffb6878920e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:57.537696 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1371/2735] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:57.542778 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed6be-5312-43a2-81c9-f214e957d005 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:57.554970 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed6be-5312-43a2-81c9-f214e957d005 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:57.561121 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09184b8-3cd5-4faf-9d49-d4a93b682e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:57.562041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09184b8-3cd5-4faf-9d49-d4a93b682e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.562318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09184b8-3cd5-4faf-9d49-d4a93b682e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.562594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09184b8-3cd5-4faf-9d49-d4a93b682e70 admin admin] PATH_INFO: `/v3/projects/acb53a3a9c0346dfb3674449e1db0597/users/75e9d61df17e454b909c8d62960c7354/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.580127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09184b8-3cd5-4faf-9d49-d4a93b682e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb53a3a9c0346dfb3674449e1db0597, user_id=75e9d61df17e454b909c8d62960c7354, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:57.582853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09184b8-3cd5-4faf-9d49-d4a93b682e70 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:57.597634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1365/2736] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:57 2022] PUT /identity/v3/projects/acb53a3a9c0346dfb3674449e1db0597/users/75e9d61df17e454b909c8d62960c7354/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:57.608526 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4aee6-8468-4cb3-b5ff-1f357d0cd10a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.608848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4aee6-8468-4cb3-b5ff-1f357d0cd10a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.609138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4aee6-8468-4cb3-b5ff-1f357d0cd10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.639208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0ec4aee6-8468-4cb3-b5ff-1f357d0cd10a None None] MFA Rules not processed for user `75e9d61df17e454b909c8d62960c7354`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:57.640518 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0ec4aee6-8468-4cb3-b5ff-1f357d0cd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:57.720726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1372/2737] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:57.727859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09184b8-3cd5-4faf-9d49-d4a93b682e70 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:57.803603 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09184b8-3cd5-4faf-9d49-d4a93b682e70 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:57.808814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef92612-845a-4dbf-8fdb-b8217673d3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:57.809481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92612-845a-4dbf-8fdb-b8217673d3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.809763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92612-845a-4dbf-8fdb-b8217673d3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.810033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92612-845a-4dbf-8fdb-b8217673d3c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.810740 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef92612-845a-4dbf-8fdb-b8217673d3c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:57.812777 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef92612-845a-4dbf-8fdb-b8217673d3c8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:57.843786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1366/2738] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:57 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:57.848472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4aee6-8468-4cb3-b5ff-1f357d0cd10a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:57.860337 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4aee6-8468-4cb3-b5ff-1f357d0cd10a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:57.897565 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:57.923195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f575e3-61e9-498d-be1e-0162a783be81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:57.923914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f575e3-61e9-498d-be1e-0162a783be81 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.924212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f575e3-61e9-498d-be1e-0162a783be81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.924475 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f575e3-61e9-498d-be1e-0162a783be81 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.925355 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f575e3-61e9-498d-be1e-0162a783be81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:57.927315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f575e3-61e9-498d-be1e-0162a783be81 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:57.954890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1373/2739] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:57 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:57.961248 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef92612-845a-4dbf-8fdb-b8217673d3c8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:57.976715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef92612-845a-4dbf-8fdb-b8217673d3c8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:57.982917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ba6fa-170f-4d22-b58c-00c5a89eec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:57.983600 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ba6fa-170f-4d22-b58c-00c5a89eec7d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:57.983889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ba6fa-170f-4d22-b58c-00c5a89eec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:57.984190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ba6fa-170f-4d22-b58c-00c5a89eec7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:57.984968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ba6fa-170f-4d22-b58c-00c5a89eec7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:57.986613 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ba6fa-170f-4d22-b58c-00c5a89eec7d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:57.997798 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1367/2740] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:58.004336 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f575e3-61e9-498d-be1e-0162a783be81 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:58.018549 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f575e3-61e9-498d-be1e-0162a783be81 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:58.023533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bae06-c77e-42ca-83a3-767f07877f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:58.024195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bae06-c77e-42ca-83a3-767f07877f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:58.024470 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bae06-c77e-42ca-83a3-767f07877f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:58.024772 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bae06-c77e-42ca-83a3-767f07877f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:58.025494 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bae06-c77e-42ca-83a3-767f07877f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:58.027087 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bae06-c77e-42ca-83a3-767f07877f6e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:58.037551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1374/2741] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:58.042311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ba6fa-170f-4d22-b58c-00c5a89eec7d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:58.058312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ba6fa-170f-4d22-b58c-00c5a89eec7d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:58.065594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee2e59-4acc-4bef-930f-1aa7a039f598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:58.066487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee2e59-4acc-4bef-930f-1aa7a039f598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:58.066766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee2e59-4acc-4bef-930f-1aa7a039f598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:58.067050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee2e59-4acc-4bef-930f-1aa7a039f598 admin admin] PATH_INFO: `/v3/projects/150ba6b2f74d40d78a5ab31e1a9b124b/users/c143e729ca7343e3a448fcac3a725b93/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:58.083139 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee2e59-4acc-4bef-930f-1aa7a039f598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=150ba6b2f74d40d78a5ab31e1a9b124b, user_id=c143e729ca7343e3a448fcac3a725b93, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:58.085864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee2e59-4acc-4bef-930f-1aa7a039f598 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:58.106163 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1368/2742] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:58 2022] PUT /identity/v3/projects/150ba6b2f74d40d78a5ab31e1a9b124b/users/c143e729ca7343e3a448fcac3a725b93/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:58.177369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684605b5-d496-42bb-bfef-41bee2cba727 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:58.177660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684605b5-d496-42bb-bfef-41bee2cba727 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:58.177956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684605b5-d496-42bb-bfef-41bee2cba727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:58.214349 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-684605b5-d496-42bb-bfef-41bee2cba727 None None] MFA Rules not processed for user `c143e729ca7343e3a448fcac3a725b93`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:58.215593 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-684605b5-d496-42bb-bfef-41bee2cba727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:58.286847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1375/2743] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:58.291595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee2e59-4acc-4bef-930f-1aa7a039f598 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:58.341593 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:58.357919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee2e59-4acc-4bef-930f-1aa7a039f598 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:58.363103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821497f8-d62e-466e-a578-3a08ae800c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:58.363759 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821497f8-d62e-466e-a578-3a08ae800c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:58.364049 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821497f8-d62e-466e-a578-3a08ae800c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:58.364319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821497f8-d62e-466e-a578-3a08ae800c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:58.365040 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821497f8-d62e-466e-a578-3a08ae800c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:58.366958 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821497f8-d62e-466e-a578-3a08ae800c8b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:58.395484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1369/2744] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:58 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:58.399848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684605b5-d496-42bb-bfef-41bee2cba727 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:58.411495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684605b5-d496-42bb-bfef-41bee2cba727 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:58.475079 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442438c-b1cf-4e5c-b24a-d0f684b7a280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:58.475784 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442438c-b1cf-4e5c-b24a-d0f684b7a280 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:58.476134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442438c-b1cf-4e5c-b24a-d0f684b7a280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:58.476403 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442438c-b1cf-4e5c-b24a-d0f684b7a280 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:58.477143 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442438c-b1cf-4e5c-b24a-d0f684b7a280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:58.479098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442438c-b1cf-4e5c-b24a-d0f684b7a280 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:58.506464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1376/2745] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:58 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:58.508378 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821497f8-d62e-466e-a578-3a08ae800c8b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:58.519821 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821497f8-d62e-466e-a578-3a08ae800c8b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:58.525572 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8183-a340-4ce8-88d0-8396c2b0a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:58.526259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8183-a340-4ce8-88d0-8396c2b0a59e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:58.526535 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8183-a340-4ce8-88d0-8396c2b0a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:58.526804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8183-a340-4ce8-88d0-8396c2b0a59e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:58.527564 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea8183-a340-4ce8-88d0-8396c2b0a59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:58.529211 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea8183-a340-4ce8-88d0-8396c2b0a59e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:58.544085 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1370/2746] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:58.548695 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442438c-b1cf-4e5c-b24a-d0f684b7a280 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:58.562281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442438c-b1cf-4e5c-b24a-d0f684b7a280 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:58.568711 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83ea38-e879-45ab-a221-0ba76cd061bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:58.569628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83ea38-e879-45ab-a221-0ba76cd061bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:58.569916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83ea38-e879-45ab-a221-0ba76cd061bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:58.570190 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83ea38-e879-45ab-a221-0ba76cd061bb admin admin] PATH_INFO: `/v3/projects/14df60c480c942b8ada76f33ee8c04d3/users/898e972ab32e4c27b1568e52083eb564/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:58.586506 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83ea38-e879-45ab-a221-0ba76cd061bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=14df60c480c942b8ada76f33ee8c04d3, user_id=898e972ab32e4c27b1568e52083eb564, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:58.589204 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83ea38-e879-45ab-a221-0ba76cd061bb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:58.603654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1377/2747] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:58 2022] PUT /identity/v3/projects/14df60c480c942b8ada76f33ee8c04d3/users/898e972ab32e4c27b1568e52083eb564/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:58.607842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8183-a340-4ce8-88d0-8396c2b0a59e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:58.618571 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8183-a340-4ce8-88d0-8396c2b0a59e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:58.682728 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b33f3-2109-4080-880d-c29eeaef8e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:58.683358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b33f3-2109-4080-880d-c29eeaef8e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:58.683635 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b33f3-2109-4080-880d-c29eeaef8e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:58.683916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b33f3-2109-4080-880d-c29eeaef8e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:58.684673 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b33f3-2109-4080-880d-c29eeaef8e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:58.686349 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b33f3-2109-4080-880d-c29eeaef8e5f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:58.696653 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1371/2748] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:58.701105 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83ea38-e879-45ab-a221-0ba76cd061bb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:58.712715 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83ea38-e879-45ab-a221-0ba76cd061bb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:58.719057 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e1abd-7974-4588-b728-e2692eb2cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:58.719981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e1abd-7974-4588-b728-e2692eb2cbe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:58.720259 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e1abd-7974-4588-b728-e2692eb2cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:58.720656 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e1abd-7974-4588-b728-e2692eb2cbe5 admin admin] PATH_INFO: `/v3/projects/14df60c480c942b8ada76f33ee8c04d3/users/898e972ab32e4c27b1568e52083eb564/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:58.722962 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e1abd-7974-4588-b728-e2692eb2cbe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14df60c480c942b8ada76f33ee8c04d3, user_id=898e972ab32e4c27b1568e52083eb564, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:58.725672 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e1abd-7974-4588-b728-e2692eb2cbe5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:58.732162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:58.738891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1378/2749] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:58 2022] PUT /identity/v3/projects/14df60c480c942b8ada76f33ee8c04d3/users/898e972ab32e4c27b1568e52083eb564/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:58.749815 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36ab3e-95ae-4138-993a-da1a8f7b1efa None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:58.750059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36ab3e-95ae-4138-993a-da1a8f7b1efa None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:58.750371 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36ab3e-95ae-4138-993a-da1a8f7b1efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:58.780104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1b36ab3e-95ae-4138-993a-da1a8f7b1efa None None] MFA Rules not processed for user `898e972ab32e4c27b1568e52083eb564`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:58.781382 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1b36ab3e-95ae-4138-993a-da1a8f7b1efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:58.854372 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1372/2750] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:33:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:58.866144 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e1abd-7974-4588-b728-e2692eb2cbe5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:58.867854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ec7e1abd-7974-4588-b728-e2692eb2cbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:58.941224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e1abd-7974-4588-b728-e2692eb2cbe5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:58.945327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b012b-aef6-4861-8db2-8fb6ef27adca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:58.946058 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b012b-aef6-4861-8db2-8fb6ef27adca service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:58.946377 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b012b-aef6-4861-8db2-8fb6ef27adca service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:58.946730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b012b-aef6-4861-8db2-8fb6ef27adca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:59.012740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b012b-aef6-4861-8db2-8fb6ef27adca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:59.014230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b012b-aef6-4861-8db2-8fb6ef27adca service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:59.024096 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1379/2751] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:00.553496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36ab3e-95ae-4138-993a-da1a8f7b1efa None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:00.554963 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1b36ab3e-95ae-4138-993a-da1a8f7b1efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:00.567658 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36ab3e-95ae-4138-993a-da1a8f7b1efa None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:00.571654 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df67ff1-2b6c-476e-889b-25aa04cc68d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:00.572311 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df67ff1-2b6c-476e-889b-25aa04cc68d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:00.572625 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df67ff1-2b6c-476e-889b-25aa04cc68d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:00.572897 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df67ff1-2b6c-476e-889b-25aa04cc68d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:00.615404 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:00.635341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df67ff1-2b6c-476e-889b-25aa04cc68d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:00.636872 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df67ff1-2b6c-476e-889b-25aa04cc68d8 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:00.647585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1373/2752] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:01.223735 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b012b-aef6-4861-8db2-8fb6ef27adca service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:01.233061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b012b-aef6-4861-8db2-8fb6ef27adca service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:01.237206 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd8890-5ce7-47f4-8547-76f9e12d795a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:01.237891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd8890-5ce7-47f4-8547-76f9e12d795a service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:01.238175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd8890-5ce7-47f4-8547-76f9e12d795a service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:01.238447 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd8890-5ce7-47f4-8547-76f9e12d795a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:01.247662 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd8890-5ce7-47f4-8547-76f9e12d795a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:01.249146 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd8890-5ce7-47f4-8547-76f9e12d795a service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:01.260197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1380/2753] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:04.274523 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df67ff1-2b6c-476e-889b-25aa04cc68d8 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:04.277845 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7df67ff1-2b6c-476e-889b-25aa04cc68d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:04.393365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df67ff1-2b6c-476e-889b-25aa04cc68d8 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:04.400417 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7934d16-e2fe-49a2-810b-05fc235f5c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:04.401096 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7934d16-e2fe-49a2-810b-05fc235f5c23 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:04.401385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7934d16-e2fe-49a2-810b-05fc235f5c23 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:04.402868 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7934d16-e2fe-49a2-810b-05fc235f5c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:04.406842 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a7934d16-e2fe-49a2-810b-05fc235f5c23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:04.428485 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7934d16-e2fe-49a2-810b-05fc235f5c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:04.430538 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7934d16-e2fe-49a2-810b-05fc235f5c23 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:04.443825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1374/2754] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:05.165426 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd8890-5ce7-47f4-8547-76f9e12d795a service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:05.241503 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd8890-5ce7-47f4-8547-76f9e12d795a service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:05.246198 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:05.247130 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:05.247383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:05.247657 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] PATH_INFO: `/v3/users/75e9d61df17e454b909c8d62960c7354` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:05.248914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e9d61df17e454b909c8d62960c7354)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:05.250857 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:05.307366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:05.317997 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e9d61df17e454b909c8d62960c7354'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:05.325424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e9d61df17e454b909c8d62960c7354'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:05.333956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e9d61df17e454b909c8d62960c7354'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:05.350171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e9d61df17e454b909c8d62960c7354'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:05.351141 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e9d61df17e454b909c8d62960c7354'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:05.359737 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1381/2755] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:34:05 2022] DELETE /identity/v3/users/75e9d61df17e454b909c8d62960c7354 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:05.364568 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1fd5f-df85-41a8-94b3-fd6e5b66fab1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:05.365014 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1fd5f-df85-41a8-94b3-fd6e5b66fab1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:05.365127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1fd5f-df85-41a8-94b3-fd6e5b66fab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:05.382687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e6d1fd5f-df85-41a8-94b3-fd6e5b66fab1 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:05.383897 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e6d1fd5f-df85-41a8-94b3-fd6e5b66fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:05.452028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1375/2756] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:05.463375 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:05.465097 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:05.535341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad86c5-5958-45ca-976c-320916cf275e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:05.540035 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da782d-099f-46a8-be93-6f0c89b32d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:05.540727 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da782d-099f-46a8-be93-6f0c89b32d60 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:05.540995 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da782d-099f-46a8-be93-6f0c89b32d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:05.541269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da782d-099f-46a8-be93-6f0c89b32d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:05.551398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da782d-099f-46a8-be93-6f0c89b32d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:05.552866 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da782d-099f-46a8-be93-6f0c89b32d60 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:05.562732 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1382/2757] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:05.617980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1fd5f-df85-41a8-94b3-fd6e5b66fab1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:05.619596 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e6d1fd5f-df85-41a8-94b3-fd6e5b66fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:05.705144 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:05.712407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1fd5f-df85-41a8-94b3-fd6e5b66fab1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:05.718834 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0f35d-2e74-41bb-bd8a-f3ca18e56534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:05.719960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0f35d-2e74-41bb-bd8a-f3ca18e56534 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:05.719960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0f35d-2e74-41bb-bd8a-f3ca18e56534 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:05.720237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0f35d-2e74-41bb-bd8a-f3ca18e56534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:05.722778 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b5b0f35d-2e74-41bb-bd8a-f3ca18e56534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:05.807551 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0f35d-2e74-41bb-bd8a-f3ca18e56534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:05.809295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0f35d-2e74-41bb-bd8a-f3ca18e56534 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:05.819423 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1376/2758] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:05.977644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da782d-099f-46a8-be93-6f0c89b32d60 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:05.979292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-05da782d-099f-46a8-be93-6f0c89b32d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:05.994505 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da782d-099f-46a8-be93-6f0c89b32d60 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:06.000422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:06.001377 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:06.001858 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:06.002133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] PATH_INFO: `/v3/projects/acb53a3a9c0346dfb3674449e1db0597` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:06.003484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb53a3a9c0346dfb3674449e1db0597)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:06.005762 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:06.069988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb53a3a9c0346dfb3674449e1db0597', 'request_id': 'req-704a9b1e-e2c7-4e9f-b269-8747691130df'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.085494 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb53a3a9c0346dfb3674449e1db0597', 'request_id': 'req-704a9b1e-e2c7-4e9f-b269-8747691130df'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.093891 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb53a3a9c0346dfb3674449e1db0597', 'request_id': 'req-704a9b1e-e2c7-4e9f-b269-8747691130df'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.110718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] The token cache is being invalidate because project acb53a3a9c0346dfb3674449e1db0597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:34:06.111055 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.112080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.118398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1383/2759] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:34:05 2022] DELETE /identity/v3/projects/acb53a3a9c0346dfb3674449e1db0597 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:06.119747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0f35d-2e74-41bb-bd8a-f3ca18e56534 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:06.134929 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0f35d-2e74-41bb-bd8a-f3ca18e56534 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:06.241864 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:06.242825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:06.243250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:06.243692 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] PATH_INFO: `/v3/users/c143e729ca7343e3a448fcac3a725b93` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:06.245275 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c143e729ca7343e3a448fcac3a725b93)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:06.247334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:06.310978 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c143e729ca7343e3a448fcac3a725b93'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.322181 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c143e729ca7343e3a448fcac3a725b93'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.345488 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c143e729ca7343e3a448fcac3a725b93'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.346833 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c143e729ca7343e3a448fcac3a725b93'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.347796 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c143e729ca7343e3a448fcac3a725b93'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.370806 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1377/2760] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:34:06 2022] DELETE /identity/v3/users/c143e729ca7343e3a448fcac3a725b93 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:06.689348 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:06.691984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:06.710921 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a9b1e-e2c7-4e9f-b269-8747691130df admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:06.765361 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:06.791957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:06.793011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:06.793363 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:06.793726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] PATH_INFO: `/v3/projects/150ba6b2f74d40d78a5ab31e1a9b124b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:06.795039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=150ba6b2f74d40d78a5ab31e1a9b124b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:06.797067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:06.861425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150ba6b2f74d40d78a5ab31e1a9b124b', 'request_id': 'req-bf71b9e6-6b4a-45df-bff0-e9ca38856140'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.868131 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150ba6b2f74d40d78a5ab31e1a9b124b', 'request_id': 'req-bf71b9e6-6b4a-45df-bff0-e9ca38856140'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.874706 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150ba6b2f74d40d78a5ab31e1a9b124b', 'request_id': 'req-bf71b9e6-6b4a-45df-bff0-e9ca38856140'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.888888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] The token cache is being invalidate because project 150ba6b2f74d40d78a5ab31e1a9b124b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:34:06.889173 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.889814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:06.891399 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1384/2761] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:34:06 2022] DELETE /identity/v3/projects/150ba6b2f74d40d78a5ab31e1a9b124b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:06.896264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:06.897824 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:06.921913 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f4386-dd86-4bdc-a4a4-a22fe0d3847a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:06.941833 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:06.985904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8520122-6291-480c-b8a4-ec15bd164246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:06.986804 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8520122-6291-480c-b8a4-ec15bd164246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:06.987084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8520122-6291-480c-b8a4-ec15bd164246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:06.987363 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8520122-6291-480c-b8a4-ec15bd164246 admin admin] PATH_INFO: `/v3/users/898e972ab32e4c27b1568e52083eb564` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:06.988681 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8520122-6291-480c-b8a4-ec15bd164246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=898e972ab32e4c27b1568e52083eb564)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:06.990664 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8520122-6291-480c-b8a4-ec15bd164246 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:07.041436 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a8520122-6291-480c-b8a4-ec15bd164246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '898e972ab32e4c27b1568e52083eb564'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:07.048738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a8520122-6291-480c-b8a4-ec15bd164246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '898e972ab32e4c27b1568e52083eb564'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:07.060930 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a8520122-6291-480c-b8a4-ec15bd164246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '898e972ab32e4c27b1568e52083eb564'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:07.061690 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a8520122-6291-480c-b8a4-ec15bd164246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '898e972ab32e4c27b1568e52083eb564'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:07.062308 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a8520122-6291-480c-b8a4-ec15bd164246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '898e972ab32e4c27b1568e52083eb564'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:07.081516 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1378/2762] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:34:06 2022] DELETE /identity/v3/users/898e972ab32e4c27b1568e52083eb564 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:07.435743 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:07.437834 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:07.461118 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71b9e6-6b4a-45df-bff0-e9ca38856140 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:07.553448 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047b922-5bd4-4180-8408-ff59447e68ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:07.554512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047b922-5bd4-4180-8408-ff59447e68ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:07.554848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047b922-5bd4-4180-8408-ff59447e68ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:07.555128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047b922-5bd4-4180-8408-ff59447e68ec admin admin] PATH_INFO: `/v3/projects/14df60c480c942b8ada76f33ee8c04d3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:07.556467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047b922-5bd4-4180-8408-ff59447e68ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=14df60c480c942b8ada76f33ee8c04d3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:07.558506 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047b922-5bd4-4180-8408-ff59447e68ec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:07.612485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4047b922-5bd4-4180-8408-ff59447e68ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14df60c480c942b8ada76f33ee8c04d3', 'request_id': 'req-4047b922-5bd4-4180-8408-ff59447e68ec'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:07.619508 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4047b922-5bd4-4180-8408-ff59447e68ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14df60c480c942b8ada76f33ee8c04d3', 'request_id': 'req-4047b922-5bd4-4180-8408-ff59447e68ec'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:07.625449 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4047b922-5bd4-4180-8408-ff59447e68ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14df60c480c942b8ada76f33ee8c04d3', 'request_id': 'req-4047b922-5bd4-4180-8408-ff59447e68ec'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:07.641007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4047b922-5bd4-4180-8408-ff59447e68ec admin admin] The token cache is being invalidate because project 14df60c480c942b8ada76f33ee8c04d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:34:07.641294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4047b922-5bd4-4180-8408-ff59447e68ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:07.642036 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4047b922-5bd4-4180-8408-ff59447e68ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:07.643724 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1385/2763] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:34:07 2022] DELETE /identity/v3/projects/14df60c480c942b8ada76f33ee8c04d3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:07.649027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfbfd2-79d5-44a0-95be-dc3a40460d31 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:07.649585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfbfd2-79d5-44a0-95be-dc3a40460d31 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:07.649585 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfbfd2-79d5-44a0-95be-dc3a40460d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:07.668957 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-26dfbfd2-79d5-44a0-95be-dc3a40460d31 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:07.670276 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-26dfbfd2-79d5-44a0-95be-dc3a40460d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:07.760411 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1379/2764] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:07.769572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a013f1-018e-40f2-b63e-3b880d493c55 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:07.770132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a013f1-018e-40f2-b63e-3b880d493c55 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:07.770225 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a013f1-018e-40f2-b63e-3b880d493c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:07.778485 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:07.795280 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b1a013f1-018e-40f2-b63e-3b880d493c55 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:07.796740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b1a013f1-018e-40f2-b63e-3b880d493c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:07.808641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1386/2765] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:07.812917 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfbfd2-79d5-44a0-95be-dc3a40460d31 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:07.823227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfbfd2-79d5-44a0-95be-dc3a40460d31 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:07.829786 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74e723-bc32-4995-9e1a-c0396b85ebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:07.830514 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74e723-bc32-4995-9e1a-c0396b85ebcb admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:07.830801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74e723-bc32-4995-9e1a-c0396b85ebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:07.831079 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74e723-bc32-4995-9e1a-c0396b85ebcb admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:07.831813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74e723-bc32-4995-9e1a-c0396b85ebcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:34:07.832142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74e723-bc32-4995-9e1a-c0396b85ebcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:07.834119 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74e723-bc32-4995-9e1a-c0396b85ebcb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:07.853451 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1380/2766] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:34:07.857884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a013f1-018e-40f2-b63e-3b880d493c55 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:07.869847 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a013f1-018e-40f2-b63e-3b880d493c55 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:07.876700 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba6d0b-d241-46b1-9a5f-80bab773c99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:07.877472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba6d0b-d241-46b1-9a5f-80bab773c99d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:07.877746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba6d0b-d241-46b1-9a5f-80bab773c99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:07.878049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba6d0b-d241-46b1-9a5f-80bab773c99d admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:07.878766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba6d0b-d241-46b1-9a5f-80bab773c99d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:07.880746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba6d0b-d241-46b1-9a5f-80bab773c99d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:07.912954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1387/2767] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:34:07 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:34:07.917272 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74e723-bc32-4995-9e1a-c0396b85ebcb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:07.929217 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74e723-bc32-4995-9e1a-c0396b85ebcb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:07.964278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:08.002726 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7885b1-8be1-404f-ac3c-66fd8f2f531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:08.003557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7885b1-8be1-404f-ac3c-66fd8f2f531d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:08.003927 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7885b1-8be1-404f-ac3c-66fd8f2f531d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:08.004258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7885b1-8be1-404f-ac3c-66fd8f2f531d admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:08.005095 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7885b1-8be1-404f-ac3c-66fd8f2f531d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:08.007177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7885b1-8be1-404f-ac3c-66fd8f2f531d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:08.035025 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1381/2768] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:34:07 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:34:08.036521 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba6d0b-d241-46b1-9a5f-80bab773c99d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:08.048011 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba6d0b-d241-46b1-9a5f-80bab773c99d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:08.055144 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee7243-887c-4adc-b838-7d2ceb5eb024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:08.056212 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee7243-887c-4adc-b838-7d2ceb5eb024 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:08.056878 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee7243-887c-4adc-b838-7d2ceb5eb024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:08.057257 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee7243-887c-4adc-b838-7d2ceb5eb024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:08.058514 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee7243-887c-4adc-b838-7d2ceb5eb024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:08.059813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee7243-887c-4adc-b838-7d2ceb5eb024 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:08.072209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1388/2769] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:34:08.076508 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7885b1-8be1-404f-ac3c-66fd8f2f531d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:08.087968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7885b1-8be1-404f-ac3c-66fd8f2f531d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:08.093857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eaa9ff-2313-4352-a537-55d87ca2d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:08.094716 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaa9ff-2313-4352-a537-55d87ca2d425 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:08.094981 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaa9ff-2313-4352-a537-55d87ca2d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:08.095274 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaa9ff-2313-4352-a537-55d87ca2d425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:08.096228 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eaa9ff-2313-4352-a537-55d87ca2d425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:08.098090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eaa9ff-2313-4352-a537-55d87ca2d425 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:08.110081 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1382/2770] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:34:08.114061 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee7243-887c-4adc-b838-7d2ceb5eb024 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:08.126944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee7243-887c-4adc-b838-7d2ceb5eb024 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:08.133037 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb2ece-c6af-4867-96fe-c50d13613e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:08.134042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb2ece-c6af-4867-96fe-c50d13613e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:08.134242 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb2ece-c6af-4867-96fe-c50d13613e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:08.134913 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb2ece-c6af-4867-96fe-c50d13613e5d admin admin] PATH_INFO: `/v3/projects/b4320b0135324071b58119a318ffe157/users/d63d7a5f427844d1a26dc58c3e217c2f/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:08.154091 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb2ece-c6af-4867-96fe-c50d13613e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4320b0135324071b58119a318ffe157, user_id=d63d7a5f427844d1a26dc58c3e217c2f, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:08.157894 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb2ece-c6af-4867-96fe-c50d13613e5d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:08.173930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1389/2771] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:34:08 2022] PUT /identity/v3/projects/b4320b0135324071b58119a318ffe157/users/d63d7a5f427844d1a26dc58c3e217c2f/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:08.184724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5feeb-b990-4869-81d2-2c0f1b689c07 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:08.185015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5feeb-b990-4869-81d2-2c0f1b689c07 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:08.185290 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5feeb-b990-4869-81d2-2c0f1b689c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:08.217653 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0ba5feeb-b990-4869-81d2-2c0f1b689c07 None None] MFA Rules not processed for user `d63d7a5f427844d1a26dc58c3e217c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:08.219355 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0ba5feeb-b990-4869-81d2-2c0f1b689c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:08.307377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1383/2772] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:34:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:34:08.328406 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb2ece-c6af-4867-96fe-c50d13613e5d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:08.330680 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-98eb2ece-c6af-4867-96fe-c50d13613e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:08.418358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb2ece-c6af-4867-96fe-c50d13613e5d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:08.422369 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223353d8-2ee7-4f42-93ea-978dca66a28d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:08.424554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223353d8-2ee7-4f42-93ea-978dca66a28d service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:08.424554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223353d8-2ee7-4f42-93ea-978dca66a28d service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:08.425949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223353d8-2ee7-4f42-93ea-978dca66a28d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:08.436645 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223353d8-2ee7-4f42-93ea-978dca66a28d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:08.439311 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223353d8-2ee7-4f42-93ea-978dca66a28d service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:08.454961 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1390/2773] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:09.859626 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5feeb-b990-4869-81d2-2c0f1b689c07 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:09.864414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0ba5feeb-b990-4869-81d2-2c0f1b689c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:09.948574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5feeb-b990-4869-81d2-2c0f1b689c07 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:09.954005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbba9db-f16f-485c-9d49-738778a84161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:09.955277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbba9db-f16f-485c-9d49-738778a84161 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:09.955732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbba9db-f16f-485c-9d49-738778a84161 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:09.956005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbba9db-f16f-485c-9d49-738778a84161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:09.958174 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ebbba9db-f16f-485c-9d49-738778a84161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:10.032441 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:10.050676 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbba9db-f16f-485c-9d49-738778a84161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:10.052173 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbba9db-f16f-485c-9d49-738778a84161 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:10.063493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1384/2774] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:34:14.250423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223353d8-2ee7-4f42-93ea-978dca66a28d service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:14.251974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-223353d8-2ee7-4f42-93ea-978dca66a28d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:14.270293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223353d8-2ee7-4f42-93ea-978dca66a28d service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:14.274543 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa16874-da22-41e2-b076-0c7e92172129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:14.275320 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa16874-da22-41e2-b076-0c7e92172129 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:14.275667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa16874-da22-41e2-b076-0c7e92172129 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:14.276156 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa16874-da22-41e2-b076-0c7e92172129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:14.278292 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-efa16874-da22-41e2-b076-0c7e92172129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:14.293039 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa16874-da22-41e2-b076-0c7e92172129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:14.294526 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa16874-da22-41e2-b076-0c7e92172129 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:14.326887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1391/2775] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:34:18.893607 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbba9db-f16f-485c-9d49-738778a84161 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:18.895744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ebbba9db-f16f-485c-9d49-738778a84161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:19.000049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa16874-da22-41e2-b076-0c7e92172129 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:19.003702 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-efa16874-da22-41e2-b076-0c7e92172129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:19.038219 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa16874-da22-41e2-b076-0c7e92172129 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:19.054206 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:19.055440 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:19.059936 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:19.060290 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] PATH_INFO: `/v3/users/2fc696f590374358aee6e70563219321` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:19.062687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc696f590374358aee6e70563219321)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:19.065513 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:19.076072 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbba9db-f16f-485c-9d49-738778a84161 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:19.086375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49852bc7-798d-4297-8134-317a054a1906 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd9ea435d7b48cb8b1b2a27d79cfa91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:19.087951 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49852bc7-798d-4297-8134-317a054a1906 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:19.088433 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49852bc7-798d-4297-8134-317a054a1906 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:19.088949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49852bc7-798d-4297-8134-317a054a1906 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:19.092960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-49852bc7-798d-4297-8134-317a054a1906 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:19.112099 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49852bc7-798d-4297-8134-317a054a1906 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:19.116326 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49852bc7-798d-4297-8134-317a054a1906 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:19.137323 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1385/2776] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:19.142015 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49852bc7-798d-4297-8134-317a054a1906 service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:19.144333 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-49852bc7-798d-4297-8134-317a054a1906 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:19.146128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc696f590374358aee6e70563219321'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.157988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc696f590374358aee6e70563219321'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.164023 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49852bc7-798d-4297-8134-317a054a1906 service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:19.169910 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc696f590374358aee6e70563219321'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.173452 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:19.174370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:19.174679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:19.174942 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] PATH_INFO: `/v3/users/4185cf0e97934e288a0d6eddc611d343` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:19.177186 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4185cf0e97934e288a0d6eddc611d343)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:19.179010 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:19.187163 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc696f590374358aee6e70563219321'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.187985 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc696f590374358aee6e70563219321'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.196547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1392/2777] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:34:18 2022] DELETE /identity/v3/users/2fc696f590374358aee6e70563219321 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:19.247516 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4185cf0e97934e288a0d6eddc611d343'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.257016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4185cf0e97934e288a0d6eddc611d343'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.276768 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4185cf0e97934e288a0d6eddc611d343'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.277896 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4185cf0e97934e288a0d6eddc611d343'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.278744 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4185cf0e97934e288a0d6eddc611d343'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.317844 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1386/2778] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:34:19 2022] DELETE /identity/v3/users/4185cf0e97934e288a0d6eddc611d343 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:19.501394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:19.503730 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:19.517822 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:19.557738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:19.559464 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:19.644599 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:19.647538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71910577-db2f-4474-b2d0-8f9bc9bbadc3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:19.669888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfc9d0-2158-4261-afa5-86b1b272e61e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:19.679703 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:19.680678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:19.680961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:19.681237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] PATH_INFO: `/v3/projects/9bc1f5ffbcbc411aad62b49e8391852c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:19.682738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc1f5ffbcbc411aad62b49e8391852c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:19.684857 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:19.722452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1b97d-04cb-4697-a646-b0524522a2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:19.723364 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1b97d-04cb-4697-a646-b0524522a2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:19.723649 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1b97d-04cb-4697-a646-b0524522a2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:19.723926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1b97d-04cb-4697-a646-b0524522a2b0 admin admin] PATH_INFO: `/v3/projects/2fb84544e44d44308b3165b73df65646` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:19.725344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1b97d-04cb-4697-a646-b0524522a2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb84544e44d44308b3165b73df65646)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:19.728608 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1b97d-04cb-4697-a646-b0524522a2b0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:19.752118 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc1f5ffbcbc411aad62b49e8391852c', 'request_id': 'req-99b9c2a6-8311-4478-a5b4-6249fd53a231'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.762482 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc1f5ffbcbc411aad62b49e8391852c', 'request_id': 'req-99b9c2a6-8311-4478-a5b4-6249fd53a231'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.770621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc1f5ffbcbc411aad62b49e8391852c', 'request_id': 'req-99b9c2a6-8311-4478-a5b4-6249fd53a231'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.788599 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] The token cache is being invalidate because project 9bc1f5ffbcbc411aad62b49e8391852c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:34:19.789027 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.790051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.793077 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1387/2779] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:34:19 2022] DELETE /identity/v3/projects/9bc1f5ffbcbc411aad62b49e8391852c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:34:19.796910 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cda1b97d-04cb-4697-a646-b0524522a2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb84544e44d44308b3165b73df65646', 'request_id': 'req-cda1b97d-04cb-4697-a646-b0524522a2b0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.798678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:19.800805 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:19.809633 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cda1b97d-04cb-4697-a646-b0524522a2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb84544e44d44308b3165b73df65646', 'request_id': 'req-cda1b97d-04cb-4697-a646-b0524522a2b0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.817423 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cda1b97d-04cb-4697-a646-b0524522a2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb84544e44d44308b3165b73df65646', 'request_id': 'req-cda1b97d-04cb-4697-a646-b0524522a2b0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.835953 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cda1b97d-04cb-4697-a646-b0524522a2b0 admin admin] The token cache is being invalidate because project 2fb84544e44d44308b3165b73df65646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:34:19.836410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cda1b97d-04cb-4697-a646-b0524522a2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.837166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-cda1b97d-04cb-4697-a646-b0524522a2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:19.838943 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1393/2780] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:34:19 2022] DELETE /identity/v3/projects/2fb84544e44d44308b3165b73df65646 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:19.844721 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a00a7e-f98b-4675-8710-051be03b0a86 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:19.845024 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a00a7e-f98b-4675-8710-051be03b0a86 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:19.845317 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a00a7e-f98b-4675-8710-051be03b0a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:19.871751 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-85a00a7e-f98b-4675-8710-051be03b0a86 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:19.873165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-85a00a7e-f98b-4675-8710-051be03b0a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:19.891762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9c2a6-8311-4478-a5b4-6249fd53a231 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:19.916281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:19.945074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1394/2781] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:34:19.945969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a00a7e-f98b-4675-8710-051be03b0a86 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:19.953153 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-85a00a7e-f98b-4675-8710-051be03b0a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:19.966027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a00a7e-f98b-4675-8710-051be03b0a86 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:19.971029 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c86c1a-e00c-4640-b6fd-1711af0f0eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:19.971922 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c86c1a-e00c-4640-b6fd-1711af0f0eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:19.972197 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c86c1a-e00c-4640-b6fd-1711af0f0eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:19.972655 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c86c1a-e00c-4640-b6fd-1711af0f0eb3 admin admin] PATH_INFO: `/v3/users/d63d7a5f427844d1a26dc58c3e217c2f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:19.973930 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c86c1a-e00c-4640-b6fd-1711af0f0eb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d63d7a5f427844d1a26dc58c3e217c2f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:19.975888 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c86c1a-e00c-4640-b6fd-1711af0f0eb3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:19.987846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206fdc6-d57c-4632-b199-31709fcddb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:19.989292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206fdc6-d57c-4632-b199-31709fcddb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:19.989292 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206fdc6-d57c-4632-b199-31709fcddb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:19.989569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206fdc6-d57c-4632-b199-31709fcddb46 admin admin] PATH_INFO: `/v3/users/00691bfafac8435fb73f590c3b6f07dc` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:19.990905 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206fdc6-d57c-4632-b199-31709fcddb46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00691bfafac8435fb73f590c3b6f07dc)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:19.993001 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206fdc6-d57c-4632-b199-31709fcddb46 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:20.038779 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-28c86c1a-e00c-4640-b6fd-1711af0f0eb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd63d7a5f427844d1a26dc58c3e217c2f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.043956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:20.047357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-28c86c1a-e00c-4640-b6fd-1711af0f0eb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd63d7a5f427844d1a26dc58c3e217c2f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.062050 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-28c86c1a-e00c-4640-b6fd-1711af0f0eb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd63d7a5f427844d1a26dc58c3e217c2f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.071698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e206fdc6-d57c-4632-b199-31709fcddb46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00691bfafac8435fb73f590c3b6f07dc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.080886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e206fdc6-d57c-4632-b199-31709fcddb46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00691bfafac8435fb73f590c3b6f07dc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.085813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-28c86c1a-e00c-4640-b6fd-1711af0f0eb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd63d7a5f427844d1a26dc58c3e217c2f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.086968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-28c86c1a-e00c-4640-b6fd-1711af0f0eb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd63d7a5f427844d1a26dc58c3e217c2f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.095342 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1395/2782] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:34:19 2022] DELETE /identity/v3/users/d63d7a5f427844d1a26dc58c3e217c2f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:20.097406 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01145d03-b732-4205-9c39-b281dee638d1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.097899 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01145d03-b732-4205-9c39-b281dee638d1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.098253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01145d03-b732-4205-9c39-b281dee638d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.101046 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e206fdc6-d57c-4632-b199-31709fcddb46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00691bfafac8435fb73f590c3b6f07dc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.102216 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e206fdc6-d57c-4632-b199-31709fcddb46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00691bfafac8435fb73f590c3b6f07dc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.103255 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e206fdc6-d57c-4632-b199-31709fcddb46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00691bfafac8435fb73f590c3b6f07dc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.119183 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-01145d03-b732-4205-9c39-b281dee638d1 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:20.120444 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-01145d03-b732-4205-9c39-b281dee638d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:20.124416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1388/2783] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:34:19 2022] DELETE /identity/v3/users/00691bfafac8435fb73f590c3b6f07dc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:20.126115 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6b6c6-0bdd-453b-9b36-47dc74fafa1c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.126965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6b6c6-0bdd-453b-9b36-47dc74fafa1c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.126965 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6b6c6-0bdd-453b-9b36-47dc74fafa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.147190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5ac6b6c6-0bdd-453b-9b36-47dc74fafa1c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:20.148437 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5ac6b6c6-0bdd-453b-9b36-47dc74fafa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:20.230538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1396/2784] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:20.237746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01145d03-b732-4205-9c39-b281dee638d1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:20.249463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1389/2785] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:20.257382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01145d03-b732-4205-9c39-b281dee638d1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:20.264123 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6b6c6-0bdd-453b-9b36-47dc74fafa1c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:20.266374 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5ac6b6c6-0bdd-453b-9b36-47dc74fafa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:20.267158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73679ab3-8a7c-4360-b772-12b457327686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:20.267861 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73679ab3-8a7c-4360-b772-12b457327686 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.268147 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73679ab3-8a7c-4360-b772-12b457327686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.268424 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73679ab3-8a7c-4360-b772-12b457327686 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.269241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73679ab3-8a7c-4360-b772-12b457327686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:34:20.269644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73679ab3-8a7c-4360-b772-12b457327686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:20.271422 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73679ab3-8a7c-4360-b772-12b457327686 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:20.287974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1397/2786] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:34:20.292291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73679ab3-8a7c-4360-b772-12b457327686 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:20.313351 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73679ab3-8a7c-4360-b772-12b457327686 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:20.320835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ae94f-8c36-46f5-8645-cf8a953891ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:20.321848 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ae94f-8c36-46f5-8645-cf8a953891ed admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.322284 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ae94f-8c36-46f5-8645-cf8a953891ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.323356 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ae94f-8c36-46f5-8645-cf8a953891ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.324120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ae94f-8c36-46f5-8645-cf8a953891ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:20.326660 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ae94f-8c36-46f5-8645-cf8a953891ed admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:20.346555 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6b6c6-0bdd-453b-9b36-47dc74fafa1c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:20.351237 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb548cd-dcef-4427-b55b-20e99ec1b7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:20.352137 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb548cd-dcef-4427-b55b-20e99ec1b7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.352532 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb548cd-dcef-4427-b55b-20e99ec1b7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.353034 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb548cd-dcef-4427-b55b-20e99ec1b7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.363450 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1398/2787] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:34:20 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:34:20.368522 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb548cd-dcef-4427-b55b-20e99ec1b7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:20.370114 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb548cd-dcef-4427-b55b-20e99ec1b7b7 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:20.372671 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ae94f-8c36-46f5-8645-cf8a953891ed admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:20.383190 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1390/2788] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:34:20.384089 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb548cd-dcef-4427-b55b-20e99ec1b7b7 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:20.385949 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9fb548cd-dcef-4427-b55b-20e99ec1b7b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:20.401354 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb548cd-dcef-4427-b55b-20e99ec1b7b7 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:20.404288 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:20.474041 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ae94f-8c36-46f5-8645-cf8a953891ed admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:20.479708 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2482052-8709-4063-ba87-6a34b759eb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:20.480584 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2482052-8709-4063-ba87-6a34b759eb91 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.480957 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2482052-8709-4063-ba87-6a34b759eb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.481282 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2482052-8709-4063-ba87-6a34b759eb91 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.482110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2482052-8709-4063-ba87-6a34b759eb91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:20.484544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2482052-8709-4063-ba87-6a34b759eb91 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:20.498566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:20.509850 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1399/2789] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:34:20 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:34:20.516873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2482052-8709-4063-ba87-6a34b759eb91 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:20.526745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3841e6-4b77-4fc1-b809-2fce601533e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:20.527850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3841e6-4b77-4fc1-b809-2fce601533e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.528309 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3841e6-4b77-4fc1-b809-2fce601533e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.528880 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2482052-8709-4063-ba87-6a34b759eb91 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:20.529082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3841e6-4b77-4fc1-b809-2fce601533e3 admin admin] PATH_INFO: `/v3/projects/d81921827a5548ce85a27bdcf623f6e5` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.531011 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3841e6-4b77-4fc1-b809-2fce601533e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81921827a5548ce85a27bdcf623f6e5)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:20.534075 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3841e6-4b77-4fc1-b809-2fce601533e3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:20.537129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1cf5-e973-486e-88d4-56a921691194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:20.538210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1cf5-e973-486e-88d4-56a921691194 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.538553 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1cf5-e973-486e-88d4-56a921691194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.539339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1cf5-e973-486e-88d4-56a921691194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.540315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d1cf5-e973-486e-88d4-56a921691194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:20.543072 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d1cf5-e973-486e-88d4-56a921691194 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:20.560562 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1400/2790] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:34:20.567198 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1cf5-e973-486e-88d4-56a921691194 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:20.580487 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1cf5-e973-486e-88d4-56a921691194 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:20.586942 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b1fdd-55de-4e92-b0a0-f8204cce2b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:20.587854 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b1fdd-55de-4e92-b0a0-f8204cce2b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.588139 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b1fdd-55de-4e92-b0a0-f8204cce2b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.588418 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b1fdd-55de-4e92-b0a0-f8204cce2b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.589509 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b1fdd-55de-4e92-b0a0-f8204cce2b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:20.590862 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b1fdd-55de-4e92-b0a0-f8204cce2b69 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:20.607614 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1401/2791] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:34:20.611610 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b1fdd-55de-4e92-b0a0-f8204cce2b69 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:20.625713 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8b3841e6-4b77-4fc1-b809-2fce601533e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81921827a5548ce85a27bdcf623f6e5', 'request_id': 'req-8b3841e6-4b77-4fc1-b809-2fce601533e3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.631902 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b1fdd-55de-4e92-b0a0-f8204cce2b69 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:20.642668 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8b3841e6-4b77-4fc1-b809-2fce601533e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81921827a5548ce85a27bdcf623f6e5', 'request_id': 'req-8b3841e6-4b77-4fc1-b809-2fce601533e3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.660316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8b3841e6-4b77-4fc1-b809-2fce601533e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81921827a5548ce85a27bdcf623f6e5', 'request_id': 'req-8b3841e6-4b77-4fc1-b809-2fce601533e3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.676539 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8b3841e6-4b77-4fc1-b809-2fce601533e3 admin admin] The token cache is being invalidate because project d81921827a5548ce85a27bdcf623f6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:34:20.676877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8b3841e6-4b77-4fc1-b809-2fce601533e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.680978 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8b3841e6-4b77-4fc1-b809-2fce601533e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:20.683770 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1391/2792] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:34:20 2022] DELETE /identity/v3/projects/d81921827a5548ce85a27bdcf623f6e5 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:20.707800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a7c2c-1835-4985-9b83-541f43503bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:20.708916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a7c2c-1835-4985-9b83-541f43503bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.709270 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a7c2c-1835-4985-9b83-541f43503bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.709560 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a7c2c-1835-4985-9b83-541f43503bad admin admin] PATH_INFO: `/v3/projects/aff5cc5ba6e343b1ba23ebd3af898bed/users/cebcb59007dd429883c2507e55cd24ed/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.734486 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a7c2c-1835-4985-9b83-541f43503bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff5cc5ba6e343b1ba23ebd3af898bed, user_id=cebcb59007dd429883c2507e55cd24ed, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:20.739324 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a7c2c-1835-4985-9b83-541f43503bad admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:20.766602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb8812-334e-4d3b-898a-fa6151ee5e8e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.767008 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb8812-334e-4d3b-898a-fa6151ee5e8e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.767198 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb8812-334e-4d3b-898a-fa6151ee5e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.768787 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1402/2793] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:34:20 2022] PUT /identity/v3/projects/aff5cc5ba6e343b1ba23ebd3af898bed/users/cebcb59007dd429883c2507e55cd24ed/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:34:20.772175 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a7c2c-1835-4985-9b83-541f43503bad admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:20.778567 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b2a7c2c-1835-4985-9b83-541f43503bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:20.789530 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dcdb8812-334e-4d3b-898a-fa6151ee5e8e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:20.791542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dcdb8812-334e-4d3b-898a-fa6151ee5e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:20.873931 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1392/2794] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:20.883318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb8812-334e-4d3b-898a-fa6151ee5e8e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:20.885171 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dcdb8812-334e-4d3b-898a-fa6151ee5e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:20.907010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a7c2c-1835-4985-9b83-541f43503bad admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:20.912221 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:20.913234 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.913522 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.913801 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] PATH_INFO: `/v3/projects/b4320b0135324071b58119a318ffe157` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.915182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4320b0135324071b58119a318ffe157)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:20.917278 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:20.932123 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:20.958469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb8812-334e-4d3b-898a-fa6151ee5e8e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:20.963003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695235e-3b53-4f3b-8760-440c8efb2042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:20.963918 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695235e-3b53-4f3b-8760-440c8efb2042 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:20.964203 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695235e-3b53-4f3b-8760-440c8efb2042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:20.964686 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695235e-3b53-4f3b-8760-440c8efb2042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:20.975430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695235e-3b53-4f3b-8760-440c8efb2042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:20.976988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695235e-3b53-4f3b-8760-440c8efb2042 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:20.987809 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1393/2795] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:34:20.990804 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4320b0135324071b58119a318ffe157', 'request_id': 'req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:21.001344 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4320b0135324071b58119a318ffe157', 'request_id': 'req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:21.011005 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4320b0135324071b58119a318ffe157', 'request_id': 'req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:21.026313 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] The token cache is being invalidate because project b4320b0135324071b58119a318ffe157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:34:21.026749 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:21.027318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:34:21.029099 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1403/2796] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:34:20 2022] DELETE /identity/v3/projects/b4320b0135324071b58119a318ffe157 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:34:25.753042 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc3fc9-5127-473d-909e-f0d2d9ec9792 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:25.754151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc3fc9-5127-473d-909e-f0d2d9ec9792 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:25.754151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc3fc9-5127-473d-909e-f0d2d9ec9792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:25.786208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7cdc3fc9-5127-473d-909e-f0d2d9ec9792 None None] MFA Rules not processed for user `cebcb59007dd429883c2507e55cd24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:25.787494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7cdc3fc9-5127-473d-909e-f0d2d9ec9792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:25.798052 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:25.867083 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1394/2797] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:34:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:25.883753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:34:25.886104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:25.966838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e289-5715-4b62-a92b-2b10dc8b5dc7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:34:25.973712 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c13e67-49ec-48fd-ade3-7427253c4c44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:34:25.974403 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c13e67-49ec-48fd-ade3-7427253c4c44 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:25.974692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c13e67-49ec-48fd-ade3-7427253c4c44 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:25.974964 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c13e67-49ec-48fd-ade3-7427253c4c44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:25.984362 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c13e67-49ec-48fd-ade3-7427253c4c44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:34:25.986269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c13e67-49ec-48fd-ade3-7427253c4c44 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:34:25.996904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1404/2798] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:34:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:34:27.348960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500228cc-67e2-4b99-9cd5-93e48b751f2c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:34:27.348960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500228cc-67e2-4b99-9cd5-93e48b751f2c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:34:27.348960 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500228cc-67e2-4b99-9cd5-93e48b751f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:34:27.367984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-500228cc-67e2-4b99-9cd5-93e48b751f2c None None] MFA Rules not processed for user `cebcb59007dd429883c2507e55cd24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:34:27.369428 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-500228cc-67e2-4b99-9cd5-93e48b751f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:34:27.377704 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1395/2799] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:34:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:34:35.991956 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:37.361751 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=25 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:18.273691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742cd36-7be1-4484-8db2-38064c2c5c1f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:18.274272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742cd36-7be1-4484-8db2-38064c2c5c1f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:18.274272 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742cd36-7be1-4484-8db2-38064c2c5c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:18.310675 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9742cd36-7be1-4484-8db2-38064c2c5c1f None None] MFA Rules not processed for user `cebcb59007dd429883c2507e55cd24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:18.312540 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9742cd36-7be1-4484-8db2-38064c2c5c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:18.338967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1405/2800] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:35:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:18.679339 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500228cc-67e2-4b99-9cd5-93e48b751f2c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:18.680981 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-500228cc-67e2-4b99-9cd5-93e48b751f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:18.798194 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500228cc-67e2-4b99-9cd5-93e48b751f2c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:18.803935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a189f0e-47f0-4173-8c96-b160a2c3d3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:18.804630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a189f0e-47f0-4173-8c96-b160a2c3d3ea service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:18.804915 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a189f0e-47f0-4173-8c96-b160a2c3d3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:18.805189 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a189f0e-47f0-4173-8c96-b160a2c3d3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:18.807375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6a189f0e-47f0-4173-8c96-b160a2c3d3ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:18.818316 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a189f0e-47f0-4173-8c96-b160a2c3d3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:18.819783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a189f0e-47f0-4173-8c96-b160a2c3d3ea service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:18.828264 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1396/2801] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:20.655164 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742cd36-7be1-4484-8db2-38064c2c5c1f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:20.657149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9742cd36-7be1-4484-8db2-38064c2c5c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:20.768411 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742cd36-7be1-4484-8db2-38064c2c5c1f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:20.774333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f48a3-1de5-4546-9942-30bd05421597 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd9ea435d7b48cb8b1b2a27d79cfa91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:20.775023 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f48a3-1de5-4546-9942-30bd05421597 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:20.775307 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f48a3-1de5-4546-9942-30bd05421597 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:20.775601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f48a3-1de5-4546-9942-30bd05421597 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:20.777460 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e62f48a3-1de5-4546-9942-30bd05421597 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:20.790339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f48a3-1de5-4546-9942-30bd05421597 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:20.791970 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f48a3-1de5-4546-9942-30bd05421597 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:20.804403 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1406/2802] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:28.824366 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=48 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:30.798629 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=59 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:18.116858 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cc9c0-0ab3-441b-9550-cdd09b713603 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:36:18.116858 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cc9c0-0ab3-441b-9550-cdd09b713603 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:36:18.116858 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cc9c0-0ab3-441b-9550-cdd09b713603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:36:18.137826 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-804cc9c0-0ab3-441b-9550-cdd09b713603 None None] MFA Rules not processed for user `cebcb59007dd429883c2507e55cd24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:36:18.139577 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-804cc9c0-0ab3-441b-9550-cdd09b713603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:36:18.147041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1397/2803] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:36:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:36:28.131527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:06.436383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f48a3-1de5-4546-9942-30bd05421597 service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:06.438134 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e62f48a3-1de5-4546-9942-30bd05421597 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:06.524524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f48a3-1de5-4546-9942-30bd05421597 service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:06.529020 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2ceb8-57eb-4aef-b688-8c16188718b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:06.529670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2ceb8-57eb-4aef-b688-8c16188718b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:06.529946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2ceb8-57eb-4aef-b688-8c16188718b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:06.530201 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2ceb8-57eb-4aef-b688-8c16188718b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:06.532760 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-56f2ceb8-57eb-4aef-b688-8c16188718b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:06.570047 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2ceb8-57eb-4aef-b688-8c16188718b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:06.571407 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2ceb8-57eb-4aef-b688-8c16188718b1 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:06.593476 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1407/2804] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:08.069554 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cc9c0-0ab3-441b-9550-cdd09b713603 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:08.071215 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-804cc9c0-0ab3-441b-9550-cdd09b713603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:08.083837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cc9c0-0ab3-441b-9550-cdd09b713603 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:08.087871 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3a88f-846c-4da3-811a-8d1bbebdaa33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:08.088520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3a88f-846c-4da3-811a-8d1bbebdaa33 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:08.088899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3a88f-846c-4da3-811a-8d1bbebdaa33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:08.089177 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3a88f-846c-4da3-811a-8d1bbebdaa33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:08.091044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-05b3a88f-846c-4da3-811a-8d1bbebdaa33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:08.105080 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3a88f-846c-4da3-811a-8d1bbebdaa33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:08.106592 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3a88f-846c-4da3-811a-8d1bbebdaa33 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:08.118240 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1398/2805] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:15.443863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc766c-df95-4cc5-bc12-7d789760261e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:15.444416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc766c-df95-4cc5-bc12-7d789760261e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:15.444416 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc766c-df95-4cc5-bc12-7d789760261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:15.462323 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8bfc766c-df95-4cc5-bc12-7d789760261e None None] MFA Rules not processed for user `cebcb59007dd429883c2507e55cd24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:15.463536 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8bfc766c-df95-4cc5-bc12-7d789760261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:15.471144 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1408/2806] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:37:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.112839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:25.457766 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=50 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:56.866051 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3a88f-846c-4da3-811a-8d1bbebdaa33 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:56.876982 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3a88f-846c-4da3-811a-8d1bbebdaa33 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:56.881745 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bf5ba-2d89-4703-80e6-9c57ea3ee2e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:56.882416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bf5ba-2d89-4703-80e6-9c57ea3ee2e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:56.882691 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bf5ba-2d89-4703-80e6-9c57ea3ee2e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:56.882956 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bf5ba-2d89-4703-80e6-9c57ea3ee2e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:56.885463 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5f4bf5ba-2d89-4703-80e6-9c57ea3ee2e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:56.896387 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bf5ba-2d89-4703-80e6-9c57ea3ee2e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:56.897883 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bf5ba-2d89-4703-80e6-9c57ea3ee2e9 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:56.906923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1399/2807] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:06.903005 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:08.224972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc766c-df95-4cc5-bc12-7d789760261e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:08.241107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc766c-df95-4cc5-bc12-7d789760261e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:08.248726 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17163f18-cd29-413f-b123-d3ad647fc273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421f05e3d10e4393b28f77b6179ade8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:08.250542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17163f18-cd29-413f-b123-d3ad647fc273 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:08.250954 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17163f18-cd29-413f-b123-d3ad647fc273 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:08.251358 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17163f18-cd29-413f-b123-d3ad647fc273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:08.254285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-17163f18-cd29-413f-b123-d3ad647fc273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:08.269634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17163f18-cd29-413f-b123-d3ad647fc273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:08.271469 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17163f18-cd29-413f-b123-d3ad647fc273 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:08.284383 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1409/2808] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:16.956056 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bf5ba-2d89-4703-80e6-9c57ea3ee2e9 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:16.957607 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5f4bf5ba-2d89-4703-80e6-9c57ea3ee2e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:17.069421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bf5ba-2d89-4703-80e6-9c57ea3ee2e9 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:17.079037 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f9794-c10b-43ba-b9ce-11dae14a380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:17.079859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f9794-c10b-43ba-b9ce-11dae14a380e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:17.080139 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f9794-c10b-43ba-b9ce-11dae14a380e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:17.080415 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f9794-c10b-43ba-b9ce-11dae14a380e admin admin] PATH_INFO: `/v3/users/cebcb59007dd429883c2507e55cd24ed` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:17.081783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f9794-c10b-43ba-b9ce-11dae14a380e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cebcb59007dd429883c2507e55cd24ed)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:17.083782 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f9794-c10b-43ba-b9ce-11dae14a380e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:17.139113 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-461f9794-c10b-43ba-b9ce-11dae14a380e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cebcb59007dd429883c2507e55cd24ed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:17.146416 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-461f9794-c10b-43ba-b9ce-11dae14a380e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cebcb59007dd429883c2507e55cd24ed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:17.158731 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-461f9794-c10b-43ba-b9ce-11dae14a380e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cebcb59007dd429883c2507e55cd24ed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:17.159496 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-461f9794-c10b-43ba-b9ce-11dae14a380e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cebcb59007dd429883c2507e55cd24ed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:17.160146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-461f9794-c10b-43ba-b9ce-11dae14a380e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cebcb59007dd429883c2507e55cd24ed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:17.175903 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1400/2809] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:16 2022] DELETE /identity/v3/users/cebcb59007dd429883c2507e55cd24ed => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:17.373366 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17163f18-cd29-413f-b123-d3ad647fc273 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:17.386171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17163f18-cd29-413f-b123-d3ad647fc273 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:17.452104 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:17.453043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:17.453322 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:17.453670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e admin admin] PATH_INFO: `/v3/projects/aff5cc5ba6e343b1ba23ebd3af898bed` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:17.455184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff5cc5ba6e343b1ba23ebd3af898bed)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:17.457184 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:17.513814 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff5cc5ba6e343b1ba23ebd3af898bed', 'request_id': 'req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:17.521099 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff5cc5ba6e343b1ba23ebd3af898bed', 'request_id': 'req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:17.527639 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff5cc5ba6e343b1ba23ebd3af898bed', 'request_id': 'req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:17.544226 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e admin admin] The token cache is being invalidate because project aff5cc5ba6e343b1ba23ebd3af898bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:17.544816 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:17.545531 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0e729fe9-f2f9-46a5-9ed0-4c2c21b4f70e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:17.547149 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1410/2810] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:17 2022] DELETE /identity/v3/projects/aff5cc5ba6e343b1ba23ebd3af898bed => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:17.552825 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05fff5-b6e3-4645-a84e-39d3342d2c95 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:17.553128 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05fff5-b6e3-4645-a84e-39d3342d2c95 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:17.553547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05fff5-b6e3-4645-a84e-39d3342d2c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:17.620587 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ae05fff5-b6e3-4645-a84e-39d3342d2c95 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:17.622009 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ae05fff5-b6e3-4645-a84e-39d3342d2c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:17.636329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:17.690050 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1401/2811] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:17.699137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4aa06-725e-4c1b-aa73-85714dd777ec None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:17.699410 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4aa06-725e-4c1b-aa73-85714dd777ec None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:17.699688 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4aa06-725e-4c1b-aa73-85714dd777ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:17.722095 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-30b4aa06-725e-4c1b-aa73-85714dd777ec None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:17.723469 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-30b4aa06-725e-4c1b-aa73-85714dd777ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:17.733588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1411/2812] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:17.739044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05fff5-b6e3-4645-a84e-39d3342d2c95 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:17.750154 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05fff5-b6e3-4645-a84e-39d3342d2c95 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:17.756650 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4032a-9278-455a-91d8-6ccb42f2e4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:17.757375 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4032a-9278-455a-91d8-6ccb42f2e4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:17.757657 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4032a-9278-455a-91d8-6ccb42f2e4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:17.758093 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4032a-9278-455a-91d8-6ccb42f2e4e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:17.758697 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4032a-9278-455a-91d8-6ccb42f2e4e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:17.759380 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4032a-9278-455a-91d8-6ccb42f2e4e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:17.760994 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4032a-9278-455a-91d8-6ccb42f2e4e1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:17.774345 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1402/2813] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:38:17.780953 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4aa06-725e-4c1b-aa73-85714dd777ec None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:17.791341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4aa06-725e-4c1b-aa73-85714dd777ec None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:17.796978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74e9b3-c9d7-492d-977a-f48e480dfdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:17.797763 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74e9b3-c9d7-492d-977a-f48e480dfdac admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:17.798045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74e9b3-c9d7-492d-977a-f48e480dfdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:17.798339 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74e9b3-c9d7-492d-977a-f48e480dfdac admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:17.799109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74e9b3-c9d7-492d-977a-f48e480dfdac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:17.801333 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74e9b3-c9d7-492d-977a-f48e480dfdac admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:17.845297 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1412/2814] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:17 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:17.850277 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4032a-9278-455a-91d8-6ccb42f2e4e1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:17.863335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4032a-9278-455a-91d8-6ccb42f2e4e1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:17.960421 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a52b9-8396-475c-9ddc-579bd65fd410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:17.961317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a52b9-8396-475c-9ddc-579bd65fd410 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:17.961317 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a52b9-8396-475c-9ddc-579bd65fd410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:17.961615 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a52b9-8396-475c-9ddc-579bd65fd410 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:17.962388 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a52b9-8396-475c-9ddc-579bd65fd410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:17.964385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a52b9-8396-475c-9ddc-579bd65fd410 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:17.989104 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1403/2815] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:17 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:17.996426 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74e9b3-c9d7-492d-977a-f48e480dfdac admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:18.008007 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74e9b3-c9d7-492d-977a-f48e480dfdac admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:18.019550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fea96e-a742-4e7b-996f-f6976f7ef695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:18.020879 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fea96e-a742-4e7b-996f-f6976f7ef695 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:18.021359 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fea96e-a742-4e7b-996f-f6976f7ef695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:18.021823 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fea96e-a742-4e7b-996f-f6976f7ef695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:18.023103 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fea96e-a742-4e7b-996f-f6976f7ef695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:18.025981 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fea96e-a742-4e7b-996f-f6976f7ef695 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:18.038074 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1413/2816] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:18.043070 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a52b9-8396-475c-9ddc-579bd65fd410 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:18.054682 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a52b9-8396-475c-9ddc-579bd65fd410 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:18.060143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af164c30-d201-4410-aec7-6894a88097b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:18.060862 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af164c30-d201-4410-aec7-6894a88097b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:18.061145 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af164c30-d201-4410-aec7-6894a88097b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:18.061419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af164c30-d201-4410-aec7-6894a88097b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:18.062181 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af164c30-d201-4410-aec7-6894a88097b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:18.063909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af164c30-d201-4410-aec7-6894a88097b0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:18.075813 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1404/2817] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:18.080281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fea96e-a742-4e7b-996f-f6976f7ef695 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:18.092042 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fea96e-a742-4e7b-996f-f6976f7ef695 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:18.096968 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e5eb6-30bf-4b8a-a30a-d8e90badf772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:18.097887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e5eb6-30bf-4b8a-a30a-d8e90badf772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:18.098179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e5eb6-30bf-4b8a-a30a-d8e90badf772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:18.098442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e5eb6-30bf-4b8a-a30a-d8e90badf772 admin admin] PATH_INFO: `/v3/projects/24982e5338b04b289161831fe04df331/users/37d7b3e837644886b51b12b8f2e83457/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:18.115168 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e5eb6-30bf-4b8a-a30a-d8e90badf772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24982e5338b04b289161831fe04df331, user_id=37d7b3e837644886b51b12b8f2e83457, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:18.117887 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e5eb6-30bf-4b8a-a30a-d8e90badf772 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:18.132728 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1414/2818] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:18 2022] PUT /identity/v3/projects/24982e5338b04b289161831fe04df331/users/37d7b3e837644886b51b12b8f2e83457/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:18.143540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f3b21-8fec-40c2-983c-f0740bb2c66a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:18.143836 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f3b21-8fec-40c2-983c-f0740bb2c66a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:18.144098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f3b21-8fec-40c2-983c-f0740bb2c66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:18.173373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-126f3b21-8fec-40c2-983c-f0740bb2c66a None None] MFA Rules not processed for user `37d7b3e837644886b51b12b8f2e83457`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:18.174624 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-126f3b21-8fec-40c2-983c-f0740bb2c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:18.242754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1405/2819] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:18.247588 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e5eb6-30bf-4b8a-a30a-d8e90badf772 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:18.254098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:18.321685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e5eb6-30bf-4b8a-a30a-d8e90badf772 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:18.326986 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43149777-f6ff-465f-bf7e-bff8b58dc7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:18.327669 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43149777-f6ff-465f-bf7e-bff8b58dc7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:18.327948 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43149777-f6ff-465f-bf7e-bff8b58dc7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:18.328222 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43149777-f6ff-465f-bf7e-bff8b58dc7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:18.328984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43149777-f6ff-465f-bf7e-bff8b58dc7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:18.330920 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43149777-f6ff-465f-bf7e-bff8b58dc7b7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:18.362224 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1415/2820] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:18 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:18.366687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f3b21-8fec-40c2-983c-f0740bb2c66a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:18.378383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f3b21-8fec-40c2-983c-f0740bb2c66a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:18.392616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:18.456111 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78cee5-f3ea-41d2-84a2-8c4e6524e590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:18.456829 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78cee5-f3ea-41d2-84a2-8c4e6524e590 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:18.457110 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78cee5-f3ea-41d2-84a2-8c4e6524e590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:18.457385 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78cee5-f3ea-41d2-84a2-8c4e6524e590 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:18.458098 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78cee5-f3ea-41d2-84a2-8c4e6524e590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:18.460054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78cee5-f3ea-41d2-84a2-8c4e6524e590 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:18.483146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1406/2821] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:18 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:18.492293 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43149777-f6ff-465f-bf7e-bff8b58dc7b7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:18.503614 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43149777-f6ff-465f-bf7e-bff8b58dc7b7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:18.508745 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38293d76-20da-4c4c-82a4-f5f47eb82053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:18.509838 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293d76-20da-4c4c-82a4-f5f47eb82053 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:18.510120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293d76-20da-4c4c-82a4-f5f47eb82053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:18.510395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293d76-20da-4c4c-82a4-f5f47eb82053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:18.511135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38293d76-20da-4c4c-82a4-f5f47eb82053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:18.513002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38293d76-20da-4c4c-82a4-f5f47eb82053 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:18.525135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1416/2822] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:18.529739 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78cee5-f3ea-41d2-84a2-8c4e6524e590 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:18.541547 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78cee5-f3ea-41d2-84a2-8c4e6524e590 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:18.547644 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcd6d4-a2c2-41c7-afa2-0581f57b0e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:18.548616 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcd6d4-a2c2-41c7-afa2-0581f57b0e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:18.548900 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcd6d4-a2c2-41c7-afa2-0581f57b0e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:18.549181 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcd6d4-a2c2-41c7-afa2-0581f57b0e9b admin admin] PATH_INFO: `/v3/projects/9a6ee7a0af0942c885cacdb82d6b3ef0/users/d6438c3fd9ad4f1498311ae0f85b344e/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:18.568381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcd6d4-a2c2-41c7-afa2-0581f57b0e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6ee7a0af0942c885cacdb82d6b3ef0, user_id=d6438c3fd9ad4f1498311ae0f85b344e, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:18.571206 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcd6d4-a2c2-41c7-afa2-0581f57b0e9b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:18.589044 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1407/2823] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:18 2022] PUT /identity/v3/projects/9a6ee7a0af0942c885cacdb82d6b3ef0/users/d6438c3fd9ad4f1498311ae0f85b344e/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:18.595222 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38293d76-20da-4c4c-82a4-f5f47eb82053 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:18.606495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38293d76-20da-4c4c-82a4-f5f47eb82053 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:18.674258 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007ccb3-d8d2-4d26-b5c9-ff95cc083120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:18.675043 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007ccb3-d8d2-4d26-b5c9-ff95cc083120 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:18.675368 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007ccb3-d8d2-4d26-b5c9-ff95cc083120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:18.675691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007ccb3-d8d2-4d26-b5c9-ff95cc083120 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:18.676523 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007ccb3-d8d2-4d26-b5c9-ff95cc083120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:18.678560 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007ccb3-d8d2-4d26-b5c9-ff95cc083120 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:18.691216 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1417/2824] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:18.696091 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcd6d4-a2c2-41c7-afa2-0581f57b0e9b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:18.708258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcd6d4-a2c2-41c7-afa2-0581f57b0e9b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:18.714425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23397010-f00c-4f6f-9017-cad2930236b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:18.715595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23397010-f00c-4f6f-9017-cad2930236b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:18.715951 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23397010-f00c-4f6f-9017-cad2930236b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:18.716325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23397010-f00c-4f6f-9017-cad2930236b2 admin admin] PATH_INFO: `/v3/projects/9a6ee7a0af0942c885cacdb82d6b3ef0/users/d6438c3fd9ad4f1498311ae0f85b344e/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:18.718831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23397010-f00c-4f6f-9017-cad2930236b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6ee7a0af0942c885cacdb82d6b3ef0, user_id=d6438c3fd9ad4f1498311ae0f85b344e, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:18.721839 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23397010-f00c-4f6f-9017-cad2930236b2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:18.734414 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1408/2825] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:18 2022] PUT /identity/v3/projects/9a6ee7a0af0942c885cacdb82d6b3ef0/users/d6438c3fd9ad4f1498311ae0f85b344e/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:18.746687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56c887-9983-440f-8ad0-90a789957f06 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:18.746947 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56c887-9983-440f-8ad0-90a789957f06 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:18.747241 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56c887-9983-440f-8ad0-90a789957f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:18.782285 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4f56c887-9983-440f-8ad0-90a789957f06 None None] MFA Rules not processed for user `d6438c3fd9ad4f1498311ae0f85b344e`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:18.783778 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4f56c887-9983-440f-8ad0-90a789957f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:18.867420 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:18.876318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1418/2826] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:18.886661 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23397010-f00c-4f6f-9017-cad2930236b2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:18.889090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23397010-f00c-4f6f-9017-cad2930236b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:18.956901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23397010-f00c-4f6f-9017-cad2930236b2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:18.960964 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce08a-b5d0-4c27-9627-2383fdf4e4f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:18.961630 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce08a-b5d0-4c27-9627-2383fdf4e4f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:18.961909 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce08a-b5d0-4c27-9627-2383fdf4e4f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:18.962263 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce08a-b5d0-4c27-9627-2383fdf4e4f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:18.973711 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce08a-b5d0-4c27-9627-2383fdf4e4f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:18.975187 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce08a-b5d0-4c27-9627-2383fdf4e4f4 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:18.985283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1409/2827] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:19.014670 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56c887-9983-440f-8ad0-90a789957f06 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:19.080523 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56c887-9983-440f-8ad0-90a789957f06 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:19.085467 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:19.086353 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:19.086631 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:19.087012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] PATH_INFO: `/v3/users/37d7b3e837644886b51b12b8f2e83457` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:19.088126 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d7b3e837644886b51b12b8f2e83457)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:19.090162 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:19.146157 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d7b3e837644886b51b12b8f2e83457'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.156709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d7b3e837644886b51b12b8f2e83457'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.166305 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d7b3e837644886b51b12b8f2e83457'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.181796 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d7b3e837644886b51b12b8f2e83457'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.182580 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d7b3e837644886b51b12b8f2e83457'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.189002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1419/2828] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:19 2022] DELETE /identity/v3/users/37d7b3e837644886b51b12b8f2e83457 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:19.194365 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae58a5-9743-444f-9484-809e33442c9e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:19.194683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae58a5-9743-444f-9484-809e33442c9e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:19.195066 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae58a5-9743-444f-9484-809e33442c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:19.216253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-feae58a5-9743-444f-9484-809e33442c9e None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:19.217534 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-feae58a5-9743-444f-9484-809e33442c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:19.284304 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1410/2829] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:19.295937 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:19.297512 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:19.361239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e7bf3-1d58-44f1-885c-5afe8d3d8900 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:19.365311 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ac754-e2ae-4e32-8b01-1e9ead23f248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:19.365974 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ac754-e2ae-4e32-8b01-1e9ead23f248 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:19.366253 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ac754-e2ae-4e32-8b01-1e9ead23f248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:19.366525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ac754-e2ae-4e32-8b01-1e9ead23f248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:19.378132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ac754-e2ae-4e32-8b01-1e9ead23f248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:19.379587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ac754-e2ae-4e32-8b01-1e9ead23f248 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:19.391510 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1420/2830] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:19.682341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae58a5-9743-444f-9484-809e33442c9e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:19.683885 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-feae58a5-9743-444f-9484-809e33442c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:19.696968 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae58a5-9743-444f-9484-809e33442c9e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:19.703367 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:19.704254 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:19.704566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:19.704853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] PATH_INFO: `/v3/projects/24982e5338b04b289161831fe04df331` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:19.706553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] RBAC: Authorizing `identity:delete_project(project_id=24982e5338b04b289161831fe04df331)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:19.708794 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:19.717525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:19.760980 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24982e5338b04b289161831fe04df331', 'request_id': 'req-14a4876b-9b94-4b11-9051-95043250675e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.770426 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24982e5338b04b289161831fe04df331', 'request_id': 'req-14a4876b-9b94-4b11-9051-95043250675e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.777383 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24982e5338b04b289161831fe04df331', 'request_id': 'req-14a4876b-9b94-4b11-9051-95043250675e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.789557 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] The token cache is being invalidate because project 24982e5338b04b289161831fe04df331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:19.789848 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.790559 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.792135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1411/2831] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:19 2022] DELETE /identity/v3/projects/24982e5338b04b289161831fe04df331 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:19.798314 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ac754-e2ae-4e32-8b01-1e9ead23f248 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:19.810709 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ac754-e2ae-4e32-8b01-1e9ead23f248 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:19.830589 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:19.879206 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557395b2-f093-48c4-bdb4-efbe975ad4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:19.880067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557395b2-f093-48c4-bdb4-efbe975ad4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:19.880318 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557395b2-f093-48c4-bdb4-efbe975ad4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:19.880654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557395b2-f093-48c4-bdb4-efbe975ad4c5 admin admin] PATH_INFO: `/v3/users/d6438c3fd9ad4f1498311ae0f85b344e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:19.881944 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557395b2-f093-48c4-bdb4-efbe975ad4c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6438c3fd9ad4f1498311ae0f85b344e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:19.883890 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557395b2-f093-48c4-bdb4-efbe975ad4c5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:19.940875 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-557395b2-f093-48c4-bdb4-efbe975ad4c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6438c3fd9ad4f1498311ae0f85b344e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.950685 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-557395b2-f093-48c4-bdb4-efbe975ad4c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6438c3fd9ad4f1498311ae0f85b344e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.959191 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-557395b2-f093-48c4-bdb4-efbe975ad4c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6438c3fd9ad4f1498311ae0f85b344e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.972474 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-557395b2-f093-48c4-bdb4-efbe975ad4c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6438c3fd9ad4f1498311ae0f85b344e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.973209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-557395b2-f093-48c4-bdb4-efbe975ad4c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6438c3fd9ad4f1498311ae0f85b344e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:19.979526 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1421/2832] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:19 2022] DELETE /identity/v3/users/d6438c3fd9ad4f1498311ae0f85b344e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:20.259576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:20.261116 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:20.275208 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4876b-9b94-4b11-9051-95043250675e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:20.340125 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:20.341036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.341319 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.341611 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3 admin admin] PATH_INFO: `/v3/projects/9a6ee7a0af0942c885cacdb82d6b3ef0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.343054 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6ee7a0af0942c885cacdb82d6b3ef0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:20.345446 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:20.399601 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6ee7a0af0942c885cacdb82d6b3ef0', 'request_id': 'req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:20.411509 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6ee7a0af0942c885cacdb82d6b3ef0', 'request_id': 'req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:20.418289 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6ee7a0af0942c885cacdb82d6b3ef0', 'request_id': 'req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:20.434525 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3 admin admin] The token cache is being invalidate because project 9a6ee7a0af0942c885cacdb82d6b3ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:20.434817 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:20.435481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-78b5e21f-a1db-4bbb-8a90-b0fb9e1ca1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:20.437227 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1412/2833] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:20 2022] DELETE /identity/v3/projects/9a6ee7a0af0942c885cacdb82d6b3ef0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:20.442622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67e8b-90ab-4eda-8827-8619f5c8f82c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.442914 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67e8b-90ab-4eda-8827-8619f5c8f82c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.443194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67e8b-90ab-4eda-8827-8619f5c8f82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.464472 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-64b67e8b-90ab-4eda-8827-8619f5c8f82c None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:20.465813 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-64b67e8b-90ab-4eda-8827-8619f5c8f82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:20.527434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1422/2834] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:20.536890 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edae1a-3e0b-460d-bcc5-6f4c9d006401 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.537139 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edae1a-3e0b-460d-bcc5-6f4c9d006401 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.537450 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edae1a-3e0b-460d-bcc5-6f4c9d006401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.559947 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-97edae1a-3e0b-460d-bcc5-6f4c9d006401 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:20.561284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-97edae1a-3e0b-460d-bcc5-6f4c9d006401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:20.569687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1413/2835] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:38:20.574210 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b67e8b-90ab-4eda-8827-8619f5c8f82c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:20.584380 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b67e8b-90ab-4eda-8827-8619f5c8f82c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:20.589195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e38b1-9110-41b4-9651-58424c6131ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:20.589926 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e38b1-9110-41b4-9651-58424c6131ce admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.590205 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e38b1-9110-41b4-9651-58424c6131ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.590464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e38b1-9110-41b4-9651-58424c6131ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.591203 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e38b1-9110-41b4-9651-58424c6131ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:20.591504 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e38b1-9110-41b4-9651-58424c6131ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:20.593208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e38b1-9110-41b4-9651-58424c6131ce admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:20.607182 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1423/2836] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:38:20.611935 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edae1a-3e0b-460d-bcc5-6f4c9d006401 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:20.622235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edae1a-3e0b-460d-bcc5-6f4c9d006401 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:20.628621 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afcd46-48a6-4205-8439-1fba3bfd2add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:20.629296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afcd46-48a6-4205-8439-1fba3bfd2add admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.629575 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afcd46-48a6-4205-8439-1fba3bfd2add admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.629846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afcd46-48a6-4205-8439-1fba3bfd2add admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.630754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afcd46-48a6-4205-8439-1fba3bfd2add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:20.632814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afcd46-48a6-4205-8439-1fba3bfd2add admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:20.649476 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:20.674553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1414/2837] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:20 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:20.676086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e38b1-9110-41b4-9651-58424c6131ce admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:20.688194 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e38b1-9110-41b4-9651-58424c6131ce admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:20.720327 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:20.757979 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ef25d-d6ad-4e74-b337-81f348105e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:20.758719 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ef25d-d6ad-4e74-b337-81f348105e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.759341 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ef25d-d6ad-4e74-b337-81f348105e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.759616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ef25d-d6ad-4e74-b337-81f348105e05 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.760322 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ef25d-d6ad-4e74-b337-81f348105e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:20.762972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ef25d-d6ad-4e74-b337-81f348105e05 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:20.785929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1424/2838] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:20 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:20.790341 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afcd46-48a6-4205-8439-1fba3bfd2add admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:20.802394 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afcd46-48a6-4205-8439-1fba3bfd2add admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:20.808430 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11fe3-3c6b-4bae-9446-aeeae27a5e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:20.809146 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11fe3-3c6b-4bae-9446-aeeae27a5e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.809434 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11fe3-3c6b-4bae-9446-aeeae27a5e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.809716 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11fe3-3c6b-4bae-9446-aeeae27a5e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.810458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b11fe3-3c6b-4bae-9446-aeeae27a5e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:20.812100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b11fe3-3c6b-4bae-9446-aeeae27a5e1d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:20.824346 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1415/2839] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:20.829357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ef25d-d6ad-4e74-b337-81f348105e05 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:20.845681 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ef25d-d6ad-4e74-b337-81f348105e05 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:20.853967 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc9a05-3b2a-4654-87c3-d244df1a67c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:20.854916 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc9a05-3b2a-4654-87c3-d244df1a67c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.855316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc9a05-3b2a-4654-87c3-d244df1a67c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.855622 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc9a05-3b2a-4654-87c3-d244df1a67c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.856544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc9a05-3b2a-4654-87c3-d244df1a67c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:20.858159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc9a05-3b2a-4654-87c3-d244df1a67c6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:20.869816 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1425/2840] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:38:20.874279 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11fe3-3c6b-4bae-9446-aeeae27a5e1d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:20.885734 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11fe3-3c6b-4bae-9446-aeeae27a5e1d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:20.891278 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b79b6-98c5-402d-8191-d7249421c723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:20.892179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b79b6-98c5-402d-8191-d7249421c723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.892469 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b79b6-98c5-402d-8191-d7249421c723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.892766 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b79b6-98c5-402d-8191-d7249421c723 admin admin] PATH_INFO: `/v3/projects/4239de60325941fa9c25a95ba3d7c148/users/2b97930345a6491eb5625dc8a65fc7ec/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.909836 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b79b6-98c5-402d-8191-d7249421c723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4239de60325941fa9c25a95ba3d7c148, user_id=2b97930345a6491eb5625dc8a65fc7ec, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:20.912595 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b79b6-98c5-402d-8191-d7249421c723 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:20.934892 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1416/2841] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:20 2022] PUT /identity/v3/projects/4239de60325941fa9c25a95ba3d7c148/users/2b97930345a6491eb5625dc8a65fc7ec/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:20.945573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aca0a-84a6-44e3-b557-13f676e96451 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.945845 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aca0a-84a6-44e3-b557-13f676e96451 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.946133 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aca0a-84a6-44e3-b557-13f676e96451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.974431 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-437aca0a-84a6-44e3-b557-13f676e96451 None None] MFA Rules not processed for user `2b97930345a6491eb5625dc8a65fc7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:20.975666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-437aca0a-84a6-44e3-b557-13f676e96451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:21.058755 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1426/2842] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:21.063512 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b79b6-98c5-402d-8191-d7249421c723 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:21.136888 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b79b6-98c5-402d-8191-d7249421c723 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:21.142368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7424c8-282d-4bf4-9ae1-4e1da11a9c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:21.143042 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7424c8-282d-4bf4-9ae1-4e1da11a9c96 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:21.143324 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7424c8-282d-4bf4-9ae1-4e1da11a9c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:21.143599 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7424c8-282d-4bf4-9ae1-4e1da11a9c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:21.144310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7424c8-282d-4bf4-9ae1-4e1da11a9c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:21.146425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7424c8-282d-4bf4-9ae1-4e1da11a9c96 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:21.186320 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1417/2843] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:21 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:21.191180 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437aca0a-84a6-44e3-b557-13f676e96451 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:21.207779 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437aca0a-84a6-44e3-b557-13f676e96451 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:21.277643 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d058d67-2093-4aeb-a0e3-9696ee2e89d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:21.278523 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d058d67-2093-4aeb-a0e3-9696ee2e89d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:21.278650 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d058d67-2093-4aeb-a0e3-9696ee2e89d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:21.278969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d058d67-2093-4aeb-a0e3-9696ee2e89d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:21.281978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d058d67-2093-4aeb-a0e3-9696ee2e89d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:21.281978 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d058d67-2093-4aeb-a0e3-9696ee2e89d6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:21.305636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1427/2844] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:21 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:21.309919 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7424c8-282d-4bf4-9ae1-4e1da11a9c96 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:21.322003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7424c8-282d-4bf4-9ae1-4e1da11a9c96 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:21.328699 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f2d57-5c68-461c-bb36-26574f2d4427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:21.329398 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f2d57-5c68-461c-bb36-26574f2d4427 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:21.329675 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f2d57-5c68-461c-bb36-26574f2d4427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:21.329948 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f2d57-5c68-461c-bb36-26574f2d4427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:21.330738 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f2d57-5c68-461c-bb36-26574f2d4427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:21.333312 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f2d57-5c68-461c-bb36-26574f2d4427 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:21.347256 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1418/2845] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:21.352094 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d058d67-2093-4aeb-a0e3-9696ee2e89d6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:21.366262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d058d67-2093-4aeb-a0e3-9696ee2e89d6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:21.374395 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbad8e-dcca-4b5f-9277-a86a31a2e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:21.382107 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbad8e-dcca-4b5f-9277-a86a31a2e1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:21.382651 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbad8e-dcca-4b5f-9277-a86a31a2e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:21.383167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbad8e-dcca-4b5f-9277-a86a31a2e1ef admin admin] PATH_INFO: `/v3/projects/291041d137e04fcab2881cb34882b117/users/031b7e6d74e9475b83a2088919eac465/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:21.412647 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbad8e-dcca-4b5f-9277-a86a31a2e1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=291041d137e04fcab2881cb34882b117, user_id=031b7e6d74e9475b83a2088919eac465, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:21.417907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbad8e-dcca-4b5f-9277-a86a31a2e1ef admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:21.438281 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1428/2846] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:21 2022] PUT /identity/v3/projects/291041d137e04fcab2881cb34882b117/users/031b7e6d74e9475b83a2088919eac465/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:21.442843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f2d57-5c68-461c-bb36-26574f2d4427 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:21.455437 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f2d57-5c68-461c-bb36-26574f2d4427 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:21.517873 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a06005-7914-4b42-b23f-37a185ceea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:21.518548 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a06005-7914-4b42-b23f-37a185ceea59 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:21.518827 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a06005-7914-4b42-b23f-37a185ceea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:21.519103 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a06005-7914-4b42-b23f-37a185ceea59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:21.519837 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a06005-7914-4b42-b23f-37a185ceea59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:21.521494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a06005-7914-4b42-b23f-37a185ceea59 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:21.533916 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1419/2847] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:21.538230 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbad8e-dcca-4b5f-9277-a86a31a2e1ef admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:21.544321 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:21.550571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbad8e-dcca-4b5f-9277-a86a31a2e1ef admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:21.557109 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d8fc9-a711-4231-b67c-88da8878d176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:21.558226 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d8fc9-a711-4231-b67c-88da8878d176 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:21.558583 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d8fc9-a711-4231-b67c-88da8878d176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:21.558983 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d8fc9-a711-4231-b67c-88da8878d176 admin admin] PATH_INFO: `/v3/projects/291041d137e04fcab2881cb34882b117/users/031b7e6d74e9475b83a2088919eac465/roles/fee299f447b040f6b5d08cb30a0b3295` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:21.561187 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d8fc9-a711-4231-b67c-88da8878d176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=291041d137e04fcab2881cb34882b117, user_id=031b7e6d74e9475b83a2088919eac465, role_id=fee299f447b040f6b5d08cb30a0b3295)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:21.563863 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d8fc9-a711-4231-b67c-88da8878d176 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:21.575453 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1429/2848] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:21 2022] PUT /identity/v3/projects/291041d137e04fcab2881cb34882b117/users/031b7e6d74e9475b83a2088919eac465/roles/fee299f447b040f6b5d08cb30a0b3295 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:21.587213 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4748122-5d61-4bea-bb4f-b0ccbc523b42 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:21.587500 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4748122-5d61-4bea-bb4f-b0ccbc523b42 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:21.587790 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4748122-5d61-4bea-bb4f-b0ccbc523b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:21.623053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a4748122-5d61-4bea-bb4f-b0ccbc523b42 None None] MFA Rules not processed for user `031b7e6d74e9475b83a2088919eac465`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:21.624322 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a4748122-5d61-4bea-bb4f-b0ccbc523b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:21.644800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:21.699687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1420/2849] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:21.716537 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d8fc9-a711-4231-b67c-88da8878d176 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:21.721826 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-014d8fc9-a711-4231-b67c-88da8878d176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:21.784758 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d8fc9-a711-4231-b67c-88da8878d176 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:21.788969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ca87a-67ec-4b6d-b178-78b8cf0bfa7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:21.789646 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ca87a-67ec-4b6d-b178-78b8cf0bfa7c service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:21.789923 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ca87a-67ec-4b6d-b178-78b8cf0bfa7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:21.790195 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ca87a-67ec-4b6d-b178-78b8cf0bfa7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:21.800883 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ca87a-67ec-4b6d-b178-78b8cf0bfa7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:21.802609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ca87a-67ec-4b6d-b178-78b8cf0bfa7c service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:21.813692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1430/2850] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:21.904184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4748122-5d61-4bea-bb4f-b0ccbc523b42 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:21.914683 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4748122-5d61-4bea-bb4f-b0ccbc523b42 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:21.918542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715000e0-cb46-48b6-8805-c19f7ebfd2f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:21.919197 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715000e0-cb46-48b6-8805-c19f7ebfd2f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:21.919481 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715000e0-cb46-48b6-8805-c19f7ebfd2f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:21.919754 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715000e0-cb46-48b6-8805-c19f7ebfd2f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:21.978270 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715000e0-cb46-48b6-8805-c19f7ebfd2f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:21.979736 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715000e0-cb46-48b6-8805-c19f7ebfd2f7 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:21.989135 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1421/2851] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:26.944743 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ca87a-67ec-4b6d-b178-78b8cf0bfa7c service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:27.013211 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ca87a-67ec-4b6d-b178-78b8cf0bfa7c service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:27.018409 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:27.019421 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:27.019795 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:27.020159 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] PATH_INFO: `/v3/users/2b97930345a6491eb5625dc8a65fc7ec` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:27.021551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b97930345a6491eb5625dc8a65fc7ec)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:27.023513 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:27.074299 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b97930345a6491eb5625dc8a65fc7ec'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.082256 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b97930345a6491eb5625dc8a65fc7ec'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.090067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b97930345a6491eb5625dc8a65fc7ec'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.110014 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b97930345a6491eb5625dc8a65fc7ec'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.111127 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b97930345a6491eb5625dc8a65fc7ec'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.121445 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1431/2852] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:26 2022] DELETE /identity/v3/users/2b97930345a6491eb5625dc8a65fc7ec => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:27.128602 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57f04d-14da-4ba8-9b6a-e62712113613 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:27.129183 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57f04d-14da-4ba8-9b6a-e62712113613 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:27.129512 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57f04d-14da-4ba8-9b6a-e62712113613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:27.157178 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2a57f04d-14da-4ba8-9b6a-e62712113613 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:27.159143 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2a57f04d-14da-4ba8-9b6a-e62712113613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:27.257710 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1422/2853] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:27.271021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:27.272990 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:27.291129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:27.346725 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b9b3c-8e43-4bd5-81f8-5d1194ee9685 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:27.350991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4c09-87a5-46c6-9bf8-d48c19acc5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:27.351687 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4c09-87a5-46c6-9bf8-d48c19acc5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:27.351969 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4c09-87a5-46c6-9bf8-d48c19acc5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:27.352231 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4c09-87a5-46c6-9bf8-d48c19acc5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:27.363554 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c4c09-87a5-46c6-9bf8-d48c19acc5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:27.365239 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c4c09-87a5-46c6-9bf8-d48c19acc5f5 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:27.376834 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1432/2854] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:27.687094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57f04d-14da-4ba8-9b6a-e62712113613 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:27.688588 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2a57f04d-14da-4ba8-9b6a-e62712113613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:27.701509 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57f04d-14da-4ba8-9b6a-e62712113613 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:27.706648 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:27.707638 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:27.707988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:27.708368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] PATH_INFO: `/v3/projects/4239de60325941fa9c25a95ba3d7c148` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:27.709901 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4239de60325941fa9c25a95ba3d7c148)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:27.712283 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:27.766784 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4239de60325941fa9c25a95ba3d7c148', 'request_id': 'req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.774679 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:27.788550 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4239de60325941fa9c25a95ba3d7c148', 'request_id': 'req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.795574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4239de60325941fa9c25a95ba3d7c148', 'request_id': 'req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.808125 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] The token cache is being invalidate because project 4239de60325941fa9c25a95ba3d7c148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:27.808419 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.809086 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.810727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1423/2855] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:27 2022] DELETE /identity/v3/projects/4239de60325941fa9c25a95ba3d7c148 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:27.815398 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4c09-87a5-46c6-9bf8-d48c19acc5f5 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:27.828638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4c09-87a5-46c6-9bf8-d48c19acc5f5 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:27.890466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c42de-945d-492e-87c6-dc185c55215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:27.891335 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c42de-945d-492e-87c6-dc185c55215d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:27.891636 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c42de-945d-492e-87c6-dc185c55215d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:27.891911 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c42de-945d-492e-87c6-dc185c55215d admin admin] PATH_INFO: `/v3/users/031b7e6d74e9475b83a2088919eac465` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:27.893209 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c42de-945d-492e-87c6-dc185c55215d admin admin] RBAC: Authorizing `identity:delete_user(user_id=031b7e6d74e9475b83a2088919eac465)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:27.895150 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c42de-945d-492e-87c6-dc185c55215d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:27.951436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b41c42de-945d-492e-87c6-dc185c55215d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031b7e6d74e9475b83a2088919eac465'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.962877 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b41c42de-945d-492e-87c6-dc185c55215d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031b7e6d74e9475b83a2088919eac465'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.971807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b41c42de-945d-492e-87c6-dc185c55215d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031b7e6d74e9475b83a2088919eac465'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.989434 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b41c42de-945d-492e-87c6-dc185c55215d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031b7e6d74e9475b83a2088919eac465'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.990245 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b41c42de-945d-492e-87c6-dc185c55215d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031b7e6d74e9475b83a2088919eac465'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:27.996668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1433/2856] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:27 2022] DELETE /identity/v3/users/031b7e6d74e9475b83a2088919eac465 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:28.299899 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:28.300425 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:28.317943 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5aab2-f0c5-4b03-9d1f-19effe4e96d1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:28.380109 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48458d-a2a9-454f-9ce7-638a8be06b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:28.380902 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48458d-a2a9-454f-9ce7-638a8be06b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:28.381219 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48458d-a2a9-454f-9ce7-638a8be06b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:28.381493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48458d-a2a9-454f-9ce7-638a8be06b5d admin admin] PATH_INFO: `/v3/projects/291041d137e04fcab2881cb34882b117` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:28.382687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48458d-a2a9-454f-9ce7-638a8be06b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=291041d137e04fcab2881cb34882b117)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:28.385084 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48458d-a2a9-454f-9ce7-638a8be06b5d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:28.434029 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c48458d-a2a9-454f-9ce7-638a8be06b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291041d137e04fcab2881cb34882b117', 'request_id': 'req-8c48458d-a2a9-454f-9ce7-638a8be06b5d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:28.441591 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c48458d-a2a9-454f-9ce7-638a8be06b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291041d137e04fcab2881cb34882b117', 'request_id': 'req-8c48458d-a2a9-454f-9ce7-638a8be06b5d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:28.447296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c48458d-a2a9-454f-9ce7-638a8be06b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291041d137e04fcab2881cb34882b117', 'request_id': 'req-8c48458d-a2a9-454f-9ce7-638a8be06b5d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:28.458988 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c48458d-a2a9-454f-9ce7-638a8be06b5d admin admin] The token cache is being invalidate because project 291041d137e04fcab2881cb34882b117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:28.459281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c48458d-a2a9-454f-9ce7-638a8be06b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:28.460004 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c48458d-a2a9-454f-9ce7-638a8be06b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:28.461717 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1424/2857] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:28 2022] DELETE /identity/v3/projects/291041d137e04fcab2881cb34882b117 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:28.467102 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1d588-4dfa-4305-ba95-c5225c05b417 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:28.467394 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1d588-4dfa-4305-ba95-c5225c05b417 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:28.467664 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1d588-4dfa-4305-ba95-c5225c05b417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:28.495137 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dce1d588-4dfa-4305-ba95-c5225c05b417 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:28.496949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dce1d588-4dfa-4305-ba95-c5225c05b417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:28.529179 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:28.563171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1434/2858] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:28.574261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80396304-72e8-4b4d-8422-350181efd898 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:28.574549 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80396304-72e8-4b4d-8422-350181efd898 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:28.574823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80396304-72e8-4b4d-8422-350181efd898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:28.594932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-80396304-72e8-4b4d-8422-350181efd898 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:28.596141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-80396304-72e8-4b4d-8422-350181efd898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:28.605039 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1425/2859] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:28.609988 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1d588-4dfa-4305-ba95-c5225c05b417 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:28.620280 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1d588-4dfa-4305-ba95-c5225c05b417 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:28.626707 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0440d-ed08-4275-b1cc-6b591cfab910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:28.627382 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0440d-ed08-4275-b1cc-6b591cfab910 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:28.627663 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0440d-ed08-4275-b1cc-6b591cfab910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:28.628021 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0440d-ed08-4275-b1cc-6b591cfab910 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:28.628715 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0440d-ed08-4275-b1cc-6b591cfab910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:28.629027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0440d-ed08-4275-b1cc-6b591cfab910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:28.630713 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0440d-ed08-4275-b1cc-6b591cfab910 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:28.643425 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1435/2860] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:38:28.647829 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80396304-72e8-4b4d-8422-350181efd898 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:28.658045 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80396304-72e8-4b4d-8422-350181efd898 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:28.663725 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e102d8-fa2d-478b-87d1-d5fd90fc5a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:28.664373 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e102d8-fa2d-478b-87d1-d5fd90fc5a8d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:28.664688 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e102d8-fa2d-478b-87d1-d5fd90fc5a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:28.664954 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e102d8-fa2d-478b-87d1-d5fd90fc5a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:28.665643 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e102d8-fa2d-478b-87d1-d5fd90fc5a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:28.667550 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e102d8-fa2d-478b-87d1-d5fd90fc5a8d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:28.695257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1426/2861] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:28 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:28.699585 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0440d-ed08-4275-b1cc-6b591cfab910 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:28.710340 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0440d-ed08-4275-b1cc-6b591cfab910 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:28.772780 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169c13b-f9cc-4ebe-bcf9-1bb70f207f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:28.773464 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169c13b-f9cc-4ebe-bcf9-1bb70f207f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:28.773740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169c13b-f9cc-4ebe-bcf9-1bb70f207f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:28.774012 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169c13b-f9cc-4ebe-bcf9-1bb70f207f9b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:28.774692 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169c13b-f9cc-4ebe-bcf9-1bb70f207f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:28.776671 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169c13b-f9cc-4ebe-bcf9-1bb70f207f9b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:28.799064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1436/2862] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:28 2022] POST /identity/v3/users => generated 280 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:28.803856 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e102d8-fa2d-478b-87d1-d5fd90fc5a8d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:28.815265 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e102d8-fa2d-478b-87d1-d5fd90fc5a8d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:28.821090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c0917-df51-4846-a980-db39fd1f6207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:28.821747 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c0917-df51-4846-a980-db39fd1f6207 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:28.822028 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c0917-df51-4846-a980-db39fd1f6207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:28.822306 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c0917-df51-4846-a980-db39fd1f6207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:28.823041 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c0917-df51-4846-a980-db39fd1f6207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:28.824691 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c0917-df51-4846-a980-db39fd1f6207 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:28.835846 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1427/2863] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:28.840020 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169c13b-f9cc-4ebe-bcf9-1bb70f207f9b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:28.850701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169c13b-f9cc-4ebe-bcf9-1bb70f207f9b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:28.855949 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d77a8-7ccf-4316-a584-dc549c4956e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:28.856674 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d77a8-7ccf-4316-a584-dc549c4956e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:28.856951 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d77a8-7ccf-4316-a584-dc549c4956e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:28.857222 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d77a8-7ccf-4316-a584-dc549c4956e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:28.857972 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d77a8-7ccf-4316-a584-dc549c4956e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:28.859718 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d77a8-7ccf-4316-a584-dc549c4956e6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:28.871746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1437/2864] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:28.876124 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c0917-df51-4846-a980-db39fd1f6207 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:28.887059 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c0917-df51-4846-a980-db39fd1f6207 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:28.892719 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a89555-7173-4545-9168-31f4da444127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:28.893617 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a89555-7173-4545-9168-31f4da444127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:28.893897 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a89555-7173-4545-9168-31f4da444127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:28.894172 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a89555-7173-4545-9168-31f4da444127 admin admin] PATH_INFO: `/v3/projects/3e38d7242929434e964dc5cd9063845b/users/c0f29402bf7646d5a56356083710f6d6/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:28.909494 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a89555-7173-4545-9168-31f4da444127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e38d7242929434e964dc5cd9063845b, user_id=c0f29402bf7646d5a56356083710f6d6, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:28.912238 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a89555-7173-4545-9168-31f4da444127 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:28.932207 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1428/2865] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:28 2022] PUT /identity/v3/projects/3e38d7242929434e964dc5cd9063845b/users/c0f29402bf7646d5a56356083710f6d6/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:28.945832 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7e19f-fc00-440f-9d60-c61152ee31e0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:28.946346 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7e19f-fc00-440f-9d60-c61152ee31e0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:28.946884 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7e19f-fc00-440f-9d60-c61152ee31e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:28.978080 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-27e7e19f-fc00-440f-9d60-c61152ee31e0 None None] MFA Rules not processed for user `c0f29402bf7646d5a56356083710f6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:28.979347 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-27e7e19f-fc00-440f-9d60-c61152ee31e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:29.047328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1438/2866] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:28 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:29.089487 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a89555-7173-4545-9168-31f4da444127 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:29.091712 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-67a89555-7173-4545-9168-31f4da444127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:29.099193 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:29.153606 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a89555-7173-4545-9168-31f4da444127 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:29.158214 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf2215-c026-40e9-b757-7e023ceacaa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:29.159151 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf2215-c026-40e9-b757-7e023ceacaa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:29.159527 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf2215-c026-40e9-b757-7e023ceacaa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:29.159923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf2215-c026-40e9-b757-7e023ceacaa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:29.174530 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf2215-c026-40e9-b757-7e023ceacaa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:29.176764 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf2215-c026-40e9-b757-7e023ceacaa5 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:29.190182 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1429/2867] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:29 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:29.204345 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7e19f-fc00-440f-9d60-c61152ee31e0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:29.235833 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:29.275740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7e19f-fc00-440f-9d60-c61152ee31e0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:29.280391 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:29.281374 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:29.281658 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:29.281934 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] PATH_INFO: `/v3/users/c0f29402bf7646d5a56356083710f6d6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:29.283161 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f29402bf7646d5a56356083710f6d6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:29.285158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:29.339889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f29402bf7646d5a56356083710f6d6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:29.348828 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f29402bf7646d5a56356083710f6d6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:29.357113 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f29402bf7646d5a56356083710f6d6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:29.370801 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f29402bf7646d5a56356083710f6d6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:29.371616 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f29402bf7646d5a56356083710f6d6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:29.378490 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1439/2868] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:29 2022] DELETE /identity/v3/users/c0f29402bf7646d5a56356083710f6d6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:29.383542 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d789f-d7d4-43ee-92f4-c022547000ae None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:29.384337 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d789f-d7d4-43ee-92f4-c022547000ae None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:29.384458 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d789f-d7d4-43ee-92f4-c022547000ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:29.403696 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-041d789f-d7d4-43ee-92f4-c022547000ae None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:29.404990 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-041d789f-d7d4-43ee-92f4-c022547000ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:29.473397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1430/2869] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:29.484535 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:29.486129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:29.550948 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02046377-e3fd-4cb3-b989-b26ca28d885c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:29.555452 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32f82b-db26-42b2-b0b8-e63dbde6b382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:29.556138 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32f82b-db26-42b2-b0b8-e63dbde6b382 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:29.556412 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32f82b-db26-42b2-b0b8-e63dbde6b382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:29.556785 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32f82b-db26-42b2-b0b8-e63dbde6b382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:29.567129 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32f82b-db26-42b2-b0b8-e63dbde6b382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:29.568637 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32f82b-db26-42b2-b0b8-e63dbde6b382 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:29.578915 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1440/2870] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:29.868741 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d789f-d7d4-43ee-92f4-c022547000ae None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:29.870443 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-041d789f-d7d4-43ee-92f4-c022547000ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:29.889329 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d789f-d7d4-43ee-92f4-c022547000ae None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:29.896889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72767382-8acf-47e7-b829-e7e22025ae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:29.898502 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72767382-8acf-47e7-b829-e7e22025ae4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:29.899062 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72767382-8acf-47e7-b829-e7e22025ae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:29.899684 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72767382-8acf-47e7-b829-e7e22025ae4b admin admin] PATH_INFO: `/v3/projects/3e38d7242929434e964dc5cd9063845b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:29.902100 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72767382-8acf-47e7-b829-e7e22025ae4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e38d7242929434e964dc5cd9063845b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:29.905386 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72767382-8acf-47e7-b829-e7e22025ae4b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:29.959117 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-72767382-8acf-47e7-b829-e7e22025ae4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e38d7242929434e964dc5cd9063845b', 'request_id': 'req-72767382-8acf-47e7-b829-e7e22025ae4b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:29.967498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-72767382-8acf-47e7-b829-e7e22025ae4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e38d7242929434e964dc5cd9063845b', 'request_id': 'req-72767382-8acf-47e7-b829-e7e22025ae4b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:29.973435 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-72767382-8acf-47e7-b829-e7e22025ae4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e38d7242929434e964dc5cd9063845b', 'request_id': 'req-72767382-8acf-47e7-b829-e7e22025ae4b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:29.984810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-72767382-8acf-47e7-b829-e7e22025ae4b admin admin] The token cache is being invalidate because project 3e38d7242929434e964dc5cd9063845b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:29.985131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-72767382-8acf-47e7-b829-e7e22025ae4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:29.985889 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-72767382-8acf-47e7-b829-e7e22025ae4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:29.987580 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1431/2871] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:29 2022] DELETE /identity/v3/projects/3e38d7242929434e964dc5cd9063845b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:29.992782 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d4210-d8f5-4527-9809-638549f4a626 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:29.993316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d4210-d8f5-4527-9809-638549f4a626 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:29.993316 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d4210-d8f5-4527-9809-638549f4a626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:30.013255 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-444d4210-d8f5-4527-9809-638549f4a626 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:30.014466 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-444d4210-d8f5-4527-9809-638549f4a626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:30.067564 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:30.086533 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1441/2872] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:30.095576 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad772f-f80d-4edd-a891-93131971692d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:30.095891 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad772f-f80d-4edd-a891-93131971692d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:30.096141 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad772f-f80d-4edd-a891-93131971692d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:30.116370 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-93ad772f-f80d-4edd-a891-93131971692d None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:30.117633 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-93ad772f-f80d-4edd-a891-93131971692d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:30.126545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1432/2873] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:30.130889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d4210-d8f5-4527-9809-638549f4a626 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:30.142019 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d4210-d8f5-4527-9809-638549f4a626 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:30.147220 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9da126-3f78-468f-a27c-2caa2ffecdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:30.148018 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9da126-3f78-468f-a27c-2caa2ffecdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:30.148294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9da126-3f78-468f-a27c-2caa2ffecdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:30.148587 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9da126-3f78-468f-a27c-2caa2ffecdb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:30.149315 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9da126-3f78-468f-a27c-2caa2ffecdb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:30.149628 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9da126-3f78-468f-a27c-2caa2ffecdb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:30.151254 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9da126-3f78-468f-a27c-2caa2ffecdb8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:30.163097 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1442/2874] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:38:30.220467 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad772f-f80d-4edd-a891-93131971692d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:30.230746 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad772f-f80d-4edd-a891-93131971692d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:30.238200 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb5329-a956-4fce-9181-e850a5c8770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:30.239162 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb5329-a956-4fce-9181-e850a5c8770b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:30.239504 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb5329-a956-4fce-9181-e850a5c8770b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:30.239853 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb5329-a956-4fce-9181-e850a5c8770b admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:30.240923 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb5329-a956-4fce-9181-e850a5c8770b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:30.243932 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb5329-a956-4fce-9181-e850a5c8770b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:30.282082 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1433/2875] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:30 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:30.287065 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9da126-3f78-468f-a27c-2caa2ffecdb8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:30.301998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9da126-3f78-468f-a27c-2caa2ffecdb8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:30.364083 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e517-24b2-4c92-84f5-4059d87f2e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:30.364980 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e517-24b2-4c92-84f5-4059d87f2e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:30.365296 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e517-24b2-4c92-84f5-4059d87f2e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:30.365638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e517-24b2-4c92-84f5-4059d87f2e0e admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:30.366666 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2e517-24b2-4c92-84f5-4059d87f2e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:30.369227 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2e517-24b2-4c92-84f5-4059d87f2e0e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:30.395099 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1443/2876] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:30 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:30.399545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb5329-a956-4fce-9181-e850a5c8770b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:30.406094 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:30.414092 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb5329-a956-4fce-9181-e850a5c8770b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:30.421540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cca56-41df-45b4-99cc-3bd70d2393c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:30.422531 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cca56-41df-45b4-99cc-3bd70d2393c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:30.422906 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cca56-41df-45b4-99cc-3bd70d2393c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:30.423303 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cca56-41df-45b4-99cc-3bd70d2393c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:30.424400 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cca56-41df-45b4-99cc-3bd70d2393c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:30.426241 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cca56-41df-45b4-99cc-3bd70d2393c1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:30.438170 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1434/2877] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:30.443026 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e517-24b2-4c92-84f5-4059d87f2e0e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:30.457322 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e517-24b2-4c92-84f5-4059d87f2e0e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:30.463810 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a614cf9-2007-41d3-81fe-3ec201b2304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:30.464520 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a614cf9-2007-41d3-81fe-3ec201b2304c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:30.464808 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a614cf9-2007-41d3-81fe-3ec201b2304c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:30.465064 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a614cf9-2007-41d3-81fe-3ec201b2304c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:30.465800 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a614cf9-2007-41d3-81fe-3ec201b2304c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:30.467415 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a614cf9-2007-41d3-81fe-3ec201b2304c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:30.478196 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1444/2878] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:30.482358 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cca56-41df-45b4-99cc-3bd70d2393c1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:30.492512 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cca56-41df-45b4-99cc-3bd70d2393c1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:30.497353 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf194633-96ac-4d9f-a070-a6b9bf42128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:30.498235 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf194633-96ac-4d9f-a070-a6b9bf42128d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:30.498515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf194633-96ac-4d9f-a070-a6b9bf42128d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:30.498788 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf194633-96ac-4d9f-a070-a6b9bf42128d admin admin] PATH_INFO: `/v3/projects/dba249d0998a42a6ba9d33d569f4c945/users/784194b75089414fbe4e4e7da17f5430/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:30.517921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf194633-96ac-4d9f-a070-a6b9bf42128d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba249d0998a42a6ba9d33d569f4c945, user_id=784194b75089414fbe4e4e7da17f5430, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:30.520875 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf194633-96ac-4d9f-a070-a6b9bf42128d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:30.538259 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1435/2879] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:30 2022] PUT /identity/v3/projects/dba249d0998a42a6ba9d33d569f4c945/users/784194b75089414fbe4e4e7da17f5430/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:30.548484 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a1ad6-c3f3-4e45-982b-8183fc2a914e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:30.548794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a1ad6-c3f3-4e45-982b-8183fc2a914e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:30.549171 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a1ad6-c3f3-4e45-982b-8183fc2a914e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:30.577032 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-012a1ad6-c3f3-4e45-982b-8183fc2a914e None None] MFA Rules not processed for user `784194b75089414fbe4e4e7da17f5430`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:30.578259 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-012a1ad6-c3f3-4e45-982b-8183fc2a914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:30.645328 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1445/2880] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:30.657894 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf194633-96ac-4d9f-a070-a6b9bf42128d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:30.659961 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bf194633-96ac-4d9f-a070-a6b9bf42128d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:30.723142 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf194633-96ac-4d9f-a070-a6b9bf42128d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:30.728296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d39af-aafc-4807-b7c2-4ae5ad5f9631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e44cec1e8ee4c82b104cf64ae0de6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:30.728996 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d39af-aafc-4807-b7c2-4ae5ad5f9631 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:30.729325 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d39af-aafc-4807-b7c2-4ae5ad5f9631 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:30.729640 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d39af-aafc-4807-b7c2-4ae5ad5f9631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:30.740053 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d39af-aafc-4807-b7c2-4ae5ad5f9631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:30.741569 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d39af-aafc-4807-b7c2-4ae5ad5f9631 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:30.751397 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1436/2881] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:38:33.850262 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a1ad6-c3f3-4e45-982b-8183fc2a914e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:33.905667 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:33.931889 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a1ad6-c3f3-4e45-982b-8183fc2a914e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:33.938097 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:33.939002 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:33.939279 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:33.939551 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] PATH_INFO: `/v3/users/784194b75089414fbe4e4e7da17f5430` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:33.941166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=784194b75089414fbe4e4e7da17f5430)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:33.943120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:33.998269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784194b75089414fbe4e4e7da17f5430'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.008519 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784194b75089414fbe4e4e7da17f5430'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.016679 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784194b75089414fbe4e4e7da17f5430'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.028768 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784194b75089414fbe4e4e7da17f5430'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.029436 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784194b75089414fbe4e4e7da17f5430'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.035538 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1446/2882] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:33 2022] DELETE /identity/v3/users/784194b75089414fbe4e4e7da17f5430 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:34.040334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524262f-9388-4ced-9b79-261b3a9fb205 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:34.040831 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524262f-9388-4ced-9b79-261b3a9fb205 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:34.040959 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524262f-9388-4ced-9b79-261b3a9fb205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:34.058519 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8524262f-9388-4ced-9b79-261b3a9fb205 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:34.059729 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8524262f-9388-4ced-9b79-261b3a9fb205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:34.137127 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1437/2883] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:34.147008 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:34.148743 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:34.220965 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e55e8-424e-4c4a-a6c8-d5cf51b47a36 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:34.225117 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0432bb-a97c-48ef-8b2e-b21d7665eebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:34.225906 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0432bb-a97c-48ef-8b2e-b21d7665eebd service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:34.226193 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0432bb-a97c-48ef-8b2e-b21d7665eebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:34.226493 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0432bb-a97c-48ef-8b2e-b21d7665eebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:34.237984 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0432bb-a97c-48ef-8b2e-b21d7665eebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:34.239442 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0432bb-a97c-48ef-8b2e-b21d7665eebd service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:34.251550 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1447/2884] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:34.566466 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524262f-9388-4ced-9b79-261b3a9fb205 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:34.568016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8524262f-9388-4ced-9b79-261b3a9fb205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:34.585558 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524262f-9388-4ced-9b79-261b3a9fb205 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:34.590505 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954ea5-5c12-466c-9fda-e46658f8a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:34.591422 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954ea5-5c12-466c-9fda-e46658f8a43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:34.591698 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954ea5-5c12-466c-9fda-e46658f8a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:34.591933 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954ea5-5c12-466c-9fda-e46658f8a43c admin admin] PATH_INFO: `/v3/projects/dba249d0998a42a6ba9d33d569f4c945` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:34.593179 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31954ea5-5c12-466c-9fda-e46658f8a43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba249d0998a42a6ba9d33d569f4c945)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:34.595096 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31954ea5-5c12-466c-9fda-e46658f8a43c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:34.649763 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-31954ea5-5c12-466c-9fda-e46658f8a43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba249d0998a42a6ba9d33d569f4c945', 'request_id': 'req-31954ea5-5c12-466c-9fda-e46658f8a43c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.658574 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-31954ea5-5c12-466c-9fda-e46658f8a43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba249d0998a42a6ba9d33d569f4c945', 'request_id': 'req-31954ea5-5c12-466c-9fda-e46658f8a43c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.665409 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-31954ea5-5c12-466c-9fda-e46658f8a43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba249d0998a42a6ba9d33d569f4c945', 'request_id': 'req-31954ea5-5c12-466c-9fda-e46658f8a43c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.666498 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:34.679969 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-31954ea5-5c12-466c-9fda-e46658f8a43c admin admin] The token cache is being invalidate because project dba249d0998a42a6ba9d33d569f4c945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:34.680253 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-31954ea5-5c12-466c-9fda-e46658f8a43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.680922 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-31954ea5-5c12-466c-9fda-e46658f8a43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.684715 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1438/2885] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:34 2022] DELETE /identity/v3/projects/dba249d0998a42a6ba9d33d569f4c945 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:34.690086 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c0699-a7c6-4ae4-85e0-4f03c03ef89b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:34.690370 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c0699-a7c6-4ae4-85e0-4f03c03ef89b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:34.690644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c0699-a7c6-4ae4-85e0-4f03c03ef89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:34.710188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-507c0699-a7c6-4ae4-85e0-4f03c03ef89b None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:34.711572 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-507c0699-a7c6-4ae4-85e0-4f03c03ef89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:34.777120 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1448/2886] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:34.788936 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cf8e9-9586-4077-a3e7-bbb69e1abde5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:34.789333 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cf8e9-9586-4077-a3e7-bbb69e1abde5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:34.789730 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cf8e9-9586-4077-a3e7-bbb69e1abde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:34.813310 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7a8cf8e9-9586-4077-a3e7-bbb69e1abde5 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:34.814540 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7a8cf8e9-9586-4077-a3e7-bbb69e1abde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:34.824055 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1439/2887] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:34.828598 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c0699-a7c6-4ae4-85e0-4f03c03ef89b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:34.838835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c0699-a7c6-4ae4-85e0-4f03c03ef89b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:34.845634 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5ad56-c6c2-4ad6-b5ba-ac4530d4501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:34.846269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ad56-c6c2-4ad6-b5ba-ac4530d4501d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:34.846544 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ad56-c6c2-4ad6-b5ba-ac4530d4501d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:34.846817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ad56-c6c2-4ad6-b5ba-ac4530d4501d admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:34.847548 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5ad56-c6c2-4ad6-b5ba-ac4530d4501d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:34.847824 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5ad56-c6c2-4ad6-b5ba-ac4530d4501d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:34.849641 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5ad56-c6c2-4ad6-b5ba-ac4530d4501d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:34.852291 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:34.863740 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1449/2888] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:38:34.868800 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cf8e9-9586-4077-a3e7-bbb69e1abde5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:34.881314 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cf8e9-9586-4077-a3e7-bbb69e1abde5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:34.887997 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2dd82-a4ea-4e31-bf0a-64b17814d71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:34.888673 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2dd82-a4ea-4e31-bf0a-64b17814d71c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:34.888955 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2dd82-a4ea-4e31-bf0a-64b17814d71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:34.889230 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2dd82-a4ea-4e31-bf0a-64b17814d71c admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:34.889938 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2dd82-a4ea-4e31-bf0a-64b17814d71c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:34.891859 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2dd82-a4ea-4e31-bf0a-64b17814d71c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:34.925258 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1440/2889] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:34 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:34.929998 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5ad56-c6c2-4ad6-b5ba-ac4530d4501d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:34.944172 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5ad56-c6c2-4ad6-b5ba-ac4530d4501d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:35.015929 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb38e-d240-4c42-b800-a72bc814db9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:35.016644 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb38e-d240-4c42-b800-a72bc814db9a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.016925 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb38e-d240-4c42-b800-a72bc814db9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.017202 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb38e-d240-4c42-b800-a72bc814db9a admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.017907 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bb38e-d240-4c42-b800-a72bc814db9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:35.019857 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bb38e-d240-4c42-b800-a72bc814db9a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:35.041397 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1450/2890] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:34 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:35.045883 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2dd82-a4ea-4e31-bf0a-64b17814d71c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:35.056732 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2dd82-a4ea-4e31-bf0a-64b17814d71c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:35.061318 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a678e-f548-47d2-9f95-36946a549c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:35.062003 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a678e-f548-47d2-9f95-36946a549c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.062284 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a678e-f548-47d2-9f95-36946a549c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.062563 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a678e-f548-47d2-9f95-36946a549c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.063304 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a678e-f548-47d2-9f95-36946a549c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:35.065381 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a678e-f548-47d2-9f95-36946a549c16 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:35.077020 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1441/2891] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:35.081090 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb38e-d240-4c42-b800-a72bc814db9a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:35.092067 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb38e-d240-4c42-b800-a72bc814db9a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:35.097743 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d22f9-e62a-4ff1-85f8-e3dc1e4b553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:35.098402 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d22f9-e62a-4ff1-85f8-e3dc1e4b553a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.098646 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d22f9-e62a-4ff1-85f8-e3dc1e4b553a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.098941 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d22f9-e62a-4ff1-85f8-e3dc1e4b553a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.099676 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d22f9-e62a-4ff1-85f8-e3dc1e4b553a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:35.101502 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d22f9-e62a-4ff1-85f8-e3dc1e4b553a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:35.112817 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1451/2892] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:35.117618 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a678e-f548-47d2-9f95-36946a549c16 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:35.129133 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a678e-f548-47d2-9f95-36946a549c16 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:35.135886 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a60587-fa9d-4434-8610-d3e8d4b0e2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:35.136810 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a60587-fa9d-4434-8610-d3e8d4b0e2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.137090 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a60587-fa9d-4434-8610-d3e8d4b0e2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.137359 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a60587-fa9d-4434-8610-d3e8d4b0e2fd admin admin] PATH_INFO: `/v3/projects/8e25eb81d5ab44bb8a5970ad208f4d2a/users/8e907ff5e96e4ad19c8072c17546b652/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.152823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a60587-fa9d-4434-8610-d3e8d4b0e2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e25eb81d5ab44bb8a5970ad208f4d2a, user_id=8e907ff5e96e4ad19c8072c17546b652, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:35.155483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a60587-fa9d-4434-8610-d3e8d4b0e2fd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:35.171016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1442/2893] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:35 2022] PUT /identity/v3/projects/8e25eb81d5ab44bb8a5970ad208f4d2a/users/8e907ff5e96e4ad19c8072c17546b652/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:35.183569 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f18ff-d244-4140-8495-ea825275e1c2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.183794 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f18ff-d244-4140-8495-ea825275e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.184223 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f18ff-d244-4140-8495-ea825275e1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.214049 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-934f18ff-d244-4140-8495-ea825275e1c2 None None] MFA Rules not processed for user `8e907ff5e96e4ad19c8072c17546b652`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:35.215273 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-934f18ff-d244-4140-8495-ea825275e1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:35.288835 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1452/2894] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:35.302546 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a60587-fa9d-4434-8610-d3e8d4b0e2fd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:35.304604 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-47a60587-fa9d-4434-8610-d3e8d4b0e2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:35.397678 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a60587-fa9d-4434-8610-d3e8d4b0e2fd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:35.402034 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1b6c3-e357-46ed-ac59-93b0dd78f7c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f9a6f6d6d840d6bc29fd0ab26ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:35.402724 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1b6c3-e357-46ed-ac59-93b0dd78f7c0 service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.402984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1b6c3-e357-46ed-ac59-93b0dd78f7c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.403281 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1b6c3-e357-46ed-ac59-93b0dd78f7c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.416771 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1b6c3-e357-46ed-ac59-93b0dd78f7c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:35.418245 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1b6c3-e357-46ed-ac59-93b0dd78f7c0 service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:35.430334 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1443/2895] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:45.285786 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:45.423599 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=65,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:57.368571 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f18ff-d244-4140-8495-ea825275e1c2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:57.440769 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f18ff-d244-4140-8495-ea825275e1c2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:57.447045 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:57.448357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:57.448357 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:57.448609 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] PATH_INFO: `/v3/users/8e907ff5e96e4ad19c8072c17546b652` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:57.450406 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e907ff5e96e4ad19c8072c17546b652)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:57.452904 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:57.510559 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e907ff5e96e4ad19c8072c17546b652'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:57.519880 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e907ff5e96e4ad19c8072c17546b652'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:57.527048 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e907ff5e96e4ad19c8072c17546b652'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:57.540132 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e907ff5e96e4ad19c8072c17546b652'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:57.540893 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e907ff5e96e4ad19c8072c17546b652'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:57.547542 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1453/2896] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:57 2022] DELETE /identity/v3/users/8e907ff5e96e4ad19c8072c17546b652 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:57.552209 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc921abd-73d6-43d0-9cf2-f977f4af7d1f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:57.552921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc921abd-73d6-43d0-9cf2-f977f4af7d1f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:57.552921 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc921abd-73d6-43d0-9cf2-f977f4af7d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:57.570710 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-cc921abd-73d6-43d0-9cf2-f977f4af7d1f None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:57.571920 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cc921abd-73d6-43d0-9cf2-f977f4af7d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:57.634520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1444/2897] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:57.644525 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:57.646135 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:57.704128 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb00786-3798-4975-860c-14602d28e955 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:57.707939 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a35629-2955-4870-8f73-15862dec0145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:57.708618 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a35629-2955-4870-8f73-15862dec0145 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:57.708896 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a35629-2955-4870-8f73-15862dec0145 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:57.709165 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a35629-2955-4870-8f73-15862dec0145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:57.719106 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a35629-2955-4870-8f73-15862dec0145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:57.720581 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a35629-2955-4870-8f73-15862dec0145 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:57.731167 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1454/2898] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:58.014159 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc921abd-73d6-43d0-9cf2-f977f4af7d1f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:58.015687 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cc921abd-73d6-43d0-9cf2-f977f4af7d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:58.030931 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc921abd-73d6-43d0-9cf2-f977f4af7d1f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:58.036036 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868eccf-2e7c-4285-936d-da2f522cc877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:58.036937 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868eccf-2e7c-4285-936d-da2f522cc877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:58.037216 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868eccf-2e7c-4285-936d-da2f522cc877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:58.037493 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868eccf-2e7c-4285-936d-da2f522cc877 admin admin] PATH_INFO: `/v3/projects/8e25eb81d5ab44bb8a5970ad208f4d2a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:58.038814 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868eccf-2e7c-4285-936d-da2f522cc877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e25eb81d5ab44bb8a5970ad208f4d2a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:58.040850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868eccf-2e7c-4285-936d-da2f522cc877 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:58.090380 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0868eccf-2e7c-4285-936d-da2f522cc877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e25eb81d5ab44bb8a5970ad208f4d2a', 'request_id': 'req-0868eccf-2e7c-4285-936d-da2f522cc877'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:58.101399 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0868eccf-2e7c-4285-936d-da2f522cc877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e25eb81d5ab44bb8a5970ad208f4d2a', 'request_id': 'req-0868eccf-2e7c-4285-936d-da2f522cc877'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:58.109407 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0868eccf-2e7c-4285-936d-da2f522cc877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e25eb81d5ab44bb8a5970ad208f4d2a', 'request_id': 'req-0868eccf-2e7c-4285-936d-da2f522cc877'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:58.123300 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0868eccf-2e7c-4285-936d-da2f522cc877 admin admin] The token cache is being invalidate because project 8e25eb81d5ab44bb8a5970ad208f4d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:58.123594 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0868eccf-2e7c-4285-936d-da2f522cc877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:58.124335 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0868eccf-2e7c-4285-936d-da2f522cc877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:58.126205 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1445/2899] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:58 2022] DELETE /identity/v3/projects/8e25eb81d5ab44bb8a5970ad208f4d2a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:58.133682 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba88297-2700-479a-b607-09b429c8cada None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:58.133976 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba88297-2700-479a-b607-09b429c8cada None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:58.135478 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba88297-2700-479a-b607-09b429c8cada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:58.156746 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4ba88297-2700-479a-b607-09b429c8cada None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:58.157966 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4ba88297-2700-479a-b607-09b429c8cada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:58.183354 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:58.233807 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1455/2900] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:58.241727 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ea98-b82f-4b3f-834b-68404b76a1d1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:58.242016 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ea98-b82f-4b3f-834b-68404b76a1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:58.242299 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ea98-b82f-4b3f-834b-68404b76a1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:58.261064 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f3d7ea98-b82f-4b3f-834b-68404b76a1d1 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:58.262250 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f3d7ea98-b82f-4b3f-834b-68404b76a1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:58.270843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1446/2901] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:58.275302 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba88297-2700-479a-b607-09b429c8cada None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:58.286010 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba88297-2700-479a-b607-09b429c8cada None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:58.291573 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebca3a-8b6e-434d-af11-24965f4f673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:58.292250 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebca3a-8b6e-434d-af11-24965f4f673c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:58.292566 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebca3a-8b6e-434d-af11-24965f4f673c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:58.292831 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebca3a-8b6e-434d-af11-24965f4f673c admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:58.293561 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebca3a-8b6e-434d-af11-24965f4f673c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:58.293852 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebca3a-8b6e-434d-af11-24965f4f673c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:58.295474 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebca3a-8b6e-434d-af11-24965f4f673c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:58.308027 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1456/2902] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:38:58.312520 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7ea98-b82f-4b3f-834b-68404b76a1d1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:58.322801 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7ea98-b82f-4b3f-834b-68404b76a1d1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:58.328970 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaa719-57da-451a-b90f-1b865c1b1592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:58.329642 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaa719-57da-451a-b90f-1b865c1b1592 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:58.329925 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaa719-57da-451a-b90f-1b865c1b1592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:58.330199 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaa719-57da-451a-b90f-1b865c1b1592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:58.330904 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaa719-57da-451a-b90f-1b865c1b1592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:58.332843 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaa719-57da-451a-b90f-1b865c1b1592 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:58.363002 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1447/2903] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:58 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:58.368799 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebca3a-8b6e-434d-af11-24965f4f673c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:58.379353 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebca3a-8b6e-434d-af11-24965f4f673c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:58.439818 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74cb12-9715-40f8-aa6a-a85eaa083ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:58.440516 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74cb12-9715-40f8-aa6a-a85eaa083ece admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:58.440802 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74cb12-9715-40f8-aa6a-a85eaa083ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:58.441075 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74cb12-9715-40f8-aa6a-a85eaa083ece admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:58.441774 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74cb12-9715-40f8-aa6a-a85eaa083ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:58.443701 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74cb12-9715-40f8-aa6a-a85eaa083ece admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:58.470946 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1457/2904] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:58 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:58.475231 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaa719-57da-451a-b90f-1b865c1b1592 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:58.496296 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaa719-57da-451a-b90f-1b865c1b1592 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:58.501983 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417a8c-9427-4adc-920f-bfab684dcdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:58.502674 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417a8c-9427-4adc-920f-bfab684dcdcb admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:58.502953 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417a8c-9427-4adc-920f-bfab684dcdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:58.503229 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417a8c-9427-4adc-920f-bfab684dcdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:58.503970 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72417a8c-9427-4adc-920f-bfab684dcdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:58.505636 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72417a8c-9427-4adc-920f-bfab684dcdcb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:58.517789 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1448/2905] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:58.521992 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74cb12-9715-40f8-aa6a-a85eaa083ece admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:58.533208 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74cb12-9715-40f8-aa6a-a85eaa083ece admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:58.538062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c7e05-548e-4c76-9195-bc299781a6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:58.538725 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c7e05-548e-4c76-9195-bc299781a6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:58.539005 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c7e05-548e-4c76-9195-bc299781a6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:58.539376 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c7e05-548e-4c76-9195-bc299781a6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:58.540110 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c7e05-548e-4c76-9195-bc299781a6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:58.541753 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c7e05-548e-4c76-9195-bc299781a6e8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:58.552166 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1458/2906] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:58.557192 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417a8c-9427-4adc-920f-bfab684dcdcb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:58.567545 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417a8c-9427-4adc-920f-bfab684dcdcb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:58.573033 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f5654-2d44-4875-ac53-b1d51f41aa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:58.573910 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f5654-2d44-4875-ac53-b1d51f41aa5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:58.574184 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f5654-2d44-4875-ac53-b1d51f41aa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:58.574457 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f5654-2d44-4875-ac53-b1d51f41aa5b admin admin] PATH_INFO: `/v3/projects/0435161851b546c2a8b0ad53cda74197/users/186df025d5a0424b970d1388fb02edd3/roles/2363304f42424934b09a0ff0bc62315d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:58.589634 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f5654-2d44-4875-ac53-b1d51f41aa5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0435161851b546c2a8b0ad53cda74197, user_id=186df025d5a0424b970d1388fb02edd3, role_id=2363304f42424934b09a0ff0bc62315d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:58.592295 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f5654-2d44-4875-ac53-b1d51f41aa5b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:58.607651 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1449/2907] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:58 2022] PUT /identity/v3/projects/0435161851b546c2a8b0ad53cda74197/users/186df025d5a0424b970d1388fb02edd3/roles/2363304f42424934b09a0ff0bc62315d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:58.619748 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec43c5-7d1c-440b-af15-ddabdcb9fcaf None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:58.620006 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec43c5-7d1c-440b-af15-ddabdcb9fcaf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:58.620331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec43c5-7d1c-440b-af15-ddabdcb9fcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:58.650269 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c9ec43c5-7d1c-440b-af15-ddabdcb9fcaf None None] MFA Rules not processed for user `186df025d5a0424b970d1388fb02edd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:58.651459 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c9ec43c5-7d1c-440b-af15-ddabdcb9fcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:58.722052 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1459/2908] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:38:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:58.733737 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f5654-2d44-4875-ac53-b1d51f41aa5b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:58.735484 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cf9f5654-2d44-4875-ac53-b1d51f41aa5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:58.760261 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:58.801762 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f5654-2d44-4875-ac53-b1d51f41aa5b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:58.805783 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696642a0-c022-4a97-8684-8229b53cebf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f9a6f6d6d840d6bc29fd0ab26ddb29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:58.806434 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696642a0-c022-4a97-8684-8229b53cebf2 service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:58.806709 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696642a0-c022-4a97-8684-8229b53cebf2 service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:58.806984 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696642a0-c022-4a97-8684-8229b53cebf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:58.815877 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696642a0-c022-4a97-8684-8229b53cebf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:58.817356 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696642a0-c022-4a97-8684-8229b53cebf2 service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:58.829617 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1450/2909] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:08.718797 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:08.822718 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=17 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:19.434393 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec43c5-7d1c-440b-af15-ddabdcb9fcaf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:19.509003 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec43c5-7d1c-440b-af15-ddabdcb9fcaf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:19.514495 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:19.515322 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:19.515601 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:19.515873 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] PATH_INFO: `/v3/users/186df025d5a0424b970d1388fb02edd3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:19.517122 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=186df025d5a0424b970d1388fb02edd3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:19.519093 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:19.581188 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '186df025d5a0424b970d1388fb02edd3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:19.590654 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '186df025d5a0424b970d1388fb02edd3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:19.597689 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '186df025d5a0424b970d1388fb02edd3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:19.611668 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '186df025d5a0424b970d1388fb02edd3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:19.612505 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '186df025d5a0424b970d1388fb02edd3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:19.619229 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1460/2910] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:19 2022] DELETE /identity/v3/users/186df025d5a0424b970d1388fb02edd3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:19.625757 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fa6f9-32fc-423b-9f0f-a2364212c561 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:19.626257 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fa6f9-32fc-423b-9f0f-a2364212c561 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:19.626357 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fa6f9-32fc-423b-9f0f-a2364212c561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:19.650405 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-247fa6f9-32fc-423b-9f0f-a2364212c561 None None] MFA Rules not processed for user `51be48ea284046818e95b0cd55b089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:19.651645 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-247fa6f9-32fc-423b-9f0f-a2364212c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:19.863677 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1451/2911] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 21 08:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:19.875181 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:19.876892 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:19.940284 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd89fd1-dbd4-4a71-ad9c-0754560b6f42 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:19.944300 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469ec1e-147e-46dc-9937-7f6234c354f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a267cec6fb4dbea619f0a77b5674dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:19.944991 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469ec1e-147e-46dc-9937-7f6234c354f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:19.945275 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469ec1e-147e-46dc-9937-7f6234c354f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:19.945577 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469ec1e-147e-46dc-9937-7f6234c354f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:19.955126 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469ec1e-147e-46dc-9937-7f6234c354f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:19.956638 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469ec1e-147e-46dc-9937-7f6234c354f5 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:19.969547 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1461/2912] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:20.249823 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fa6f9-32fc-423b-9f0f-a2364212c561 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:20.251377 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-247fa6f9-32fc-423b-9f0f-a2364212c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:20.263610 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fa6f9-32fc-423b-9f0f-a2364212c561 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:20.268483 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c0808-c438-4c05-9989-21280a8f1987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51be48ea284046818e95b0cd55b089e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9abea4928641f4840c146c33d7e1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:20.269368 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c0808-c438-4c05-9989-21280a8f1987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:20.269645 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c0808-c438-4c05-9989-21280a8f1987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:20.270777 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c0808-c438-4c05-9989-21280a8f1987 admin admin] PATH_INFO: `/v3/projects/0435161851b546c2a8b0ad53cda74197` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:20.272185 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c0808-c438-4c05-9989-21280a8f1987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0435161851b546c2a8b0ad53cda74197)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:20.274185 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c0808-c438-4c05-9989-21280a8f1987 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:20.326553 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5d8c0808-c438-4c05-9989-21280a8f1987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0435161851b546c2a8b0ad53cda74197', 'request_id': 'req-5d8c0808-c438-4c05-9989-21280a8f1987'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:20.334362 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5d8c0808-c438-4c05-9989-21280a8f1987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0435161851b546c2a8b0ad53cda74197', 'request_id': 'req-5d8c0808-c438-4c05-9989-21280a8f1987'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:20.340063 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5d8c0808-c438-4c05-9989-21280a8f1987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0435161851b546c2a8b0ad53cda74197', 'request_id': 'req-5d8c0808-c438-4c05-9989-21280a8f1987'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:20.351566 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5d8c0808-c438-4c05-9989-21280a8f1987 admin admin] The token cache is being invalidate because project 0435161851b546c2a8b0ad53cda74197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:20.351850 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5d8c0808-c438-4c05-9989-21280a8f1987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:20.352515 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5d8c0808-c438-4c05-9989-21280a8f1987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:20.354131 dv-cinder-850318-4-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1452/2913] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:20 2022] DELETE /identity/v3/projects/0435161851b546c2a8b0ad53cda74197 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:29.963062 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:30.348465 dv-cinder-850318-4-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:05.132524 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469ec1e-147e-46dc-9937-7f6234c354f5 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:41:05.134522 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2469ec1e-147e-46dc-9937-7f6234c354f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:05.215621 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469ec1e-147e-46dc-9937-7f6234c354f5 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:41:05.289098 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c28c9-ef21-46b4-9d24-c1e67cf4172c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd9ea435d7b48cb8b1b2a27d79cfa91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c487ed72a15c45faa40f743ae752e48b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:41:05.289691 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c28c9-ef21-46b4-9d24-c1e67cf4172c service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:05.289971 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c28c9-ef21-46b4-9d24-c1e67cf4172c service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:05.290271 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c28c9-ef21-46b4-9d24-c1e67cf4172c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:05.292331 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-917c28c9-ef21-46b4-9d24-c1e67cf4172c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:05.305294 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c28c9-ef21-46b4-9d24-c1e67cf4172c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:41:05.307054 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c28c9-ef21-46b4-9d24-c1e67cf4172c service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:41:05.318722 dv-cinder-850318-4-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1462/2914] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 21 08:41:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:41:15.319158 dv-cinder-850318-4-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=58 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}